Skip to main content

Topic: Enhanced AAC+, how to compare quality between original file and decode (Read 4819 times) previous topic - next topic

0 Members and 1 Guest are viewing this topic.
Enhanced AAC+, how to compare quality between original file and decode
Hello,I'm doing with Enhanced aac+ codec, i met a problem ,is there someone knows which tool can be used to calculate the quality between original .wav file and the decoder output .wav file ?
I tried PEAQ, but the ODG value seems very low even though i did not add any error to the stream file.3gp.
Because the decoder output file is delayed, and the length between two files is different, so i shift the decoder output file and made the two files have same length, but still doesn't work, does someone know how to modify PEAQ or the two files?
Thanks.

  • greynol
  • [*][*][*][*][*]
  • Global Moderator
Enhanced AAC+, how to compare quality between original file and decode
Reply #1
  • Last Edit: 19 September, 2012, 11:40:14 AM by greynol
13 February 2016: The world was blessed with the passing of a truly vile and wretched person.

Your eyes cannot hear.

  • C.R.Helmrich
  • [*][*][*][*][*]
  • Developer
Enhanced AAC+, how to compare quality between original file and decode
Reply #2
Regarding PEAQ:

  • Make sure both input (reference) and decoded (test) file are sampled at 48 kHz, since IIRC that's required by the PEAQ algorithm. Resample if necessary. You can encode from and to 44.1 kHz, though.
  • PEAQ mainly compares waveforms, so it doesn't give you any meaningful information on HE-AAC with its parametric stereo and bandwidth Extension (the ODGs are too low). See greynol's links.


Chris
If I don't reply to your reply, it means I agree with you.

Enhanced AAC+, how to compare quality between original file and decode
Reply #3
Regarding PEAQ:

  • Make sure both input (reference) and decoded (test) file are sampled at 48 kHz, since IIRC that's required by the PEAQ algorithm. Resample if necessary. You can encode from and to 44.1 kHz, though.
  • PEAQ mainly compares waveforms, so it doesn't give you any meaningful information on HE-AAC with its parametric stereo and bandwidth Extension (the ODGs are too low). See greynol's links.


Chris

Thanks.
both files are 48khz.
do you mean for the aac part, i can use PEAQ, but because Enhanced AAC+  includes the SBR+PS,so I can not use PEAQ ,right?
SO I can only use the subjective listening test , how about mushra test?

Enhanced AAC+, how to compare quality between original file and decode
Reply #4

  • C.R.Helmrich
  • [*][*][*][*][*]
  • Developer
Enhanced AAC+, how to compare quality between original file and decode
Reply #5
... how about mushra test?

Correct, for the AAC-LC part at high bitrates, you can use PEAQ, but you must average ODGs over many items to get reliable results. Yes, for SBR/PS, use a blind testing methodology like MUSHRA (if you have corresponding test software). ABC-HR is almost the same (but doesn't require a 3.5-kHz anchor condition) and works equally well.

Chris
  • Last Edit: 20 September, 2012, 05:19:54 AM by C.R.Helmrich
If I don't reply to your reply, it means I agree with you.

Enhanced AAC+, how to compare quality between original file and decode
Reply #6
... how about mushra test?

Correct, for the AAC-LC part at high bitrates, you can use PEAQ, but you must average ODGs over many items to get reliable results. Yes, for SBR/PS, use a blind testing methodology like MUSHRA (if you have corresponding test software). ABC-HR is almost the same (but doesn't require a 3.5-kHz anchor condition) and works equally well.

Chris

Thanks again.
1;could you please tell me how did you find  the PEAQ is not good for SBR/PS?
2\do you know how to download the MUSHRA test software or ABC-HR?( i never did subjective listening test before)  i followed the 'Programs for Performing Blind Listening Tests' in the link http://wiki.hydrogenaudio.org/index.php?title=ABX ,but i can not open it
3\ do you know how to use only AAC-LC part ,do not use SBR/PS?
My question seems too much. sorry to trouble you ,and thank you very much.

  • Garf
  • [*][*][*][*][*]
  • Developer (Donating)
Enhanced AAC+, how to compare quality between original file and decode
Reply #7
1;could you please tell me how did you find  the PEAQ is not good for SBR/PS?


By doing listening tests and seeing that the PEAQ output is completely uncorrelated with the result. As far as I can tell from your first post, you already found this yourself.

PEAQ records some crude information about the distortion and tries to match this to listening test results. If the distortion introduced is of a form PEAQ can't understand, or if the encoder is smarter and has a more advanced model of the human ear than PEAQ, it will give completely wrong results.

Quote
2\do you know how to download the MUSHRA test software or ABC-HR?


Try this one:
http://www.hydrogenaudio.org/forums/index....showtopic=32128

Quote
3\ do you know how to use only AAC-LC part ,do not use SBR/PS?


Perhaps that could be done by compiling a version of FAAD2, but disabling the HE-AAC decoding part of it.

  • greynol
  • [*][*][*][*][*]
  • Global Moderator
Enhanced AAC+, how to compare quality between original file and decode
Reply #8
If you are only comparing one lossy encoding against the original lossless source then you should use ABX instead of ABC/HR, though the later can be used like ABX but you have to conduct multiple trials in order to get any statistical significance.
13 February 2016: The world was blessed with the passing of a truly vile and wretched person.

Your eyes cannot hear.

Enhanced AAC+, how to compare quality between original file and decode
Reply #9
If you are only comparing one lossy encoding against the original lossless source then you should use ABX instead of ABC/HR, though the later can be used like ABX but you have to conduct multiple trials in order to get any statistical significance.

thanks, but I can't download the ABX from the link ,do you have other way to download ?

Enhanced AAC+, how to compare quality between original file and decode
Reply #10
1;could you please tell me how did you find  the PEAQ is not good for SBR/PS?


By doing listening tests and seeing that the PEAQ output is completely uncorrelated with the result. As far as I can tell from your first post, you already found this yourself.

PEAQ records some crude information about the distortion and tries to match this to listening test results. If the distortion introduced is of a form PEAQ can't understand, or if the encoder is smarter and has a more advanced model of the human ear than PEAQ, it will give completely wrong results.




thank you very much , i just want to ask where can I find the theory reason.

could you please tell me which listening tool do you use?

  • greynol
  • [*][*][*][*][*]
  • Global Moderator
Enhanced AAC+, how to compare quality between original file and decode
Reply #11
If you are only comparing one lossy encoding against the original lossless source then you should use ABX instead of ABC/HR, though the later can be used like ABX but you have to conduct multiple trials in order to get any statistical significance.

thanks, but I can't download the ABX from the link ,do you have other way to download ?

Have you tried searching the web?
13 February 2016: The world was blessed with the passing of a truly vile and wretched person.

Your eyes cannot hear.