HydrogenAudio

Lossy Audio Compression => AAC => AAC - General => Topic started by: Garf on 2004-06-08 23:04:13

Title: Want to test the next generation AAC encoders?
Post by: Garf on 2004-06-08 23:04:13
...then we can use your help!

We are working on the low bitrate AAC encoders, and need some more feedback to make decisions.

At low bitrates, sometimes what sounds best is an issue of what sounds least bad...so we want to know what you think sounds least bad  At the same time you can get an impression what is up-and-coming in AAC.

Download this first:

http://www.audiocoding.com/listening_tests/decode.rar (http://www.audiocoding.com/listening_tests/decode.rar)

Links to samples:

http://www.audiocoding.com/listening_tests/sample1.rar (http://www.audiocoding.com/listening_tests/sample1.rar)
http://www.audiocoding.com/listening_tests/sample2.rar (http://www.audiocoding.com/listening_tests/sample2.rar)
http://www.audiocoding.com/listening_tests/sample3.rar (http://www.audiocoding.com/listening_tests/sample3.rar)
http://www.audiocoding.com/listening_tests/sample4.rar (http://www.audiocoding.com/listening_tests/sample4.rar)
http://www.audiocoding.com/listening_tests/sample5.rar (http://www.audiocoding.com/listening_tests/sample5.rar)
http://www.audiocoding.com/listening_tests/sample6.rar (http://www.audiocoding.com/listening_tests/sample6.rar)
http://www.audiocoding.com/listening_tests/sample7.rar (http://www.audiocoding.com/listening_tests/sample7.rar)
http://www.audiocoding.com/listening_tests/sample8.rar (http://www.audiocoding.com/listening_tests/sample8.rar)
http://www.audiocoding.com/listening_tests/sample9.rar (http://www.audiocoding.com/listening_tests/sample9.rar)
http://www.audiocoding.com/listening_tests/sample10.rar (http://www.audiocoding.com/listening_tests/sample10.rar)
http://www.audiocoding.com/listening_tests/sample11.rar (http://www.audiocoding.com/listening_tests/sample11.rar)

Put them all in the same dir and run the decode.bat.

And compare the A B and C files to the reference. Grade them from
0 to 5 and make a few notes on what your impressisons of them are.

ABC/HR may come in handy for that:
http://ff123.net/abchr/abchr.html (http://ff123.net/abchr/abchr.html)

Send your results to gcp@sjeng.org. Thanks for the help!
Title: Want to test the next generation AAC encoders?
Post by: Sebastian Mares on 2004-06-08 23:19:48
When will this test end? I would be glad to participate, but I can only start on Saturday.
Title: Want to test the next generation AAC encoders?
Post by: negritot on 2004-06-08 23:28:15
Windows only?
Title: Want to test the next generation AAC encoders?
Post by: harashin on 2004-06-08 23:56:31
These lines in decode.bat don't seem to be correct.
Code: [Select]
flac -d .\sample1\sample1.flac
flac -d .\sample1\sample2.flac
flac -d .\sample1\sample3.flac
flac -d .\sample1\sample4.flac
flac -d .\sample1\sample5.flac
flac -d .\sample1\sample6.flac
flac -d .\sample1\sample7.flac
flac -d .\sample1\sample8.flac
flac -d .\sample1\sample9.flac
flac -d .\sample1\sample10.flac
flac -d .\sample1\sample11.flac
Title: Want to test the next generation AAC encoders?
Post by: WarBird on 2004-06-09 00:32:38
Quote
These lines in decode.bat don't seem to be correct.

Was just about to comment on that... it doesn't only "seem" to not be correct, it's obviously not    should be easy enough to fix for most people, before garf fixes the .bat himself
Title: Want to test the next generation AAC encoders?
Post by: Ivan Dimkovic on 2004-06-09 06:19:00
Sorry for that - file is fixed now
Title: Want to test the next generation AAC encoders?
Post by: Garf on 2004-06-09 06:22:14
Quote
Windows only?

Should be possible on Linux too, though you'll have to decode the files manually. The public FAAD source can handle them. So basically you just have to find an AAC and FLAC decoder for Linux or your OS of choice...

Thanks to everyone that sent results so far!
Title: Want to test the next generation AAC encoders?
Post by: negritot on 2004-06-09 07:08:05
One more question: will the OS X binary from rarewares work for decoding these files?

http://www.rarewares.org/aac.html (http://www.rarewares.org/aac.html)
Title: Want to test the next generation AAC encoders?
Post by: plonk420 on 2004-06-09 07:51:00
THIS i can do, but, as others have asked, when will it end? i get back from Cali on friday...
Title: Want to test the next generation AAC encoders?
Post by: Garf on 2004-06-09 10:03:59
Quote
One more question: will the OS X binary from rarewares work for decoding these files?

http://www.rarewares.org/aac.html (http://www.rarewares.org/aac.html)

It is dated 2003-09-15, which would be too old...we fixed and improved a lot of things since then.

Maybe someone can do a new compile based on new FAAD sources.
Title: Want to test the next generation AAC encoders?
Post by: Garf on 2004-06-09 10:04:55
Quote
THIS i can do, but, as others have asked, when will it end? i get back from Cali on friday...

Yeah, we have about a week time.
Title: Want to test the next generation AAC encoders?
Post by: bond on 2004-06-09 10:51:18
is this a parametric stereo (+sbr) decoder or does it include more goodies?
Title: Want to test the next generation AAC encoders?
Post by: Garf on 2004-06-09 11:24:38
Quote
is this a parametric stereo (+sbr) decoder or does it include more goodies?

FAAD2 decodes SBR and PS. It has done so for a while now...?! Both are needed to decode the files in this test.
Title: Want to test the next generation AAC encoders?
Post by: SirGrey on 2004-06-09 13:46:17
Ok, fast results are sent.
EDIT: BTW, rather impressive quality for such a bitrates...
Title: Want to test the next generation AAC encoders?
Post by: SirGrey on 2004-06-09 18:18:31
Now I have some spare time to analyze what I've done
So, I have some questions now:
1. What codecs/settings were used for this test ?
(If this is not a secret period)
2. (Not directly related to this test) Are the spatial audio specs finalized ? And is there any chance that it will be used by AHEAD aac encoder ?
Thanks in advance !!
Title: Want to test the next generation AAC encoders?
Post by: Garf on 2004-06-09 18:33:46
Quote
Now I have some spare time to analyze what I've done
So, I have some questions now:
1. What codecs/settings were used for this test ?
(If this is not a secret period)


Combinations of SBR and PS, all from our in-development encoder.

Quote
2. (Not directly related to this test) Are the spatial audio specs finalized ? And is there any chance that it will be used by AHEAD aac encoder ?
Thanks in advance !!


They are not finalized. Once they are I assume we will do something in this area.
Title: Want to test the next generation AAC encoders?
Post by: Garf on 2004-06-14 17:04:00
A very big thanks from the NeroDigital team to everyone that submitted results!
Title: Want to test the next generation AAC encoders?
Post by: askoff on 2004-06-18 10:03:20
Can you tell us something more about the results?
Title: Want to test the next generation AAC encoders?
Post by: Garf on 2004-06-18 19:38:46
We now know the break-even point for current Parametric Stereo.
Title: Want to test the next generation AAC encoders?
Post by: slippyC on 2004-06-19 05:15:21
Hey Garf, in that sample1 of the pack we downloaded I did some goofing around.  I took the flac samp and re-encoded at 80kbits MP3Pro and 80kbits HEAAC and the MP3Pro samp sounded much better.  There was alot of ringing in the begining that wasn't present or pretty much unaudible in the MP3Pro re-encode(also at 96kbits MP3Pro still sounded better at 80kbits). 

Just something you guys may want to check out, since you are competing with that codec.


***Edited Part and Note***
The gain/volume on the mp3Pro samp was slightly less than the original on that triangle sounding instrument.  So there was audible difference, but the ringing wasn't present.
Title: Want to test the next generation AAC encoders?
Post by: SirGrey on 2004-06-19 22:17:43
Quote
We now know the break-even point for current Parametric Stereo.

Hehe
Can you be a bit more specific, if you have spare time, of course ?
Just curious about settings used for all 3 encodes and overall conclusion 
Title: Want to test the next generation AAC encoders?
Post by: Ivan Dimkovic on 2004-06-19 23:02:44
Well - the overall conclusion is that PS48 and SBR48 are pretty much equal:

HE64: 3.61
HE48: 2.78
PS48: 2.75

At current state, PS and HE were very close - where HE failed, PS was ranked as very good - and vice versa.

Current conclusion is not to use PS on this bit rate - due to power consumption and backwards compatibility - at 40 Kb/s, PS brings significant improvements, and will be used.
Title: Want to test the next generation AAC encoders?
Post by: SirGrey on 2004-06-20 01:22:40
Thanks for clarification, Ivan !
So, As I understand this, now situation with nero aac implementation will be:
(for stereo)
>96 -> LC
48-96 -> HE
<48 -> PS
So, we all waiting for the new Nero version to test it by ourselves ! 
P.S. It would be great, if PS will be finised until new Roberto test begins.
I hope, it will happen...

Thanks again.
Title: Want to test the next generation AAC encoders?
Post by: Garf on 2004-06-20 09:42:28
There's also DSBR which can be useful from about 64kbps to 128kbps. Finding the exact margins for optimal quality also needs a lot of testing there.

Just in case you were wondering why we're taking so long
Title: Want to test the next generation AAC encoders?
Post by: SirGrey on 2004-06-20 19:17:28
Quote
There's also DSBR which can be useful from about 64kbps to 128kbps.

I remeber, Ivan mentioned somewhere that your testing team try DSBR to find if it is better on this bitrates...
Is this clarified now, that downsampled SBR produce better result using 128Kbit bitrate, than pure LC ?
Quote
Just in case you were wondering why we're taking so long

Understandable. But life is short, so we need it all and imidiately
EDIT: grammar
Title: Want to test the next generation AAC encoders?
Post by: stoff on 2004-06-21 10:03:57
Hi Garf and Ivan Dimkovic. Its cool to see the two of you doing development for Ahead AAC and to see that your efforts and talents being put to very good use for the masses!

Do you have any timeframe for an updated AAC encoder? 
Title: Want to test the next generation AAC encoders?
Post by: Garf on 2004-06-21 10:31:09
Quote
Do you have any timeframe for an updated AAC encoder? 

We want to participate in roberto's test with the new encoder so there should be an update before it starts.

It won't contain all the new stuff though, need some more time for that.
Title: Want to test the next generation AAC encoders?
Post by: Gabriel on 2004-06-21 10:53:10
Quote
We want to participate in roberto's test with the new encoder so there should be an update before it starts.

Good luck because it is planned for the end of the month...
Title: Want to test the next generation AAC encoders?
Post by: stoff on 2004-06-21 13:02:22
Quote
We want to participate in roberto's test with the new encoder so there should be an update before it starts.

It won't contain all the new stuff though, need some more time for that.

Great, thanks for the fast reply. I'm about ready to try some 64-96 kbps Nero AAC out myself (for use in a mobil phone), so any upcoming improvement is most welcome!
Title: Want to test the next generation AAC encoders?
Post by: Garf on 2004-06-22 13:30:22
Quote
I remeber, Ivan mentioned somewhere that your testing team try DSBR to find if it is better on this bitrates...
Is this clarified now, that downsampled SBR produce better result using 128Kbit bitrate, than pure LC ?

Well, it's another one of those pesky situations where we're near the break-even point. Because of the nice feedback we got with this test (which is VERY MUCH APPRECIATED), we may do a public test of 128k DSBR too.
Title: Want to test the next generation AAC encoders?
Post by: askoff on 2004-06-23 09:30:29
Quote
Great, thanks for the fast reply. I'm about ready to try some 64-96 kbps Nero AAC out myself (for use in a mobil phone), so any upcoming improvement is most welcome!

Do you have mobile phone which can play AAC-HE?
Title: Want to test the next generation AAC encoders?
Post by: stoff on 2004-06-23 18:09:41
Quote
Quote
Great, thanks for the fast reply. I'm about ready to try some 64-96 kbps Nero AAC out myself (for use in a mobil phone), so any upcoming improvement is most welcome!

Do you have mobile phone which can play AAC-HE?

Errr, probably not. I didn't read up on the HE-AAC issue before posting. 

My brandnew SE K700 can play the HE-AAC test files I tried on it, but that of course doesn't prove anything. I seem to remember something about HE-AAC files just being played as mono if the player doesn't support HE? Garf?
Title: Want to test the next generation AAC encoders?
Post by: Garf on 2004-06-23 20:58:26
PS AAC is played as mono if the player doesn't support it.

HE AAC is played as LC AAC if the player doesn't support it.
Title: Want to test the next generation AAC encoders?
Post by: stoff on 2004-06-23 22:41:40
Quote
PS AAC is played as mono if the player doesn't support it.

HE AAC is played as LC AAC if the player doesn't support it.

Thanks for the input, Garf. This is what the SE K700 whitepaper say:

Quote
The AAC offers three different profiles to facilitate trade off between quality, memory and processing power requirements. They include: Main Profile (MP), Low Complexity (LC) and Scalable Sampling Rate (SSR).


I guess I will try and see whether CBR80 LC or maybe CBR96 LC will do decent enough. It is just for casual use on a mobile phone after all, so unless there is too many artifacts, those may make a very decent trade off.
Title: Want to test the next generation AAC encoders?
Post by: Garf on 2004-06-23 22:44:29
DSBR will greatly enhance quality for non-HE AAC capable players that have to play back HE-AAC content.

Current HE-AAC is not very efficient at that bitrate yet, so if you have just a little more patience you will be in for some pleasant surprises
Title: Want to test the next generation AAC encoders?
Post by: stoff on 2004-06-24 08:21:27
Quote
DSBR will greatly enhance quality for non-HE AAC capable players that have to play back HE-AAC content.

Current HE-AAC is not very efficient at that bitrate yet, so if you have just a little more patience you will be in for some pleasant surprises

Sounds delightful!

(I guess I did good by buying Nero 6 after all then)