I promised to do some listening tests two months (and two thread pages) ago, but I have been too busy with other activities until now.
By default Vorbis uses 44.1 kHz at -q1. Common sense would say that at a small bitrate like 48 kbps a 32 kHz sample rate would leave more room for vital information. Lame uses 22.05 kHz and iTunes AAC 32 kHz at 48 kbps.
I thought that 32 kHz would have helped Vorbis too, but it seems that it makes things better only with a couple of the samples I tried now.
I tested ten samples from Gabriel's 48 kbps AAC test. I used Vorbis aoTuVb4.51 (oggenc 2.83 2006-04-26 from Rarewares) and b5 (2006-04-08) with the following settings:
Vorbis aoTuV b4.51 32 kHz source "-q -0.55"
Vorbis aoTuV b4.51 32 kHz source "-q -0.55 --advanced-encode-option lowpass_frequency=15"
Vorbis aoTuV b4.51 44.1 kHz source "-q -1"
Vorbis aoTuV b5 44.1 kHz source "-q -1"
I resampled the 32 kHz source files with foobar's SSRC (slow mode) before encoding. I used Koss PortaPro headphones and Terratec DMX 6fire 24/96 sound card.
The results
Despite the few differences I found, it seems that all contenders are tied. It would be interesting to test the new b5 at 32 kHz and 15 kHz lowpass.
ABC/HR
ABC/HR for Java, Version 0.5b, 09 June 2006
Testname: chanchanT Vorbis
Tester: Alex B
1R = E:\test\Vorbis 48\01\Vorbis32_-055 - 01 - chanchanT.wav
2R = E:\test\Vorbis 48\01\Vorbis32_-055_lp15 - 01 - chanchanT.wav
3R = E:\test\Vorbis 48\01\Vorbis44_-1 - 01 - chanchanT.wav
4L = E:\test\Vorbis 48\01\VorbisB5 - 01 - chanchanT.wav
---------------------------------------
General Comments: Trumpet is very bad, trumpet sound from the best to the worst: 3, 2/4, 1
---------------------------------------
1R File: E:\test\Vorbis 48\01\Vorbis32_-055 - 01 - chanchanT.wav
1R Rating: 2.0
1R Comment:
---------------------------------------
2R File: E:\test\Vorbis 48\01\Vorbis32_-055_lp15 - 01 - chanchanT.wav
2R Rating: 2.1
2R Comment:
---------------------------------------
3R File: E:\test\Vorbis 48\01\Vorbis44_-1 - 01 - chanchanT.wav
3R Rating: 2.2
3R Comment:
---------------------------------------
4L File: E:\test\Vorbis 48\01\VorbisB5 - 01 - chanchanT.wav
4L Rating: 2.1
4L Comment:
---------------------------------------
ABX Results:
________________________________________________________________________
ABC/HR for Java, Version 0.5b, 09 June 2006
Testname: fools Vorbis
Tester: Alex B
1R = E:\test\Vorbis 48\02\Vorbis32_-055_lp15 - 02 - fools.wav
2L = E:\test\Vorbis 48\02\Vorbis32_-055 - 02 - fools.wav
3R = E:\test\Vorbis 48\02\Vorbis44_-1 - 02 - fools.wav
4R = E:\test\Vorbis 48\02\VorbisB5 - 02 - fools.wav
---------------------------------------
General Comments:
---------------------------------------
1R File: E:\test\Vorbis 48\02\Vorbis32_-055_lp15 - 02 - fools.wav
1R Rating: 3.2
1R Comment: Second worst class breaking sound at about 13 s
---------------------------------------
2L File: E:\test\Vorbis 48\02\Vorbis32_-055 - 02 - fools.wav
2L Rating: 3.0
2L Comment: Worst class breaking sound at about 13 s
---------------------------------------
3R File: E:\test\Vorbis 48\02\Vorbis44_-1 - 02 - fools.wav
3R Rating: 3.4
3R Comment: Second best class breaking sound at about 13 s
---------------------------------------
4R File: E:\test\Vorbis 48\02\VorbisB5 - 02 - fools.wav
4R Rating: 3.8
4R Comment: Best class breaking sound at about 13 s
---------------------------------------
ABX Results:
________________________________________________________________________
ABC/HR for Java, Version 0.5b, 09 June 2006
Testname: kraftwerk Vorbis
Tester: Alex B
1L = E:\test\Vorbis 48\03\Vorbis32_-055_lp15 - 03 - kraftwerk.wav
2R = E:\test\Vorbis 48\03\Vorbis32_-055 - 03 - kraftwerk.wav
3R = E:\test\Vorbis 48\03\Vorbis44_-1 - 03 - kraftwerk.wav
4L = E:\test\Vorbis 48\03\VorbisB5 - 03 - kraftwerk.wav
---------------------------------------
General Comments: Distorded, pronounced and strange highs. 3 & 4 have one extra artifact at about 22 s.
---------------------------------------
1L File: E:\test\Vorbis 48\03\Vorbis32_-055_lp15 - 03 - kraftwerk.wav
1L Rating: 1.6
1L Comment:
---------------------------------------
2R File: E:\test\Vorbis 48\03\Vorbis32_-055 - 03 - kraftwerk.wav
2R Rating: 1.6
2R Comment:
---------------------------------------
3R File: E:\test\Vorbis 48\03\Vorbis44_-1 - 03 - kraftwerk.wav
3R Rating: 1.4
3R Comment:
---------------------------------------
4L File: E:\test\Vorbis 48\03\VorbisB5 - 03 - kraftwerk.wav
4L Rating: 1.4
4L Comment:
---------------------------------------
ABX Results:
________________________________________________________________________
ABC/HR for Java, Version 0.5b, 09 June 2006
Testname: Liszt_in_B Vorbis
Tester: Alex B
1R = E:\test\Vorbis 48\04\VorbisB5 - 04 - Liszt_in_B.wav
2L = E:\test\Vorbis 48\04\Vorbis44_-1 - 04 - Liszt_in_B.wav
3L = E:\test\Vorbis 48\04\Vorbis32_-055 - 04 - Liszt_in_B.wav
4R = E:\test\Vorbis 48\04\Vorbis32_-055_lp15 - 04 - Liszt_in_B.wav
---------------------------------------
General Comments: awful, 3 & 4 are slightly better
---------------------------------------
1R File: E:\test\Vorbis 48\04\VorbisB5 - 04 - Liszt_in_B.wav
1R Rating: 1.0
1R Comment:
---------------------------------------
2L File: E:\test\Vorbis 48\04\Vorbis44_-1 - 04 - Liszt_in_B.wav
2L Rating: 1.0
2L Comment:
---------------------------------------
3L File: E:\test\Vorbis 48\04\Vorbis32_-055 - 04 - Liszt_in_B.wav
3L Rating: 1.5
3L Comment:
---------------------------------------
4R File: E:\test\Vorbis 48\04\Vorbis32_-055_lp15 - 04 - Liszt_in_B.wav
4R Rating: 1.5
4R Comment:
---------------------------------------
ABX Results:
________________________________________________________________________
ABC/HR for Java, Version 0.5b, 07 June 2006
Testname: orin_ii Vorbis
Tester: Alex B
1R = E:\test\Vorbis 48\05\Vorbis44_-1 - 05 - orion_ii.wav
2R = E:\test\Vorbis 48\05\Vorbis32_-055_lp15 - 05 - orion_ii.wav
3R = E:\test\Vorbis 48\05\Vorbis32_-055 - 05 - orion_ii.wav
4L = E:\test\Vorbis 48\05\VorbisB5 - 05 - orion_ii.wav
---------------------------------------
General Comments: Bad bad bad
---------------------------------------
1R File: E:\test\Vorbis 48\05\Vorbis44_-1 - 05 - orion_ii.wav
1R Rating: 1.5
1R Comment:
---------------------------------------
2R File: E:\test\Vorbis 48\05\Vorbis32_-055_lp15 - 05 - orion_ii.wav
2R Rating: 1.8
2R Comment:
---------------------------------------
3R File: E:\test\Vorbis 48\05\Vorbis32_-055 - 05 - orion_ii.wav
3R Rating: 1.8
3R Comment:
---------------------------------------
4L File: E:\test\Vorbis 48\05\VorbisB5 - 05 - orion_ii.wav
4L Rating: 1.7
4L Comment:
---------------------------------------
ABX Results:
________________________________________________________________________
ABC/HR for Java, Version 0.5b, 07 June 2006
Testname: sandman Vorbis
Tester: Alex B
1R = E:\test\Vorbis 48\06\Vorbis44_-1 - 06 - sandman.wav
2L = E:\test\Vorbis 48\06\VorbisB5 - 06 - sandman.wav
3R = E:\test\Vorbis 48\06\Vorbis32_-055 - 06 - sandman.wav
4L = E:\test\Vorbis 48\06\Vorbis32_-055_lp15 - 06 - sandman.wav
---------------------------------------
General Comments: Surprisingly good
---------------------------------------
1R File: E:\test\Vorbis 48\06\Vorbis44_-1 - 06 - sandman.wav
1R Rating: 3.8
1R Comment:
---------------------------------------
2L File: E:\test\Vorbis 48\06\VorbisB5 - 06 - sandman.wav
2L Rating: 3.6
2L Comment:
---------------------------------------
3R File: E:\test\Vorbis 48\06\Vorbis32_-055 - 06 - sandman.wav
3R Rating: 3.4
3R Comment:
---------------------------------------
4L File: E:\test\Vorbis 48\06\Vorbis32_-055_lp15 - 06 - sandman.wav
4L Rating: 3.8
4L Comment:
---------------------------------------
ABX Results:
________________________________________________________________________
ABC/HR for Java, Version 0.5b, 07 June 2006
Testname: Stravinsky_Capriccio Vorbis
Tester: Alex B
1L = E:\test\Vorbis 48\07\Vorbis44_-1 - 07 - Stravinsky_Capriccio.wav
2L = E:\test\Vorbis 48\07\Vorbis32_-055 - 07 - Stravinsky_Capriccio.wav
3L = E:\test\Vorbis 48\07\VorbisB5 - 07 - Stravinsky_Capriccio.wav
4L = E:\test\Vorbis 48\07\Vorbis32_-055_lp15 - 07 - Stravinsky_Capriccio.wav
---------------------------------------
General Comments:
---------------------------------------
1L File: E:\test\Vorbis 48\07\Vorbis44_-1 - 07 - Stravinsky_Capriccio.wav
1L Rating: 2.6
1L Comment:
---------------------------------------
2L File: E:\test\Vorbis 48\07\Vorbis32_-055 - 07 - Stravinsky_Capriccio.wav
2L Rating: 2.6
2L Comment:
---------------------------------------
3L File: E:\test\Vorbis 48\07\VorbisB5 - 07 - Stravinsky_Capriccio.wav
3L Rating: 2.6
3L Comment:
---------------------------------------
4L File: E:\test\Vorbis 48\07\Vorbis32_-055_lp15 - 07 - Stravinsky_Capriccio.wav
4L Rating: 2.8
4L Comment:
---------------------------------------
ABX Results:
________________________________________________________________________
ABC/HR for Java, Version 0.5b, 07 June 2006
Testname: Toms Diner Vorbis
Tester: Alex B
1R = E:\test\Vorbis 48\08\VorbisB5 - 08 - TomsDiner.wav
2R = E:\test\Vorbis 48\08\Vorbis32_-055 - 08 - TomsDiner.wav
3R = E:\test\Vorbis 48\08\Vorbis32_-055_lp15 - 08 - TomsDiner.wav
4L = E:\test\Vorbis 48\08\Vorbis44_-1 - 08 - TomsDiner.wav
---------------------------------------
General Comments: Human voice seems to be easy for Vorbis.
---------------------------------------
1R File: E:\test\Vorbis 48\08\VorbisB5 - 08 - TomsDiner.wav
1R Rating: 3.9
1R Comment:
---------------------------------------
2R File: E:\test\Vorbis 48\08\Vorbis32_-055 - 08 - TomsDiner.wav
2R Rating: 3.6
2R Comment:
---------------------------------------
3R File: E:\test\Vorbis 48\08\Vorbis32_-055_lp15 - 08 - TomsDiner.wav
3R Rating: 3.6
3R Comment:
---------------------------------------
4L File: E:\test\Vorbis 48\08\Vorbis44_-1 - 08 - TomsDiner.wav
4L Rating: 4.0
4L Comment:
---------------------------------------
ABX Results:
________________________________________________________________________
ABC/HR for Java, Version 0.5b, 07 June 2006
Testname: Twist & Shout Vorbis
Tester: Alex B
1L = E:\test\Vorbis 48\09\Vorbis32_-055_lp15 - 09 - twist_shout.wav
2R = E:\test\Vorbis 48\09\VorbisB5 - 09 - twist_shout.wav
3R = E:\test\Vorbis 48\09\Vorbis32_-055 - 09 - twist_shout.wav
4L = E:\test\Vorbis 48\09\Vorbis44_-1 - 09 - twist_shout.wav
---------------------------------------
General Comments:
---------------------------------------
1L File: E:\test\Vorbis 48\09\Vorbis32_-055_lp15 - 09 - twist_shout.wav
1L Rating: 3.5
1L Comment:
---------------------------------------
2R File: E:\test\Vorbis 48\09\VorbisB5 - 09 - twist_shout.wav
2R Rating: 3.5
2R Comment:
---------------------------------------
3R File: E:\test\Vorbis 48\09\Vorbis32_-055 - 09 - twist_shout.wav
3R Rating: 3.5
3R Comment:
---------------------------------------
4L File: E:\test\Vorbis 48\09\Vorbis44_-1 - 09 - twist_shout.wav
4L Rating: 3.3
4L Comment:
---------------------------------------
ABX Results:
________________________________________________________________________
ABC/HR for Java, Version 0.5b, 07 June 2006
Testname: waiting Vorbis
Tester: Alex B
1L = E:\test\Vorbis 48\10\Vorbis32_-055_lp15 - 10 - waiting.wav
2L = E:\test\Vorbis 48\10\Vorbis32_-055 - 10 - waiting.wav
3L = E:\test\Vorbis 48\10\Vorbis44_-1 - 10 - waiting.wav
4L = E:\test\Vorbis 48\10\VorbisB5 - 10 - waiting.wav
---------------------------------------
General Comments:
---------------------------------------
1L File: E:\test\Vorbis 48\10\Vorbis32_-055_lp15 - 10 - waiting.wav
1L Rating: 3.8
1L Comment:
---------------------------------------
2L File: E:\test\Vorbis 48\10\Vorbis32_-055 - 10 - waiting.wav
2L Rating: 3.2
2L Comment:
---------------------------------------
3L File: E:\test\Vorbis 48\10\Vorbis44_-1 - 10 - waiting.wav
3L Rating: 3.8
3L Comment:
---------------------------------------
4L File: E:\test\Vorbis 48\10\VorbisB5 - 10 - waiting.wav
4L Rating: 3.5
4L Comment:
---------------------------------------
ABX Results:
The samples are available here: http://www.mp3-tech.org/tests/aac_48/samples/
I analyzed the bitrates with MrQuestionMan. The html reports are available here: Vorbis48kbps_bitrates.rar
Edit: fixed a few typos