Skip to main content

Topic: Public, Multiformat Listening Test @ 64 kbps - OPEN (Read 87562 times) previous topic - next topic

0 Members and 1 Guest are viewing this topic.
Public, Multiformat Listening Test @ 64 kbps - OPEN
Greetings!

I finally managed to extract my password database from a backup set and am happily using an Ubuntu live CD until my new HDD ships. Anyways, great news: the multiformat listening test at 64 kbps is finally open!

The featured encoders, as most of you know already, are:

Nero Digital HE-AAC (VBR)
WMA Professional 10 (CBR)
Ogg Vorbis AoTuV 5 Beta (VBR)

The anchors used in this test are:

iTunes LC-AAC at 96 kbps VBR as high anchor
iTunes LC-AAC at 48 kbps CBR as low anchor

The test is scheduled to end on August 5th, 2007 August 12th, 2007 August 15th, 2007. Its address is: http://www.listening-tests.info/mf-64-1/

Happy testing!
  • Last Edit: 12 August, 2007, 08:06:09 AM by Sebastian Mares

Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #1
Is the WMA Encoder the "plain" one or the one from WMP11 that uses some kind of SBR?

Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #2
It's 10 Professional that comes with Vista and WMP 11.

  • Alex B
  • [*][*][*][*][*]
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #3
I downloaded the Torrents and I'm seeding them now. The samples 1-17 have been downloaded a few times, but the sample 18 may have a problem.

Azureus reports this when I try to update tracker for the sample 18:

Quote
Connection Error (IOException:Server returned HTTP response code: 503 for URL: http://www.rarewares.org/tracker/tracker.p...Hi&azver=3)

All other samples show "OK" tracker status.

  • rjamorim
  • [*][*][*][*][*]
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #4
I'll try redoing that torrent file. If it still won't work, you guys can always download through http...
Get up-to-date binaries of Lame, AAC, Vorbis and much more at RareWares:
http://www.rarewares.org

  • rjamorim
  • [*][*][*][*][*]
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #5
Redone the torrent file, seems to be working now! (please delete the old torrent file and download the new one:
http://www.rarewares.org/sebastian/Sample18.zip.torrent )
  • Last Edit: 25 July, 2007, 06:16:34 PM by rjamorim
Get up-to-date binaries of Lame, AAC, Vorbis and much more at RareWares:
http://www.rarewares.org

  • ff123
  • [*][*][*][*][*]
  • Developer (Donating)
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #6
Yay!  I might actually get time to contribute results this time.

  • Alex B
  • [*][*][*][*][*]
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #7
Redone the torrent file, seems to be working now! (please delete the old torrent file and download the new one:
http://www.rarewares.org/sebastian/Sample18.zip.torrent )


Thanks. It works now.

  • menno
  • [*][*][*][*][*]
  • Developer (Donating)
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #8
Great job Sebastian, I hope we will get a lot of results.

Quote
#  Nero HE-AAC Jul 20 2007
-q 0.24 (hard-coded value in this version of the encoder)


That last part can be left out I guess. The uploaded package has the complete encoder, including the linux binaries!!

Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #9
I removed the info about the hardcoded value.

  • niktheblak
  • [*][*][*][*]
  • Members (Donating)
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #10
God damn it, it's becoming increasingly difficult to detect even 64 kbps encodings. Either codecs are now really good or I'm going deaf. On the tests I've performed so far, the only sample I can easily and 100% reliably detect seems to be the low anchor. And I'm using $300 Alessandro MS-2 headphones with headphone amp and M-Audio sound card.

These tests are an excellent way to lower one's self-esteem

  • muaddib
  • [*][*][*][*]
  • Developer
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #11
Hi all,

just to mention that the more accurate results on this test are, better quality of future Nero AAC Encoder you can expect. This is because results from listening tests are used to tune the encoder settings. So, please concentrate very hard when you perform the test. I don't have special hearing, but I can hear differences in these encodings and thus I believe that any of you with normal hearing can hear the differences. Thus please concentrate. At least you must be able to discover low anchor, but please try to grade all samples and all encoders.
And it is not important that Nero wins (though I would like it ), only that there are as many as possible results and that you tried really hard to hear differences.

Cheers, Goran.

  • Alexxander
  • [*][*][*][*]
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #12
This is my first time participating in listening tests (though I have done rather a lot of ABXing with foobar2000).

To be sure:

I have to send the SampleXX.erf files generated through menu File>Save Test Results ?
(so that would a RAR file containing 18 .erf files)

Second question: Why isn't included iTunes AAC 7.3.1.3 64 VBR? Seems to me unfair not to include this speed.

Third question: Will I be able to see my own results?

Thx

Edit: Added second and third question
  • Last Edit: 26 July, 2007, 05:36:01 AM by Alexxander

  • Ivan Dimkovic
  • [*][*][*][*][*]
  • Developer
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #13
God damn it, it's becoming increasingly difficult to detect even 64 kbps encodings. Either codecs are now really good or I'm going deaf.
...


No, you're not going deaf - codecs are becoming better and better

Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #14
I have to send the SampleXX.erf files generated through menu File>Save Test Results ?
(so that would a RAR file containing 18 .erf files)


Correct - at least if you want to test all samples. You can also send me an archive containing only five results if you only tested five samples.

Second question: Why isn't included iTunes AAC 7.3.1.3 64 VBR? Seems to me unfair not to include this speed.


Because that is LC-AAC which is not really optimized for low bitrates like HE-AAC. LC-AAC and HE-AAC will be featured in an upcoming 80 kbps listening test.

Third question: Will I be able to see my own results?


Not until after the test when I publish the encryption / decryption key.

  • Alexxander
  • [*][*][*][*]
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #15

Second question: Why isn't included iTunes AAC 7.3.1.3 64 VBR? Seems to me unfair not to include this speed.


Because that is LC-AAC which is not really optimized for low bitrates like HE-AAC. LC-AAC and HE-AAC will be featured in an upcoming 80 kbps listening test.


Ok, then what sense has to use VBR iTunes AAC 7.3.1.3 at 96 kbps and not higher speed? Why are high and low anchor included?

Just learning 

  • naylor83
  • [*][*][*]
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #16
God damn it, it's becoming increasingly difficult to detect even 64 kbps encodings. Either codecs are now really good or I'm going deaf. On the tests I've performed so far, the only sample I can easily and 100% reliably detect seems to be the low anchor. And I'm using $300 Alessandro MS-2 headphones with headphone amp and M-Audio sound card.

These tests are an excellent way to lower one's self-esteem


Typical. I was hoping this one would be a walk-over.  The last one I participated in, the huge ~128 kbps test around new year 05/06(?), was a nightmare.
  • Last Edit: 26 July, 2007, 12:12:56 PM by naylor83
davidnaylor.org

  • rbrito
  • [*][*]
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #17
Great job Sebastian, I hope we will get a lot of results.


I think that I may participate this time. This will be the first listening test in which I will be involved, but, as the old saying goes, practice leads to perfection. 

Quote
That last part can be left out I guess. The uploaded package has the complete encoder, including the linux binaries!!


Where can I find the linux binaries, please? I would love to encode my collection with your encoder, as it seems to be the "best of breed". And speaking of that, I can even provide Debian (also usable by Ubuntu Linux users) packages for that and I would be glad to provide packages for amd64 and powerpc too.

Regards, Rogério Brito.

  • menno
  • [*][*][*][*][*]
  • Developer (Donating)
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #18
Where can I find the linux binaries, please? I would love to encode my collection with your encoder, as it seems to be the "best of breed".


http://www.listening-tests.info/mf-64-1/NeroDigitalAudio.zip

  • rjamorim
  • [*][*][*][*][*]
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #19
And speaking of that, I can even provide Debian (also usable by Ubuntu Linux users) packages for that and I would be glad to provide packages for amd64 and powerpc too.


PowerPC? 

The Nero encoder is distributed binary-only. Unless you get Nero's sources through some sort of NDA, you won't be able to create binaries for architectures other than i386.

PS: still not interested in creating a PowerPC repository at RareWares?
Get up-to-date binaries of Lame, AAC, Vorbis and much more at RareWares:
http://www.rarewares.org

  • naylor83
  • [*][*][*]
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #20
Wow, this really was much harder than I thought. I never thought I'd have to listen so hard to 64 kbps music to hear the artifacts.

One thing is certain: It's definitely usable!
davidnaylor.org

  • muaddib
  • [*][*][*][*]
  • Developer
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #21
Ok, then what sense has to use VBR iTunes AAC 7.3.1.3 at 96 kbps and not higher speed? Why are high and low anchor included?
Just learning 


You can read about use of anchors in ITU-R BS.1116. Also try searching on this forum, there were already discussions about anchors.

  • niktheblak
  • [*][*][*][*]
  • Members (Donating)
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #22
Typical. I was hoping this one would be a walk-over.  The last one I participated in, the huge ~128 kbps test around new year 05/06(?), was a nightmare.

Fortunately transparency at 64 kbps is highly dependent on the sample. I had huge problems identifying the encodes with classical (Paganini_Allegro_spirituoso) and "normal" music (Senor), but it was much easier with a kind of music that is most familiar to me (symphnoy_metal [sic]).

Anyway I had to do several testing rounds and multiple listening passes to learn what to listen to; concentrate on cymbals, sibilants and on other high-frequency content and the encodes should be easier to spot.

Anyway at least two of the three codecs are really good.
  • Last Edit: 27 July, 2007, 04:48:25 AM by niktheblak

  • naylor83
  • [*][*][*]
Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #23
Fortunately transparency at 64 kbps is highly dependent on the sample. I had huge problems identifying the encodes with classical (Paganini_Allegro_spirituoso) and "normal" music (Senor), but it was much easier with a kind of music that is most familiar to me (symphnoy_metal [sic]).

Anyway I had to do several testing rounds and multiple listening passes to learn what to listen to; concentrate on cymbals, sibilants and on other high-frequency content and the encodes should be easier to spot.

Anyway at least two of the three codecs are really good.


Yes, I basically narrow in on a second or two, with lots of high pitch detail, and listen over and over and over again.
davidnaylor.org

Public, Multiformat Listening Test @ 64 kbps - OPEN
Reply #24
Same here =)
This is awesome, first time I participate in such test <3

The Deutsch man was an interesting soundclip, first I thought this is gonna be impossible to distinguish but turned out it was one of the easiest so far
  • Last Edit: 27 July, 2007, 03:55:24 PM by mr budzone