Proposal on listening tests 2004-08-12 03:22:39 Hello.It has been a month since the (official) finish of the last listening test, and I'd like to propose some tests that can be conduced by the more courageous people out there. It's about time new tests start getting planned.There have been several proposals. I believe the one deserving more attention is a speech listening test, comparing speech samples against several different speech codecs (GSM, WMA Voice, Speex, g729, MPEG4 CELP, PureVoice/CDMA...) in both wideband and narrowband mode. I'm confident jmvalin would be able to help the conducer choose the adequate encoders and settings.Another test, proposed by Danchr, would be testing open source encoders at some bitrate. LAME, Vorbis, FAAC, maybe Musepack... such test would surely be of interest to users using platforms other than Windows, specially Linux users.Sthayashi proposed a test comparing several AAC encoders againt Vorbis, to see how Vorbis performs againt encoders other than iTunes. I guess that the answer is now clear that Vorbis will perform better than all AAC encoders at 128kbps, since if it won even over the best of them. But the proposal is made.Last but not least, ScorLibran proposed a transparency thresold test. It would somehow detect at which average bitrate each codec first reaches transparency. That would serve as proof if Musepack is still the codec that offers transparency at lowest bitrates, or if the recent developments in all other codecs obsoleted Musepack in this aspect.Of course, the most courageous (or nuts) out there might be dreaming of a 160 or 192kbps test. I personally believe this is madness, but hey, don't let me stop you :BI personally don't think that conducing another multiformat at 128kbps, or AAC at 128kbps test would be justifiable right now. There has hardly been any development in the mainstream encoders since my last tests were conduced, so it would just be a waste of resources. Maybe next year?This is what I can offer to help starters:- Hosting the sample packages- Hosting the torrent tracker and help seeding from fast servers- Help you with answers and hints about test conducing to the best of my knowledgeAll this for the low, low fee of zero bucks All other responsabilities would belong to the test conducer: choosing the sample set, deciding on codecs, versions and settings, managing eventual pre-tests, gathering and processing the results, and the most dreaded question - VBR or CBR?Hope I can spark some interest with this invitation. We definitely need someone to pick up from where I left.Thanks for your attention.Best regards;Roberto.