HydrogenAudio

Hydrogenaudio Forum => General Audio => Topic started by: Pio2001 on 2010-08-08 14:54:18

Title: Links to blind listening tests
Post by: Pio2001 on 2010-08-08 14:54:18
Discussion about this topic : http://www.hydrogenaudio.org/forums/index....showtopic=82783 (http://www.hydrogenaudio.org/forums/index.php?showtopic=82783)


Read first

What is an ABX blind test ?
http://www.hydrogenaudio.org/forums/index....st&p=382266 (http://www.hydrogenaudio.org/forums/index.php?s=&showtopic=16295&view=findpost&p=382266)


---------------------------------------------------------------

Audio codecs :

Warning : because of the psycho-acoustic tricks used in lossy codecs, spectrogram-based comparisons, signal cancellation, or artifacts amplification (SoundExpert tests) are not suited for the evaluation of the audio performance of these codecs.

Public double blind listening tests, led by Roberto J. Amorim and Sebastian Mares. 2003-2008. Some codecs have been improved since then.
http://listening-tests.freetzi.com/ (http://listening-tests.freetzi.com/)

List of Hydrogenaudio's tests, with Guruboolez' gigantic blind tests.
http://wiki.hydrogenaudio.org/index.php?ti...Listening_Tests (http://wiki.hydrogenaudio.org/index.php?title=Listening_Tests)

Mp3 at 320 kbps.
http://www.hydrogenaudio.org/forums/index....c=70598&hl= (http://www.hydrogenaudio.org/forums/index.php?showtopic=70598&hl=)

Many tests by forumers, on various formats
http://www.hydrogenaudio.org/forums/index....=45644&st=0 (http://www.hydrogenaudio.org/forums/index.php?showtopic=45644&st=0)



---------------------------------------------------------------

Audio hardware


Websites with many tests :

David Carlstrom. Very interesting tests, but unfortunately undocumented.
http://www.provide.net/~djcarlst/abx_data.htm (http://www.provide.net/~djcarlst/abx_data.htm)

[French] The "Kangourous's" tests. Several gatherings involving blind tests of amplifiers, preamplifiers, DACs, interconnects, and an equalizer.
http://www.homecinema-fr.com/forum/viewtop...&t=29915556 (http://www.homecinema-fr.com/forum/viewtopic.php?f=1037&t=29915556)

[Spanish] Matrix-hifi, spanish audiophile association , fond of blind tests. Take the red pill and follow the link "Pruebas Ciegas".
http://www.matrixhifi.com/ (http://www.matrixhifi.com/)



Training

Ohl's website, with several distorsion simulators that include ABX modules.
http://www.ohl.to/about-audio/audio-softwares (http://www.ohl.to/about-audio/audio-softwares)

[French] ABX tests for dummies
http://chaud7.forumactif.fr/tests-abx-f8/l...s-nuls-t480.htm (http://chaud7.forumactif.fr/tests-abx-f8/les-tests-abx-pour-les-nuls-t480.htm)



Whole stereo system : CD player, amplifiers, cables, stands :

Blind comparison between to very different electronic setups (700$/12,000U$). The listeners had to choose their preferred system, rather than identifying them. Surprising results.
http://www.matrixhifi.com/contenedor_ppec_eng.htm (http://www.matrixhifi.com/contenedor_ppec_eng.htm)


Ribbon Tweeter

[French] Accidental "liar test"... they forgot to turn it on.
http://www.homecinema-fr.com/forum/viewtop...=105#p172065673 (http://www.homecinema-fr.com/forum/viewtopic.php?f=1029&t=29891959&start=105#p172065673)


Amplifiers :

Transistors versus tubes, including the study of the speakers' influence on the amplifier's sound. Failures and success.
http://www.soundandvisionmag.com/assets/do...erInterface.pdf (http://www.soundandvisionmag.com/assets/download/AmpSpekerInterface.pdf)

David Clark. Several amplifiers, from very low to very high end. Failure.
http://bruce.coppola.name/audio/Amp_Sound.pdf (http://bruce.coppola.name/audio/Amp_Sound.pdf)

High end Bryston versus low end Onkyo. Liar test (the listener thought that he was listening to the other amplifier).
http://www.diyaudio.com/forums/showthread....;threadid=12752 (http://www.diyaudio.com/forums/showthread.php?s=&threadid=12752)

"Amplifiers Do Sound Different", by Martin Colloms, Hi-Fi News and Record Review, May 1986.
Debunked, then reconfirmed success.
http://www.bostonaudiosociety.org/bas_spea...ul_thinking.htm (http://www.bostonaudiosociety.org/bas_speaker/wishful_thinking.htm)

[French] Nad versus Rotel, by Trias and Kriktop. Failure.
http://forum.hardware.fr/hfr/VideoSon/HiFi...91.htm#t1219805 (http://forum.hardware.fr/hfr/VideoSon/HiFi-HomeCinema/topic-triangle-gamme-sujet_75180_191.htm#t1219805)

[French] Yamaha RVX657 vs BGW 750A, by Denis31. Failure.
http://chaud7.forumactif.fr/tests-abx-f8/a...w-750a-t476.htm (http://chaud7.forumactif.fr/tests-abx-f8/abx-d-amplis-yamaha-rvx657-vs-bgw-750a-t476.htm)

[French] Quadri-amplification, test on the medium channel, by Denis31 : Yamaha RVX657 versus Icos Elsberg 270. Failure.
http://chaud7.forumactif.fr/tests-abx-f8/a...rg-270-t478.htm (http://chaud7.forumactif.fr/tests-abx-f8/abx-d-amplis-yamaha-rvx657-vs-icos-elsberg-270-t478.htm)

[French] Yamaha RVX657 versus Jolida JD202, by Denis31 (transistor versus tube, failure)
http://chaud7.forumactif.fr/tests-abx-f8/c...-jd202-t537.htm (http://chaud7.forumactif.fr/tests-abx-f8/comparaison-yamaha-rvx657-jolida-jd202-t537.htm)

[French] Sansui 999 versus Yamaha RX V595 (Failure)
ABX test "Chez Jalot" : interconnects and amplifiers
http://www.forumcabasse.org/forum/viewtopic.php?t=3396 (http://www.forumcabasse.org/forum/viewtopic.php?t=3396)


Headphone amplifiers :

By Nitri and Pio2001. Success.
http://www.head-fi.org/forum/thread/429619...nts-and-one-abx (http://www.head-fi.org/forum/thread/429619/headphone-outputs-lots-of-measurments-and-one-abx)


CD Players and digital :

DA-AD chain (Xonar Essence STX, Xonar D1 soundcards), with different antialias filter settings. Software emulation of the soundcard filter included. Successful ABX.
Results : http://www.head-fi.org/t/676885/successful...ed-to-192-24/60 (http://www.head-fi.org/t/676885/successful-abx-testing-to-hear-the-difference-between-redbook-audio-vs-upsampled-to-192-24/60)
Description of the files : http://www.head-fi.org/t/676885/successful...90#post_9738961 (http://www.head-fi.org/t/676885/successful-abx-testing-to-hear-the-difference-between-redbook-audio-vs-upsampled-to-192-24/90#post_9738961)

[French] ABX of the Non-OverSampling design (simulated). Success.
http://www.homecinema-fr.com/forum/viewtop...t=60#p170435302 (http://www.homecinema-fr.com/forum/viewtopic.php?f=1037&t=29842033&start=60#p170435302)

Blind test between two CD Players (Follow the "Blind listening test" link):
http://diy.cowanaudio.com/blind.html (http://diy.cowanaudio.com/blind.html)

ABX test undertaken and failed by Y Tieffenbrunn, head of Linn, on the Sony A/D-D/A converter PCM F1 :
http://www.bostonaudiosociety.org/bas_spea...bx_testing2.htm (http://www.bostonaudiosociety.org/bas_speaker/abx_testing2.htm)

Study, including blind tests, on the sound of CD pressings :
The numerically-Identical CD mystery (http://www.prismsound.com/m_r_downloads/cdinvest.pdf) Ian Dennis, Julian Dunn and Doug Carson.
>> To put in balance against the "jitter theory", presented by Bob Katz (http://www.digido.com/media/articles-and-demos.html) in order to explain audible differences between originals and copies, or between digital drives; and with Bruno Putzeys' indications (http://www.pgm.com/pipermail/proaudio/2005-April/000639.html), who measured distortion in the analog output of a CD Player.

Direct vinyl vs digitalized vinyl (48 kHz 16 bits). Failure.
http://www.hydrogenaudio.org/forums/index....f=21&t=7953 (http://www.hydrogenaudio.org/forums/index.php?act=ST&f=21&t=7953)

Various analog copies. Success with an SB64 soundcard, and with a copy from a CD Player versus direct audio extraction :
http://www.hydrogenaudio.org/forums/index....f=21&t=6651 (http://www.hydrogenaudio.org/forums/index.php?act=ST&f=21&t=6651)

CD Tweaks (green pen etc), by John Atkinson and Will Hammond. Claimed success, debunked then because of wrong analysis :
http://www.bostonaudiosociety.org/bas_spea...ul_thinking.htm (http://www.bostonaudiosociety.org/bas_speaker/wishful_thinking.htm)

Equalizer and ADC/DAC :
http://www.bostonaudiosociety.org/bas_spea...abx_testing.htm (http://www.bostonaudiosociety.org/bas_speaker/abx_testing.htm)

[French] HD970 Player (250€) versus Cambridge 840C (1000€), by Coxwell and Mahler (failure) :
http://www.homecinema-fr.com/forum/viewtop...&t=29888619 (http://www.homecinema-fr.com/forum/viewtopic.php?f=1029&t=29888619)

[French] CD Players. 96 kHz 24 bits recordings from low end DVD player vs low end DVD Player + external DAC (success), then from CD Player vs Discman (success).
http://www.homecinema-fr.com/forum/viewtopic.php?p=169329500 (http://www.homecinema-fr.com/forum/viewtopic.php?p=169329500)

[French] RMAA measurments on four CD Players, by Kriktop :
http://forum.hardware.fr/hfr/VideoSon/HiFi...98.htm#t1225121 (http://forum.hardware.fr/hfr/VideoSon/HiFi-HomeCinema/topic-triangle-gamme-sujet_75180_198.htm#t1225121)

[French] AV integrated amplifier Yamaha 3900 versus Cambridge 840c (failure).
http://www.homecinema-fr.com/forum/viewtop...&t=29908630 (http://www.homecinema-fr.com/forum/viewtopic.php?f=1034&t=29908630)



Turntables :

[French] Luxman PD-282 vs Technics SL-3100 (both recorded digitally). Failure
http://www.homecinema-fr.com/forum/materie...-t30037817.html (http://www.homecinema-fr.com/forum/materiel-haute-fidelite/mesures-et-ecoutes-de-cellules-grado-stanton-t30037817.html)



Speaker cables :

John Dunlavy, liar tests (the listeners are said that something is changed while it is not true) :
http://www.nytimes.com/library/tech/99/12/...les/23down.html (http://www.nytimes.com/library/tech/99/12/circuits/articles/23down.html)

Measurements and ABX test on speaker cables (failure) :
http://www.hydrogenaudio.org/forums/index....mp;#entry135916 (http://www.hydrogenaudio.org/forums/index.php?showtopic=12941&st=50&#entry135916)

Measurements and ABX test on speaker cables (success) :
http://www.hydrogenaudio.org/forums/index....mp;#entry148461 (http://www.hydrogenaudio.org/forums/index.php?showtopic=14082&st=25&p=148461&#entry148461)

Monster versus Opus MM :
http://www.avsforum.com/avs-vb/showthread.php?t=941184 (http://www.avsforum.com/avs-vb/showthread.php?t=941184)

Monster 1000 versus Belden (success with Martin logan SL3, stats to be verified), Monster 1000 versus coathangers : failure !
http://forums.audioholics.com/forums/showt...15412#post15412 (http://forums.audioholics.com/forums/showthread.php?p=15412#post15412)

Success.
http://bruce.coppola.name/audio/Greenhill.pdf (http://bruce.coppola.name/audio/Greenhill.pdf) (dead link, reported to B.Coppola the 14/07/2010).



Interconnects :

Blind comparaison between three pairs of interconnects, by Edwood. "Blind Cable Taste Test".
http://www.head-fi.org/forums/f21/blind-ca...results-190566/ (http://www.head-fi.org/forums/f21/blind-cable-taste-test-results-190566/)

[French] Double blind test of interconnects, by Pio2001 :
http://www.homecinema-fr.com/forum/viewtopic.php?t=29781210 (http://www.homecinema-fr.com/forum/viewtopic.php?t=29781210)

[French] Double blind test of interconnects, by Rorominator. First account with wrong scores (false success) :
http://www.homecinema-fr.com/forum/viewtop...=480#p168850208 (http://www.homecinema-fr.com/forum/viewtopic.php?t=29781603&postdays=0&postorder=asc&start=480#p168850208)
New analysis, with real scores, failure :
http://www.homecinema-fr.com/forum/viewtop...=585#p168857599 (http://www.homecinema-fr.com/forum/viewtopic.php?t=29781603&postdays=0&postorder=asc&start=585#p168857599)

[French] Discussion on the two above tests, with links to Rorominator's declarations, who was certain of the success before the test :
http://www.homecinema-fr.com/forum/viewtop...=240#p168903915 (http://www.homecinema-fr.com/forum/viewtopic.php?t=29786006&postdays=0&postorder=asc&start=240#p168903915)

[French] Interconnects used between a preamplifier's output and headphones, (ABX 20/20) :
http://www.homecinema-fr.com/forum/viewtop...c&start=480 (http://www.homecinema-fr.com/forum/viewtopic.php?t=29781210&postdays=0&postorder=asc&start=480)

[French] Profigold versus DIY "that looks like Audioquest King Cobra". Failure.
http://www.homecinema-fr.com/forum/viewtop...8683#p172718683 (http://www.homecinema-fr.com/forum/viewtopic.php?f=1036&t=29910187&p=172718683#p172718683)

[French] 2 €uros basic interconnects versus 300 € Transparent cable
ABX test "Chez Jalot" : interconnects and amplifiers
http://www.forumcabasse.org/forum/viewtopic.php?t=3396 (http://www.forumcabasse.org/forum/viewtopic.php?t=3396)


Power cables :

Long term power cable blind test by Kiang. Hidden cables were sent to 23 forumers for comparison. Extraordinary differences heard between similar cables in the final results.

Test presentation :
http://www.hifiwigwam.com/forum1/1614.html (http://www.hifiwigwam.com/forum1/1614.html)
Results presentation in the discussion (dead links) :
http://www.hifiwigwam.com/forum1/1614-8.html#p113020 (http://www.hifiwigwam.com/forum1/1614-8.html#p113020)
http://www.hifiwigwam.com/forum1/1614-19.html#p115713 (http://www.hifiwigwam.com/forum1/1614-19.html#p115713)
Final results, with listeners comments :
http://3141592.pio2001.online.fr/files/Kia..._cable_test.xls (http://3141592.pio2001.online.fr/files/Kiang_Power_cable_test.xls)

J.V.Serinus test. With volume differences perceived between two times the same thing.
http://www.hometheaterhifi.com/volume_11_4...ds-12-2004.html (http://www.hometheaterhifi.com/volume_11_4/feature-article-blind-test-power-cords-12-2004.html)


HDMI cables :

[French] HDMI blind tests with two groups : experts and readers
http://www.lesnumeriques.com/page-blind-te...70_6175_93.html (http://www.lesnumeriques.com/page-blind-tests-avec-deux-jurys-experts-et-lecteurs-p770_6175_93.html)


Equalizer

Equalizer and ADC/DAC :
http://www.bostonaudiosociety.org/bas_spea...abx_testing.htm (http://www.bostonaudiosociety.org/bas_speaker/abx_testing.htm)

[French] Behringer DCX2496 (AD converter + equalization -12dB, Q=4 at 40, 100, 1k, 3k, 10k + equalization +12dB, Q=4 at 40, 100, 1k, 3k, 10k + DA converter) versus cable (the DCX output gain had to be set to +0.9dB in order to match input and output levels). Failure :
http://www.homecinema-fr.com/forum/viewtop...2551#p172522551 (http://www.homecinema-fr.com/forum/viewtopic.php?f=1037&t=29899454&p=172522551#p172522551) (setup given page 13).



General Audio

24/96, high definition formats :

Big study by Brad Meyer et David Moran at the AES :
http://www.aes.org/e-lib/browse.cfm?elib=14195 (http://www.aes.org/e-lib/browse.cfm?elib=14195)
Short presentation :
http://www.hydrogenaudio.org/forums/index....st&p=515700 (http://www.hydrogenaudio.org/forums/index.php?s=&showtopic=57406&view=findpost&p=515700)

Summary of various studies, including many links (Oohashi, NHK, Griesinger etc).
http://www.hydrogenaudio.org/forums/index....mp;#entry372649 (http://www.hydrogenaudio.org/forums/index.php?showtopic=40134&st=75&p=372649&#entry372649)

Links to the big test in Detmold university :
http://www.hydrogenaudio.org/forums/index....mp;#entry374740 (http://www.hydrogenaudio.org/forums/index.php?showtopic=3390&st=75&p=374740&#entry374740)

[French] Corsario's test :
Quantization noise detected at full volume (ABX 10/10) :
http://www.homecinema-fr.com/forum/viewtop...t=60#p172042057 (http://www.homecinema-fr.com/forum/viewtopic.php?f=1029&t=29891959&st=0&sk=t&sd=a&start=60#p172042057)
Failure on an "unmissable difference" :
http://www.homecinema-fr.com/forum/viewtop...t=60#p172048378 (http://www.homecinema-fr.com/forum/viewtopic.php?f=1029&t=29891959&st=0&sk=t&sd=a&start=60#p172048378)

[French] Gbo's test :
http://www.homecinema-fr.com/forum/viewtop...6126#p168172020 (http://www.homecinema-fr.com/forum/viewtopic.php?p=168176126#p168172020)

Very interesting : test your own perception threshold.
For frequency in kHz, download the "Mustang" files :
http://ff123.net/samples.html (http://ff123.net/samples.html)
Discussion :
http://www.hydrogenaudio.org/forums/index....showtopic=36469 (http://www.hydrogenaudio.org/forums/index.php?showtopic=36469)
For resolution in bits, the MAD challenge :
http://ff123.net/madchallenge.html (http://ff123.net/madchallenge.html)

Close to the MAD challenge, Ethan Winer's test, 21 listeners :
http://ff123.net/24bit/24bitanalysis.html (http://ff123.net/24bit/24bitanalysis.html)


Frequency response

Minimal audible deviations, by David Clark (http://www.aes.org/e-lib/browse.cfm?elib=3839) :
http://www.provide.net/~djcarlst/abx_crit.htm (http://www.provide.net/~djcarlst/abx_crit.htm)

Volume difference

[French] Kangourou spécial différences de volume
http://www.homecinema-fr.com/forum/viewtop...&t=29932928 (http://www.homecinema-fr.com/forum/viewtopic.php?f=1037&t=29932928)


Nothing at all :

Blind test on nothing at all (ABX 12/13, success without listening to anything !)
http://www.hydrogenaudio.org/forums/index....amp;#entry70284 (http://www.hydrogenaudio.org/forums/index.php?showtopic=6651&st=25&p=70284&#entry70284)

Another nothing at all blind test (success with p = 0.003)
http://www.hydrogenaudio.org/forums/index....mp;#entry151930 (http://www.hydrogenaudio.org/forums/index.php?showtopic=15192&st=0&p=151930&#entry151930)

...Lucky strikes that illustrate the effect of multiple tests for the first one, and of "sequencial tests" for the second. Follow the "Read first" link above for more informations.