Proposal on listening tests
Reply #43 – 2004-08-13 21:20:35
I would like to know the transparency level of each codec, but I see a number of problems related to such a test. Which of the following should be considered the transparency level? - The level at which the top 5% can't ABX problem samples from original - The level at which the top 5% can't ABX 95% of the samples from original - The level at which the top 5% can't ABX average samples from original - The level at which I can't ABX problem samples from original on my stereo - The level at which I can't ABX problem samples from original on my iPod - The level at which I can't ABX average samples from original I would probably be more interested in the last three and could find the transparency level by doing my personal listening tests, once the problem samples have been identified. A transparency test with public interest should be based on the results from a population of testers that should each report the transparency level supported by ABX tests. That would require not only a number of codecs to be used but also a number of predefined settings for each codec. In the end it would require a series of listening tests, say a seperate transparency test for each codec. [a href="index.php?act=findpost&pid=234225"][{POST_SNAPBACK}][/a] I've been thinking about this a lot, and the test would indeed be hard to pull off. I've especially been thinking about where the threshold should be, although my thoughts were: - 95% of the people can't ABX any samples - nobody can ABX more than 5% of the samples (this would require at least 20 samples, though) - 95% of the people can't ABX 95% of the samples (sort of a combination between the first two) The last three on your list really only have to do with you, so there's no need for everybody to participate. You only need yourself to figure out where they're transparent to you. It would be quite a bit different from other listening tests, but I think that's a lot of the appeal for it: there hasn't been anything like it. PS. I think you got something a bit wrong with your "which of the following" list. For example:- The level at which the top 5% can't ABX problem samples from original If the top 5% can't ABX them, then the bottom 95% CERTAINLY can't. You'll end up with the level where nobody can ABX them. I think you mean that only the top 5% CAN ABX them. [span style='font-size:8pt;line-height:100%']edit: streamlined quote[/span]