Skip to main content

Topic: ABX+ a layman (or noob)'s proposal (Read 2807 times) previous topic - next topic

0 Members and 1 Guest are viewing this topic.
  • LoFiYo
  • [*][*][*]
ABX+ a layman (or noob)'s proposal
When I see someone post ABX results like:

orig vs sample1 -- 12/12
orig vs sample2 -- 12/12
sample1 vs sample2 -- 12/12

unless there is a comment on the results, you couldn't tell which sample was better or harder to ABX. If there is a program that records how much time it took to reach the sufficient -p value, you can tell how difficult it was to ABX each sample.

For example, if you try to ABX fatboy.wav vs fatboy-cbr-96.mp3 (an mp3 file encoded in CBR96), it is very easy, therefore very quick to ABX the two. It might only take 1 minute to reach p = 0.001, whereas if you are trying to compare a very easy-to-encode sample vs alt-preset insane, it will definitely take much more time if possible at all.

So the correlation I see is, the more time it takes to reach the target p value, the more difficult it is to ABX the difference.

So if orig vs sample1 took 2 minutes to reach p=0.005, and if orig vs sample2 took 15 minutes to reach p=0.005, sample2 would be the clear winner.

If someone could make a quick and dirty prog that does this, people could test it and see if my theory is any good...

edit: for clarify
  • Last Edit: 25 March, 2004, 10:43:59 AM by LoFiYo

  • tigre
  • [*][*][*][*][*]
ABX+ a layman (or noob)'s proposal
Reply #1
Aren't there some ABX tools that log each trial with time? (latest fb2k ABX component does IIRC). Besides this, my 2 cent:
- I think ppl who are ready to spend the time necessary for doing valid ABX tests and posting the results, should be able to write one extra line describing the differences they heard and what sounded better/worse. Asking for such information if missing shouldn't be a problem.
- The time spent doesn't tell much generally, because of
-- listening fatigue / training effect can cause additional differences
-- sometimes you take a break or (as I do) ABX two different tracks alternately at the same time to avoid fatigue and save time.
Let's suppose that rain washes out a picnic. Who is feeling negative? The rain? Or YOU? What's causing the negative feeling? The rain or your reaction? - Anthony De Mello

  • harashin
  • [*][*][*][*]
ABX+ a layman (or noob)'s proposal
Reply #2
Actually, I spent more time on Rosemary than on Castanets.
Folding@Home Hydrogenaudio.org Team ID# 32639
http://folding.stanford.edu/

  • ff123
  • [*][*][*][*][*]
  • Developer (Donating)
ABX+ a layman (or noob)'s proposal
Reply #3
WinABX also logs the times

ff123

  • [proxima]
  • [*][*][*]
ABX+ a layman (or noob)'s proposal
Reply #4
I have to agree with tigre here. Nor time nor wrong trials are necessarily index of difficulty. Others motivations are:
-Sometimes i try to abx artifacts more subtle than the most annoying one in the sample, just to be sure they exist.
- I can obtain better results flushing my memory and waiting a little time before listening the other sample, fast switching doesn't help me to concentrate.

@LoFiYo: if you're referring to my abx results, try listening with more attention. The artifacts with rebel.wav are really easy to hear for me. I don't think it's a matter of good/bad ears. My equipment is nothing special (SB128 soundcard and HD 497 headphones). Maybe could be a matter of training.
WavPack 4.3 -mfx5
LAME 3.97 -V5 --vbr-new --athaa-sensitivity 1

  • LoFiYo
  • [*][*][*]
ABX+ a layman (or noob)'s proposal
Reply #5
I see. I almost exclusively use ABC/HR for ABX testing, so I was ignorant of other options... I also ignored the fatigue factor etc. Obviously I have much to learn.

[proxima]: your results and others on this forum only initially made me start thinking about this idea, and I am in no way trying to discredit your results. I respect your spending that much time for the test. If you are any way offended, I am sorry. I will try that sample again later. Maybe I can do better this time.

Thanks

  • [proxima]
  • [*][*][*]
ABX+ a layman (or noob)'s proposal
Reply #6
Quote
I am in no way trying to discredit your results. I respect your spending that much time for the test. If you are any way offended, I am sorry.

Offended.. ?? for what ??
Are you joking ??
Really no reasons to excuse.
WavPack 4.3 -mfx5
LAME 3.97 -V5 --vbr-new --athaa-sensitivity 1