Skip to main content

Topic: ABX Result Calculation : Suggestion (Read 2706 times) previous topic - next topic

0 Members and 1 Guest are viewing this topic.
  • kotrtim
  • [*][*][*][*][*]
ABX Result Calculation : Suggestion
Is this way of calculation any good?

this is my suggestion: (to test codec's transparency)

at high bitrate such as 192kbps and above, its pretty hard to rate it!
so why not just use A , B & X test (which is available in foobar2000)

Formula = no. of wrong trials divided by no. right trials

Fix the trial to 10

if the result is 9/10, that means 1/9=0.11111, the codec is NOT transparent

if the result is 10/10,  0/10=0, the codec transparent probability is 0

if the result is 5/10, 5/5=1, the codec is transparent

if the result is 1/10, 9/1=9, the codec is NO DOUBT transparent

If the result is 0/10 (which is impossible), 10/0=......No DOUBT transparent

..............
  • Last Edit: 24 November, 2004, 04:53:13 AM by kotrtim

  • guruboolez
  • [*][*][*][*][*]
  • Members (Donating)
ABX Result Calculation : Suggestion
Reply #1
Quote
(...)
if the result is 5/10, 5/5=1, the codec is transparent
(...)
[{POST_SNAPBACK}][/a]

Did you ever run any ABX program?

[a href="http://ff123.net/abx/abx.html]http://ff123.net/abx/abx.html[/url]
An encoded file is for sure transparent if pval < 0.05 (even below if ABX test is not sequential).
5/10 => pval = 0.624
In other word, 62% of chance that the tester is guessing.

  • kotrtim
  • [*][*][*][*][*]
ABX Result Calculation : Suggestion
Reply #2
Quote
An encoded file is for sure transparent if pval < 0.05 (even below if ABX test is not sequential).
5/10 => pval = 0.624
In other word, 62% of chance that the tester is guessing.
[a href="index.php?act=findpost&pid=256084"][{POST_SNAPBACK}][/a]


oops...thanks guru, I've used ABX in foobar2000, but I don't really understand the pval=XX%
  • Last Edit: 25 November, 2004, 05:05:21 AM by kotrtim

  • guruboolez
  • [*][*][*][*][*]
  • Members (Donating)
ABX Result Calculation : Suggestion
Reply #3
Another precision:
0/10 doesn't mean transparency, but total failure. 9/10 is a pretty good result - not the opposite