When are we reaching the point that further tests in the future become superfluous? Just from looking at the results of this test, not one codec is significally better than another one. Can we safely say "stick to lame for universal compatibilty or take your pick for whatever your hardware device will suport"

Quote

Quote from: Sebastian Mares,Jan 14 2006, 03:41 Can you also add more complete info of the encoder in the graph? e.g.: AoTuv -> Vorbis AoTuV 4.51, Nero -> AAC Nero 3.1.0.2, etc... I prefer first the format, then vendor and version. Many sites link only to the image and can give a confusing idea of which encoder was used. Also on that image should be a link to the full explanation of the results.[/quote

Well, if someone posts the image, he should also post to results page.
Adding the full encoder version / information is useless IMHO - it's stated already on the presentation page (which can be accessed if you are on the results page, that is supposed to be posted together with the plot).

i agree with fpi, i would add encoder, version, and probably command line. Even if i link to your page, people most of the time just look at the graph.

When are we reaching the point that further tests in the future become superfluous?
[a href="index.php?act=findpost&pid=357164"][{POST_SNAPBACK}][/a]

i agree with fpi, i would add encoder, version, and probably command line. Even if i link to your page, people most of the time just look at the graph.

You know, space is limited. Writing "VBR/Stereo - Streaming, 100-120 kbps [LC AAC]" in the graph is pretty much overkill. Anyways, I will see what I can do tomorrow.
[{POST_SNAPBACK}][/a]

And BTW, this was a funny result:

Code: [Select]

 ABC/HR for Java, Version 0.5b, 06 december 2005 
 Testname: DontLetMeBeMisunderstood 
  
 Tester:  
  
 1R = Sample05\DontLetMeBeMisunderstood_1.wav 
 2L = Sample05\DontLetMeBeMisunderstood_2.wav 
 3L = Sample05\DontLetMeBeMisunderstood_3.wav 
 4L = Sample05\DontLetMeBeMisunderstood_6.wav 
 5R = Sample05\DontLetMeBeMisunderstood_4.wav 
 6R = Sample05\DontLetMeBeMisunderstood_5.wav 
  
 --------------------------------------- 
 General Comments: Focus on 4.16 - 6.46 
 --------------------------------------- 
 1L File: Sample05\DontLetMeBeMisunderstood.wav 
 1L Rating: 4.8 
 1L Comment:  
 --------------------------------------- 
 5L File: Sample05\DontLetMeBeMisunderstood.wav 
 5L Rating: 1.0 
 5L Comment:  
 --------------------------------------- 
  
 ABX Results: 

[a href=\"index.php?act=findpost&pid=357129\"][{POST_SNAPBACK}][/a]

By the way, results that were invalid (didn't meet ABX minimums) were not uploaded. Since I posted the encryption key, you can decrypt the results yourself if you are wondering why your result is not counted.
[{POST_SNAPBACK}][/a]

Sample  AoTuV AAC-Itunes AAC-Nero Lame Shine WMApro
01      5.0   4.5        5.0      2.0  2.0   5.0   
03      5.0   5.0        5.0      2.0  2.0   5.0
04      5.0   5.0        5.0      5.0  2.0   5.0
05      5.0   5.0        3.0      5.0  1.0   5.0
06      5.0   5.0        5.0      5.0  1.0   5.0
07      5.0   5.0        5.0      5.0  3.0   5.0
08      5.0   4.0        4.0      3.0  1.5   4.5
10      5.0   5.0        5.0      5.0  2.0   5.0

Sample iTunes LAME Nero Shine AoTuv WMA Pro
1      3,2    3,2  4    1     5     3,5
2      5      4,5  4    1     5     4,5
3      5      2,2  5    1,5   4     3,5
4      4      3,2  3,5  1     5     2,8
5      5      4    5    1,5   4     3,5
6      4,4    2,8  4    1,5   5     3
7      5      4    4,5  2,5   5     4,5
8      5      3,5  4    1     5     3,5
9      5      4    3,5  1     5     4
10     5      4    4    1,5   5     3,5
11     3,5    4    4    1,5   5     3,5
12     4,5    3,5  4    1,5   4,5   3,5
13     5      3,5  5    1     5     4
14     5      4    4,5  1     5     4
15     4,5    3,5  4    1     5     3,5
16     5      4    4    1     5     4
17     5      3    4    1     5     3,5
18     5      4    5    1     5     5

AVG    4,67   3,61 4,22 1,25  4,86  3,74

Does the results page state what settings where used for each encoder?
[a href="index.php?act=findpost&pid=357197"][{POST_SNAPBACK}][/a]

Quote

By the way, results that were invalid (didn't meet ABX minimums) were not uploaded. Since I posted the encryption key, you can decrypt the results yourself if you are wondering why your result is not counted.
[a href="index.php?act=findpost&pid=357124"][{POST_SNAPBACK}][/a]

Sebastian,

Could you please elaborate on the criteria used for invalidating a result file?[a href="index.php?act=findpost&pid=357204"][{POST_SNAPBACK}][/a]

If the results contain ranked references and no ABX logs, the results are invalid.
[a href="index.php?act=findpost&pid=357238"][{POST_SNAPBACK}][/a]

On the total results: how much % of the gradings gave a "transparent" mark, if we exclude shine?

The same question but adding the graded references as 5.0 for the codec in question?
[a href="index.php?act=findpost&pid=357241"][{POST_SNAPBACK}][/a]

Is there a way to see your own results, including results for discarded result files?
[a href="index.php?act=findpost&pid=357242"][{POST_SNAPBACK}][/a]

sehested, do you want to see the results you submitted or what? If you still have the encrypted files, you can decrypt them using ABC/HR and the encryption key I linked to on the results page.
[a href="index.php?act=findpost&pid=357246"][{POST_SNAPBACK}][/a]

Quote

sehested, do you want to see the results you submitted or what? If you still have the encrypted files, you can decrypt them using ABC/HR and the encryption key I linked to on the results page.
[a href="index.php?act=findpost&pid=357246"][{POST_SNAPBACK}][/a]

Thanks, I will check it right away.

The other question I have is about the amount of result files that where discarded.

Can you give any numbers?
[a href="index.php?act=findpost&pid=357249"][{POST_SNAPBACK}][/a]