Skip to main content

Topic: Multiformat Listening Test @ 128 kbps - OPEN (Read 148544 times) previous topic - next topic

0 Members and 1 Guest are viewing this topic.
  • naylor83
  • [*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #75
Quote
Doesn't telling everyone where the artifacts are kinda defeat the point of a listening test?
[a href="index.php?act=findpost&pid=348120"][{POST_SNAPBACK}][/a]


Well, I had listened at the beginning and I couldn't hear a thing, so it certainly didn't help me 

Ok. I'll stop asking.
davidnaylor.org

  • naylor83
  • [*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #76
Quote
Quote
Quote
Doesn't telling everyone where the artifacts are kinda defeat the point of a listening test?
[a href="index.php?act=findpost&pid=348120"][{POST_SNAPBACK}][/a]

The whole procedure of a listening test kind of defeats itself if you think like this. Training yourself to hear artifacts also shouldn't be done then, because you then might recognize new artifacts you missed before, which would change the notation of the codecs. I think the important thing is whether you can hear artifacts are not. Without knowing what to listen for and preferably also in which parts of the music, I am pretty sure practically everybody would have to rate all codecs as 5.0 in this test.
[a href="index.php?act=findpost&pid=348126"][{POST_SNAPBACK}][/a]


Well, specifying the exact position and sample where an artifact is noticable is a bit unfair IMHO.
[a href="index.php?act=findpost&pid=348128"][{POST_SNAPBACK}][/a]


But I think sTisTi has a point all the same. If I can hear it, I can hear it. If I can't - as it turned out in this case - (I can't even single out the low anchor for Carbonelli...) then I can't. All the knowledge in the world probably couldn't help me find that artifact, and hence the sample to me is a 5.0.
davidnaylor.org

Multiformat Listening Test @ 128 kbps - OPEN
Reply #77
That is true, too.

  • naylor83
  • [*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #78
Quote
That is true, too.
[a href="index.php?act=findpost&pid=348147"][{POST_SNAPBACK}][/a]


And you have to remember that the people taking a test like this probably vary a lot when it comes to training and skill, so the results can never be seen as representative for say 'average listeners' or 'pedantic listeners' - it's most likely a mix of all kinds.
davidnaylor.org

  • rjamorim
  • [*][*][*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #79
Jesus Christ!

Discussing artifacts ist verboten. Please stop it at once, people!
  • Last Edit: 06 December, 2005, 05:07:23 PM by rjamorim
Get up-to-date binaries of Lame, AAC, Vorbis and much more at RareWares:
http://www.rarewares.org

Multiformat Listening Test @ 128 kbps - OPEN
Reply #80
Edit: Roberto was faster.
  • Last Edit: 06 December, 2005, 05:12:21 PM by Sebastian Mares

Multiformat Listening Test @ 128 kbps - OPEN
Reply #81
Quote
Quote
That is true, too.
[a href="index.php?act=findpost&pid=348147"][{POST_SNAPBACK}][/a]


And you have to remember that the people taking a test like this probably vary a lot when it comes to training and skill, so the results can never be seen as representative for say 'average listeners' or 'pedantic listeners' - it's most likely a mix of all kinds.
[a href="index.php?act=findpost&pid=348154"][{POST_SNAPBACK}][/a]


One thing I didn't consider - when person X says that sample Y has an artifact at postition 123, then person Z is going to keep testing and testing sample Y because he knows that it has an artifact.

  • caligae
  • [*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #82
Quote
One thing I didn't consider - when person X says that sample Y has an artifact at postition 123, then person Z is going to keep testing and testing sample Y because he knows that it has an artifact.
[a href="index.php?act=findpost&pid=348168"][{POST_SNAPBACK}][/a]


But this would only be unfair if that specific artifact is only spotable with encoder A, but encoder B has noticable artifacts at different positions. If this is not the case it would be an improvement for the test results IMHO -- because you get real ratings instead of all 5.0s.

  • rjamorim
  • [*][*][*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #83
Quote
If this is not the case it would be an improvement for the test results IMHO -- because you get real ratings instead of all 5.0s.[a href="index.php?act=findpost&pid=348183"][{POST_SNAPBACK}][/a]


You also get artificial results, as people might listen again and again, paying much more attention than they normally would.
Get up-to-date binaries of Lame, AAC, Vorbis and much more at RareWares:
http://www.rarewares.org

  • eisa01
  • [*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #84
My fear is that I'll only be able to figure out what the low anchor is

Have only tested two samples, and I've only managed to find one version that had artifacts.
  • Last Edit: 06 December, 2005, 07:54:41 PM by eisa01

  • markanini
  • [*][*][*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #85
So far I've done three samples and sure it's difficult to spot artefacts on other than the low anchor but it's not totally impossible. A quiet enviroment and adjusting the volume moderately loud for each sample helps. The hard parts is probably that you need to be in a focused state of mind and you'll have to listen to all the samples more than a few times to spot the artefacts.

Just a few observations I made. Not that I've done many listening teste before...

  • Oliver
  • [*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #86
Quote
My fear is that I'll only be able to figure out what the low anchor is
[{POST_SNAPBACK}][/a]
Hi eisa01,

I have the same fear!  I plan to use the practice files, in the hope that they will improve my ability to hear the problems.

Oliver

Practice files [a href="http://ff123.net/64test/64kbsPractice.zip]http://ff123.net/64test/64kbsPractice.zip[/url]

  • Dibrom
  • [*][*][*][*][*]
  • Administrator
Multiformat Listening Test @ 128 kbps - OPEN
Reply #87
It has already been requested twice that people stop discussing their experience of the listening test itself while the still is still being carried out.

Please respect that, otherwise it is likely that this thread will be closed so as to maintain test integrity.

Really, until the test is finished, the only things that should be discussed in this thread, in my opinion (Sebastian can add something here if he doesn't agree), are metaissues such as discussion about obtaining or distributing the files, announcing the test at other places, or discussion about problems with the abc/hr program.

If you can't hear any differences, fine.  That is just as useful of a result for the purposes of the test.  Please don't ask other people to tell you if they hear differences or to describe their testing experience.

By the way, if Sebastian requests it, I will remove previous posts discussing any of this from the current thread.

  • Shade[ST]
  • [*][*][*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #88
I found an issue with the delivered ABC/HR program :

DISCLAIMER - DO NOT READ THIS IF YOU ARE PERFORMING THE OPEN TEST - IT MAY INFLUENCE YOUR RESULTS.

PM me for details.
  • Last Edit: 07 December, 2005, 01:43:27 PM by Shade[ST]

  • ErikS
  • [*][*][*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #89
Quote
I found an issue with the delivered ABC/HR program :
[...]hear a click[...]
[a href="index.php?act=findpost&pid=348218"][{POST_SNAPBACK}][/a]

Make sure you're using JRE v1.5. If you haven't upgraded, clicks in the sound is an issue which is already known. Perhaps there should have been a warning or something when abc/hr falls back on older JRE... well well...

  • Shade[ST]
  • [*][*][*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #90
I am using the latest JRE. I reformatted two days ago.

  • naylor83
  • [*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #91
Quote
I am using the latest JRE. I reformatted two days ago.
[a href="index.php?act=findpost&pid=348229"][{POST_SNAPBACK}][/a]


Me too.
davidnaylor.org

  • naylor83
  • [*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #92
Quote
Quote
If this is not the case it would be an improvement for the test results IMHO -- because you get real ratings instead of all 5.0s.[a href="index.php?act=findpost&pid=348183"][{POST_SNAPBACK}][/a]


You also get artificial results, as people might listen again and again, paying much more attention than they normally would.
[a href="index.php?act=findpost&pid=348194"][{POST_SNAPBACK}][/a]


But then again, that is true for any listening tests. Or do you suggest we just listen to every sample once, as if we were only 'enjoying the music', and then rate everything at 5.0?

However, I will respect Sebastians request not to ask/answer questions like that. And nobody has gone against him since he stated his opinion on the matter.
davidnaylor.org

Multiformat Listening Test @ 128 kbps - OPEN
Reply #93
Quote
Quote
Quote
If this is not the case it would be an improvement for the test results IMHO -- because you get real ratings instead of all 5.0s.[a href="index.php?act=findpost&pid=348183"][{POST_SNAPBACK}][/a]


You also get artificial results, as people might listen again and again, paying much more attention than they normally would.
[a href="index.php?act=findpost&pid=348194"][{POST_SNAPBACK}][/a]


But then again, that is true for any listening tests. Or do you suggest we just listen to every sample once, as if we were only 'enjoying the music', and then rate everything at 5.0?

However, I will respect Sebastians request not to ask/answer questions like that. And nobody has gone against him since he stated his opinion on the matter.
[a href="index.php?act=findpost&pid=348240"][{POST_SNAPBACK}][/a]


No, it's OK to re-listen to the song as many times as you want.
However, when someone says that sample XYZ has an artifact, you are not going to let go until you spotted it because you know there is an artifact there.

  • Lyx
  • [*][*][*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #94
Quote
But then again, that is true for any listening tests. Or do you suggest we just listen to every sample once, as if we were only 'enjoying the music', and then rate everything at 5.0?

This is not a black/white issue. Some "artificial" training is necessary - but the line has to be drawn somewhere. And you now know where it is.

- Lyx
I am arrogant and I can afford it because I deliver.

  • plonk420
  • [*][*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #95
RareWares seems to be sending .TORRENT files as wrong MIME type. browser normally opens them to download or launch (and trust me, i use a LOT of torrent sites ;). RareWares causes my firefox to display them as text files...

Multiformat Listening Test @ 128 kbps - OPEN
Reply #96
Holy crap, I just finished the test and I must say, I am really impressed by the quality of these samples. It's phenominal.

I have one question and I will not in any way be aggrevated if it is not answered (for some test reason).

The question I have is, what were the specific settings for the Nero encoded files. Was it one of the default LC profiles. Perhaps VBR/Stereo - Transparent [110-150]? Or was it a custom setting?

Thanks.
Just an average nerd!

  • Shade[ST]
  • [*][*][*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #97
Quote
I have one question and I will not in any way be aggrevated if it is not answered (for some test reason).
[a href="index.php?act=findpost&pid=348253"][{POST_SNAPBACK}][/a]

You can read the whole discussion about the choice of samples in the pre-test thread. just search for it.

  • caligae
  • [*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #98
Quote
I found an issue with the delivered ABC/HR program :


I don't think you can avoid this (except every listener being supervised by some authority during the test). Even if you use strong encryption, the sound has to go to the soundcard unencrypted sooner or later. It's just like with DRM.

Yesterday I could easily abx a file without even the sound turned on within a few seconds.

So we just have to trust that no one wants to ruin the test by sending in manipulated results. Since the encoders and settings are also available, it would even be possible to favor/bash a specific codec.

  • Shade[ST]
  • [*][*][*][*][*]
Multiformat Listening Test @ 128 kbps - OPEN
Reply #99
Quote
I don't think you can avoid this (except every listener being supervised by some authority during the test). Even if you use strong encryption, the sound has to go to the soundcard unencrypted sooner or later. It's just like with DRM.
[a href="index.php?act=findpost&pid=348261"][{POST_SNAPBACK}][/a]

It would be possible to implement a disk cache flushing mechanism that would make sure that both accesses take the same time.  Or, on opposite levels, a cache mechanism that would make sure that no delays are heard when playing back sound.  A sort of safety, like, don't start playing until all files are fully cached (at least the beginning of them, maybe 1-2 seconds, praps)