HydrogenAudio

Hydrogenaudio Forum => Listening Tests => Topic started by: Sebastian Mares on 2009-12-03 12:47:31

Title: Closing listening-tests.info
Post by: Sebastian Mares on 2009-12-03 12:47:31
This post is to inform you that listening-tests.info will close within the next weeks. The reasons for this decision are various and I don't want to go too deep into detail.

After the last test, a lot of people complained that the page is not very user-friendly which I have to admit is true. However, unfortunately I don't have the time and to be honest also the skills to improve the situation on my own. I asked several times in public if anyone might be willing to give me a helping hand with creating a new layout and how to write better how-tos, but never received any reply.
Also, several people complained that now that I work for Nero, future results might be faked to let Nero appear in better light (of course I would never do something like this).
Beside this, conducting successful tests became rather difficult because only few people are willing to invest time and test the samples - most people only want to see results without putting any effort, which is quite sad.
Broadband Internet and storage space also got cheap in the meanwhile and a lot of people either use lossless codecs to store their music or they encode at bitrates which are transparent for most users. If 128 kbps was such a big challenge, you can imagine that 192 kbps or higher is simply untestable. The demand for 96 or 80 kbps is no longer here.

Anyways, I would appreciate it if somebody from Hydrogenaudio could "port" the existing results to the Wiki so that the results are not lost. In case a HA admin is willing to host the site as-is, I could also provide the whole site as ZIP.

Cheers,
Sebastian Mares
Title: Closing listening-tests.info
Post by: 2Bdecided on 2009-12-03 13:12:26
I think it would be useful to archive it as-is here - as long as it all gets mirrored properly (which it should do if you provide a zip).

There's precious little good listening test data out there - we don't need to lose some of the reliable stuff!

Cheers,
David.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2009-12-03 13:44:02
I prepared a 7z containing the whole site. If a HA admin / moderator is willing to create a mirror here, drop me a line via PM.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2009-12-03 13:47:58
I also got in touch with rjamorim and he is also looking for a mirror for his listening tests. Due to some personal problems, he missed the date for renewing his domain.
Title: Closing listening-tests.info
Post by: ExUser on 2009-12-03 14:47:48
I think this needs to be done. I will talk to the admins about this. If they refuse to host it (I can't see why), I'll personally offer to host the whole thing and even offer to take over paying for the domain.
Title: Closing listening-tests.info
Post by: Zarggg on 2009-12-03 15:45:06
Due to some personal problems, he missed the date for renewing his domain.

Most registrars will hold the domain for a year if it expires. They might charge an extra fee if it's more than 90 days past due, but it should still be renewable.
Title: Closing listening-tests.info
Post by: Garf on 2009-12-03 21:46:40
Should be no problem to host the sites as is. Are you going to keep renewing the domain or ... ?
Title: Closing listening-tests.info
Post by: Axon on 2009-12-03 22:17:43
I'll host and/or store a backup of the files on audiamorous.net if need be. My conflicts of interest don't intersect with listening tests.
Title: Closing listening-tests.info
Post by: MichaelW on 2009-12-03 23:27:50
Could I thank Sebastian for all the work he has done on the listening tests?

The increasing difficulty in getting them done undoubtedly reflects the increasing quality of lossy encoders; to which, surely, public listening tests have contributed. So, in the best way, the tests have brought about their own obsolescence.

Congrats on the new job, Sebastian. I guess avoiding the appearance of conflict of interest is a good idea, but I hope you don't think those accusations represent more than the secretions of the standard Internet Trolling Drongo.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2009-12-04 08:44:25
Should be no problem to host the sites as is. Are you going to keep renewing the domain or ... ?


Thanks Garf. I could transfer it to you or Canar if you think it's useful. Otherwise I would quit it together with the webhosting account.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2009-12-06 21:53:39
BTW, another problem is that schnofler apparently stopped development of ABC/HR for Java, coding something in Silverlight would require an expensive IIS server, and I don't know how to program in Air or Flash or even if those would be suitable for a testing application. ABC/HR has certain limitations and bugs that I don't know how to fix. Last time it didn't work correctly with JRE 1.6 and even with JRE 1.5 it had the problem that on some machines, a click was hearable when playing certain files (it always happened for the same files).
Title: Closing listening-tests.info
Post by: IgorC on 2009-12-08 17:34:35
If 128 kbps was such a big challenge, you can imagine that 192 kbps or higher is simply untestable.

Nah, I don't think it was so big challenge.
From last MP3 128kbps test http://www.listening-tests.info/mp3-128-1/results.htm (http://www.listening-tests.info/mp3-128-1/results.htm) I see that all encoders are more or less tied but they aren't transparent. Personally for me to be transparent encoder should have at least 4.7-4.8 of average score and don't go to lower mark than ~4.0-4.2.
There were actually bad scores.

Picking up some more difficult samples for listening test will help.
It's possible to perform test even at least at 160 kbps with very hard samples.Aemese sample will be just very killer. I didn't participate in last public test as I hadn't time but I've participated in previous.


Quote
After the last test, a lot of people complained that the page is not very user-friendly which I have to admit is true

There are always a lot of problems but the most important thing is that the public test was performed and it was useful.
Title: Closing listening-tests.info
Post by: Garf on 2010-01-04 19:37:52
Should be no problem to host the sites as is. Are you going to keep renewing the domain or ... ?

Thanks Garf. I could transfer it to you or Canar if you think it's useful. Otherwise I would quit it together with the webhosting account.

I'd drop the domain then. I'll just put it on a subdomain of hydrogenaudio.org.

Can you make a tarball of all content somewhere where I can fetch it, or so? Nevermind, got it.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2010-01-04 20:21:56
Cool, thanks for hosting Garf.

Anyone intersted in taking the domain and using it as "alias" for the subdomain on HA.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2010-01-05 20:45:44
Could a moderator please split this thread into "Closing listening-tests.info" and "Development of ABC/HR for Java" or something.
Title: Closing listening-tests.info
Post by: Alex B on 2010-01-06 10:41:35
Could a moderator please split this thread into "Closing listening-tests.info" and "Development of ABC/HR for Java" or something.

Good idea.

Regarding to the actual topic, it would be nice if

1. the domain could be preserved as a hosted domain at HA (otherwise there will be lots of dead links in the HA forums, HA Wiki and also elsewhere in the web), but if that is not possible, at least the links inside "listening-tests.info" that point to other pages in the same domain should be be corrected.

2. Roberto's old tests could be added.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2010-01-27 20:47:46
Domain will be closed on 25. February 2010.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2010-02-19 09:35:12
The site is online for five more days. In case anyone / HA wants to mirror it, now would be the right time.

Edit: Sorry for the confusion. Five more days doesn't mean that it will close in March (25. February + 5 days) but in five days starting today.
Title: Closing listening-tests.info
Post by: C.R.Helmrich on 2010-02-20 07:10:04
The site is online for five more days. In case anyone / HA wants to mirror it, now would be the right time.

Edit: Sorry for the confusion. Five more days doesn't mean that it will close in March (25. February + 5 days) but in five days starting today.

In case nobody volunteers, I am willing to host the tests without any downloadable material (ZIP or audio files) on ecodis.de. Some more tests might follow there anyway.

Chris
Title: Closing listening-tests.info
Post by: Alex B on 2010-02-22 21:14:11
Sebastian,

In order to keep your valuable test reports online until Garf adds the site as a hosted domain (I hope it'll happen) I reserved a site from a free hosting service. They advertise unlimited bandwidth and the free version can hold up to 60 megabytes of data. Later on, after the site has been added to HA, the address can serve as mirror.

If you agree, the site is already running and just needs the content. (I can fix the broken links if any will show up and you don't have time to do that.)

The address is  http://listeningtests.t35.com (http://listeningtests.t35.com/) and a demo page is here: http://listeningtests.t35.com/testpage (http://listeningtests.t35.com/testpage/). I tried to reserve "listening-tests.t35.com", but it did not accept a hyphen in the name.

As you can see it displays only a quite modest amount of advertisements - just a line of links at the end of the page.

PM me for details.


P.S. Naturally Roberto's tests would be welcomed too.


P.S.2  C.R.Helmrich,

If this site works as I expect, you would not need to sacrifice your personal site's bandwidth. Future tests can naturally be added, but I hope they'll be hosted at HA.

EDIT

Maybe they have changed the rules or I just remembered this wrong, but the disc space seems to be now unlimited. Only the size of individual files is limited to 1 MB, so it can hold any usual content, except files like audio samples that would exceed the limit. If there is a need to release audio samples in the future, linking them from other hosts would not be a problem.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2010-02-22 21:46:44
http://listening-tests.info/4mirrors.7z (http://listening-tests.info/4mirrors.7z)

Links should be all relative, so no need to change anything.
Title: Closing listening-tests.info
Post by: Alex B on 2010-02-22 21:52:25
Thanks, I'll upload it ASAP.
Title: Closing listening-tests.info
Post by: Alex B on 2010-02-22 22:49:28
It's done.

http://listeningtests.t35.com/ (http://listeningtests.t35.com/)
(also www.listeningtests.t35.com (http://www.listeningtests.t35.com) works)


Sebastian, probably the email address should be fixed on the pages where the following exists:

"If you have any questions, feel free to contact me via e-mail: mail [at] listening-tests [dot] info."

Should I change it to something like: "If you have any questions, feel free to ask them in the Listening Tests (http://www.hydrogenaudio.org/forums/index.php?showforum=40) forum at the hydrogenaudio.org (http://www.hydrogenaudio.org/) site." or would you like to provide another mail address?
Title: Closing listening-tests.info
Post by: Soap on 2010-02-23 00:20:12
Anyone intersted in taking the domain and using it as "alias" for the subdomain on HA.

If you're still looking for a taker for this role, I'll cough up the ~$10 a year to hold on to the domain and redirect towards the mirror, or even host the mothballed site.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2010-02-23 08:55:54
No idea if it's still possible to keep the domain. I already sent the signed confirmation fax to close the domain and not to transfer it.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2010-02-23 13:58:05
Sebastian, probably the email address should be fixed on the pages where the following exists:

"If you have any questions, feel free to contact me via e-mail: mail [at] listening-tests [dot] info."

Should I change it to something like: "If you have any questions, feel free to ask them in the Listening Tests (http://www.hydrogenaudio.org/forums/index.php?showforum=40) forum at the hydrogenaudio.org (http://www.hydrogenaudio.org/) site." or would you like to provide another mail address?


You're right. You can use a link to Hydrogenaudio. Thanks!
Title: Closing listening-tests.info
Post by: Alex B on 2010-02-24 08:00:53
I added Roberto's site from the Wayback Machine to listeningtests.t35.com. I had to fix a lot of links and some other things, but I think the site is now pretty complete and works correctly. I tried to not change any of the contents. The individal test participants' comments are not yet included as separate files (I'll try to add them later), but the comments are available in the rar packages. Only the "dial-up" results are missing a couple of image files that were not available. Also the actual test files (samples & configurations) are not included.

I have all reference samples from Roberto's tests in a lossless format (46 samples, 105 MB) in case someone would like to host them (t35.com has a 1 MB file size limit).

I hope Roberto will approve my preservation work. I understood from Sebastian's reply in this thread that Roberto is seeking a new home for the archived test site. (I didn't try to send him a PM. He was last active here in November 2008.)


In addition, I created a new homepage that provides links to Sebastian's and Roberto's test sites. I handled the mail address issues by explaining the situation on the homepage and providing a link to HA.

As I said before, it is possible to add new tests in the future. The homepage can be made better and expanded. Pages of additional stuff like testing instructions can be added.

http://listeningtests.t35.com (http://listeningtests.t35.com)
Title: Closing listening-tests.info
Post by: Alex B on 2010-02-24 16:10:42
I have now uploaded the 2725 individual result files that the participants created for Roberto's tests. Two of the seven tests had the results files in the xml format. I needed to process the xml files (to txt) and fix all folder links before they were ready.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2010-02-24 18:14:36
Thanks for your work Alex.
Title: Closing listening-tests.info
Post by: Alex B on 2010-02-25 10:29:30
t35.com (http://www.t35.com) seems to be down at the moment.   

They have a pretty good reputation though (as a free hosting service).

As a quick workaround, I created a mirror here: http://listening-tests.freetzi.com (http://listening-tests.freetzi.com)
(freetzi.com is one of the available names at www.freewebhostingarea.com)

Let's see how this turns out. Please report if the http://listeningtests.t35.com (http://listeningtests.t35.com) address works for you.
Title: Closing listening-tests.info
Post by: Alex B on 2010-02-25 10:46:10
Status report:

listeningtests.t35.com works again.

The main site www.t35.com is still down or overloaded because there is now too much traffic.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2010-02-25 17:26:28
listening-tests.info is down as you can see. Would be nice if Garf or some other admin could create a mirror here on HA. What I forgot to mention is that the mean traffic is about 200 MB per month, so not that much.

For people who are organizing tests, expect peaks of several GB per month when you announce the results of a test. My last test results generated about 10 GB traffic per month for 3 months.
Title: Closing listening-tests.info
Post by: Alex B on 2010-02-25 18:40:42
R.I.P. listening-tests.info 

At least both new addresses seem to work fine now. The T35 problem might have been a temporary hiccup, perhaps a problem in the international connections. I can't see any posts about the downtime in their user forum.
Title: Closing listening-tests.info
Post by: IgorC on 2010-03-03 02:51:53
Thank you very much for preserving valuable information.
Title: Closing listening-tests.info
Post by: Garf on 2010-03-06 13:28:30
I finally got off my ass, and archived the site here:

http://listening-tests.hydrogenaudio.org/sebastian/ (http://listening-tests.hydrogenaudio.org/sebastian/)
Title: Closing listening-tests.info
Post by: ExUser on 2010-03-06 16:20:39
Hooray! Thanks, Garf.
Title: Closing listening-tests.info
Post by: Sebastian Mares on 2010-03-18 16:32:45
Awesome, thanks Garf!
Title: Closing listening-tests.info
Post by: Alex B on 2011-10-04 11:20:23
FYI,

My mirror site is now available only at http://listening-tests.freetzi.com (http://listening-tests.freetzi.com) . The t35.com hosting service ended a few days ago.