Skip to main content

Notice

Please note that most of the software linked on this forum is likely to be safe to use. If you are unsure, feel free to ask in the relevant topics, or send a private message to an administrator or moderator. To help curb the problems of false positives, or in the event that you do find actual malware, you can contribute through the article linked here.
Topic: Audibility of "typical" Digital Filters in a Hi-Fi Playback  (Read 331664 times) previous topic - next topic
0 Members and 6 Guests are viewing this topic.

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #500
Remember, this forum requires such proofs of audible difference.  See TOS #8 in my last post.

Beware AJ, amirm has discovered the ToS. He doesn't understand it, but happy like a little child finding a dollar he spreads the word to everyone, just like he did after he found out that he can produce ABX logs.
"I hear it when I see it."

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #501
So low-res audio is not about sales?

Sure it is. But it's not a $cam, like inaudible benefit "Hi-Rez" for more $$.

Who says?

You did:
You say I have claimed to hear audible problems.  I have not.

You admitted you couldn't hear audio problems with the 16/44 version. So how isn't charging more and claiming audible benefits a $cam?

Can you prove you can hear the difference  between CD and MP3 Ammar?

I don't have to, as it's only purpose would be to Red Herring or Ad Hominem the arguments about the BS paper.
And no I won't meet you in the schoolyard for a fight after classes either Amir. 
Pull yourself togther now, let's get back to the award winning BS paper.

Remember, this forum requires such proofs of audible difference.  See TOS #8 in my last post.

If you feel I've violated forum rules, please report it. Otherwise, let's get back to the BS paper and you inability to defend it, the real source of your worries. 

cheers,

AJ
Loudspeaker manufacturer

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #502
I sell speakers...

You do more than that Ammar.

Wrong Amir. The only thing I sell is speakers. On my website, only speakers. Nothing else.
Now, we both know you do sell Hi-Rez products (Berkley) hardware. So I understand fully you've got some skin in the game and have a very strong desire for the BS paper to be legit.
So let's address some the issue around the BS test, like the dither doctoring, zero system transparency data, possibility of switching artifacts, the fact that no "CD"16/44 TPDF downsampled version of the 2L Hadyn file exists, etc., etc.
Are you a bit worried about some of these legitimate issues raised?

cheers,

AJ
Loudspeaker manufacturer

 

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #503
Can you prove you can hear the difference  between CD and MP3 Ammar?

I don't have to, as it's only purpose would be to Red Herring or Ad Hominem the arguments about the BS paper.

Ah, so the premium cost of CD over MP3 is justified.  But past that, it is a sin.

The rules we invent.  It is like saying you can go from 3 to 4 bedroom house. But oh, more than that?  It is a sin.

Quote
And no I won't meet you in the schoolyard for a fight after classes either Amir.

Chicken. 

Quote
If you feel I've violated forum rules, please report it. Otherwise, let's get back to the BS paper and you inability to defend it, the real source of your worries. 

Seems like you missed what is on the title page:

).  Award winning Ammar.  Peer reviewed Ammar.  Co-written by AES Fellow.  With strong background in psychoacoustics.

Don't need no defending I say! 

Tables are turned AJ.  The impossible has happened.  People have passed ABX DBT tests of high res vs CD's 16/44.  Peer reviewed published tests have shown the same even down to the filtering alone.

And that is not all.  We have just about all of you on record refusing to run double blind ABX tests.  Maybe you could have lived with the above but with this?  Not possible Ammar.  You will be haunted by it and strongly so.

Me?  I ran the tests.  I held a position that has come true now.  That quality engineering matters.  That the good enough camp will have its hat handed to them one day.  The day and year came .

Folks on AVS gave up on protests.  Same will happen here. Just takes a bit of time for the reality to sink in.  That by very standard we demand proof, proof has been provided.  Attempts to change the rules now will just look silly as heck. 

Grown up "objectivists" declaring ABX test logs subject to corruption!  This whole forum is based on that bylaw.  But we now say live witnesses are required.  Don't come here with no DBT ABX results.  That is what we are saying.  Why?  Because we can't allow ourselves to lose the "good enough" war.

Let me know when you understand truly what it means to be an objectivist because it is clear you are living same made up notion.

Edit: grammar and a couple of additions.
Amir
Retired Technology Insider
Founder, AudioScienceReview.com

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #504
If you read the fine-print you'd have seen that the award was given on basis of the abstract and a 750-word summary, which has been peer-reviewed. They explicitly say that the paper itself has not been peer reviewed. How can a journal in good conscience hand out an award in that case?

And anyway, highlighting the names of the authors or the fact that this paper got an (dubious) award also means nothing at all. What's more interesting is that all of the people work at a company with a strong interest to push "hi-res" mass-market adoption.
It's only audiophile if it's inconvenient.

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #505
Are you ever going to stop trying to shift the burden of proof? Again, it makes you look retarded and impossible to take seriously. Your deluded statements do not help your case either. You may even be partially right, but no one here is going to take you seriously the way you state your case. I am not an engineer so I do not understand the technical details, but I do not need to if one side of this never ending debate is clearly irrational. You lose by default. It's getting old.





FLAC -> JDS Labs ODAC/O2 -> Sennheiser HD 650 (equalized)

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #506
If you read the fine-print you'd have seen that the award was given on basis of the abstract and a 750-word summary, which has been peer-reviewed. They explicitly say that the paper itself has not been peer reviewed. How can a journal in good conscience hand out an award in that case?

They can because that is not the situation at hand as I explained to Arny earlier in this thread:

Winner of best *peer-reviewed* paper award.  You say you have the paper but didn't see that?  And positioned it as not being peer-reviewed?

The copy of the paper I just obtained from the AES web site starts out:

"This Convention paper was selected based on a submitted abstract and 750-word precis that have been peer reviewed
by at least two quali ed anonymous reviewers. The complete manuscript was not peer reviewed. This convention
paper has been reproduced from the author's advance manuscript without editing, corrections, or consideration by the
Review Board. The AES takes no responsibility for the contents."

Hi Arny.  That is just a boilerplate AES puts on every conference paper these days.  The Stuart paper is different and has this additional line I post:

Winner of the AES 137th Convention Best Peer-Reviewed Paper Award

That is the result of this (rather) new category of paper submission to the conference: http://www.aes.org/events/137/authors/137thCallForPapers.pdf

Authors may submit proposals in three categories:
1. Complete-manuscript peer-reviewed convention papers (submit at www.aes.org/137th_authors)
2. Abstract-precis-reviewed convention papers (submit at www.aes.org/137th_authors)
3. Synopsis-reviewed engineering briefs (submit at www.aes.org/137th_ebriefs)


For the complete-manuscript peer-reviewed convention papers (category 1), authors are asked to submit papers of 4–10 pages to the
submission site. Papers exceeding 10 pages run the risk of rejection without review. These complete-manuscript papers will be reviewed
by at least two experts in the field,
and authors will be notified of acceptance by 2014 June 18. Final manuscript with revisions
requested by the reviewers have to be submitted before 2014 July 9. If rejected as a convention paper (Cat. 1), the proposal may still be
accepted for categories 2 or 3.


Award selection is then made from these complete, peer-reviewed papers. Winning the award opens the door to the paper being published in the journal.

I think we have slammed the door shut on any statement regarding standing of this paper in the eyes of professional AES community.  It is excellent work.  It is the most careful double blind test of small differences due to coding of audio that has been published.  It is an inconvenient truth to be sure for many, but hopefully the search for knowledge and learning trumps that negative emotion.


As to your other comment,
Quote
And anyway, highlighting the names of the authors or the fact that this paper got an (dubious) award also means nothing at all. What's more interesting is that all of the people work at a company with a strong interest to push "hi-res" mass-market adoption.

it seems the nature of Audio Engineering Society is not understood.  This is an industry organization.  I would say some 90% of the papers are from companies describing the work they have done for their commercial enterprise.  Check out Dr. Toole and Dr. Olive's work.  Dr. Toole used to work for Harman and Dr. Olive still does.  Dr. Olive was elected the president of AES.  If you dispose of their work due to commercial interest, you will lose some of the best work done every about speakers and room acoustics.  AES is where the industry gets together and shares knowledge.

Even if that were not the case, appearance of bias is not bias.  Who do you think will go and rush and buy Meridian hardware because this paper came out?  Doesn't your AVR player 24/192?  How would you using that capability result in increased sales for Meridian?  Yes, there is some side benefit in potentially justifying the apodizing filter and such in Meridian equipment but they have no lock on that and at any rate, that is a side comment.

All of this said, I praise the paper sarcastically because for weeks your members, mzil kept saying on AVS Forum thread that all sins of Meyer and Moran are to be forgiven because their work was "peer reviewed and published by AES."  Here is what he said when like you, thought the paper was not peer reviewed:

Quote
In numbers, yes, but in terms of human hearing there is still, to this date, no peer reviewed, published study which has found even a single individual, anywhere, under any conditions, using either music or specially designed test tones (to make the challenge even easier), who can distinguish between CD quality sound and Hi-res even in an ideal, specially treated room, using $20K-$80K/pr speakers [$46k?], under controlled, blind, level matched conditions, sourced from the same master recording, at normal listening levels, with statistical significance.


As they say, the bed was made and now folks have to sleep in it .

As to appeal to authority, sad to see that argument used again when it has no relevance in real life.  When our industry luminaries speak, we listen.  They have knowledge, experience and data which we do not have.  The notion that they are no better than AJ in florida, or xnor in Australia is absurd.  Their work trumps any member posting under an alias with no industry or research experience.  Please don't ask me to live in the fantasy we have created for ourselves otherwise .

Amir
Retired Technology Insider
Founder, AudioScienceReview.com

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #507
Are you ever going to stop trying to shift the burden of proof? Again, it makes you look retarded and impossible to take seriously. Your deluded statements do not help your case either. You may even be partially right, but no one here is going to take you seriously the way you state your case. I am not an engineer so I do not understand the technical details, but I do not need to if one side of this never ending debate is clearly irrational. You lose by default. It's getting old.

Shift the burden of proof?  Proof has been provided.  Every DBT thrown at me I have taken and passed.  We now are discussing double blind published study that has shown across 160 trials to better than 95% statistical confidence that listeners could hear difference between high resolution source and filtered one.  The burden is all yours to prove otherwise. 

And why do you think you were on the other side of the fence ever?  I know we have convinced ourselves in forums that such proof can't exist.  But that is symptom of living in a bubble, not reality.  I can cite paper after paper that demonstrates CD can lack transparency.  Here is professor Vanderkooy who despite his high qualification, is more on you all's side:

J. Vanderkooy. A digital-domain listening test
for high-resolution. AES 129th Convention,
San Fransisco, 2010.

At the outset, let me state my bias that CD-quality audio
(44.1 kHz, 16 bit) is essentially transparent. Under
pristine conditions it may just be possible to hear
residual channel noise.


[..]

My colleagues and I have done some fairly good tests
ourselves, and while we cannot say definitively that
good digital systems all sound alike
, the significance of
any differences were minor in our assessment. Clearly
better tests are needed
, and this proposal seeks to garner
broad support for a new test concept.


And so a better test was developed which is the topic of this thread.  The above is reference [7] in Stuart's paper out of 35.  Yes, 35 references.  And you thought that work can be dismissed out of hand like that?  Burden of proof?  Really?

So please excuse me for once again being disappointed in another emotional outburst instead of a constructive technical contribution.  Is there no hope that this forum acts professionally and the discussion remains on topic than personal?

Edit: typos.
Amir
Retired Technology Insider
Founder, AudioScienceReview.com

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #508
Every DBT thrown at me I have taken and passed.

Amirm, I see you passed a comparison of non-linear filtering on this forum in the 20kHz brickwall filtering thread, and a particular comparison of non-aligned sources on another forum (AVS), in its "take 2" thread. I have not seen your attempt at ABXing linear filtering in the 20kHz brickwall thread, or time-aligned files in the AVS take 2 thread (my own samples X2 and Y2).

Given that your hearing is not as responsive to high frequencies as it used to be, it would be quite reasonable for you to decline. However if you wish to display a current prowess, then I would invite you specifically to try ABXing the linear 20kHz brickwall filter example on this forum,1 and the time-aligned, level aligned, linear filtered for 44.1kHz, On_The_Street_Where_You_Live examples X2 and Y2 on AVS Forum.2 If you try, and hear no differences, please advise.

_______________

The following footnotes identify where the comparison sources may be found.

1. 20kHz reference and maximum phases files:
I've filtered some 24/96 audio with the linear phase (050) and maximum phase (100) 20k impulses, and uploaded the results here:
...

The files I linked to in this thread have expired.
To make sure the files remain accessible, I've also put them online on my website.
Note that these are slightly modified files made on Jul 9 2010 by bandpass.
The shell-script used to generate the latest samples is available as well.
...
limehouse_20k.zip
...


2. AVS forum time-aligned, level matched, linear filtered comparison files:
Quote from: MLXXX on AVS Forum link=msg=0 date=
{Link to AVS post = http://www.avsforum.com/forum/91-audio-the...ml#post29132777 }
Amirm,
as you have indicated an ability to ABX test pairs provided by AVS for this thread, I wonder whether you would be good enough to try out the test pair below, On_The_Street_Where_You_Live_X2.flac and On_The_Street_Where_You_Live_Y2.flac, one of which is the first two minutes of a true 24/96 hi-res version as supplied by AVS Forum, and the other of which is the same file constricted to 16/44 and then resampled back to 24/96, using readily available software, the SoX utility.

I would be interested in:

  • Whether you feel you hear differences.
  • If so, whether you are able to establish that objectively using ABX software.
  • How pronounced the subjective differences are for your ears, and what character the differences have for your ears.


I note that the dither used was a slightly modified version of TPDF dither. It is not the rectangular dither used for the AES 137th Convention Paper, The audibility of typical digital audio filters in a high-fidelity playback system.

I note also that the files are time aligned and level-matched. This can be verified by inverting one, playing both together, using an editor such as Audacity, and hearing silence.

Quote from: MLXXX on AVS Forum link=msg=0 date=
{Link to AVS post = http://www.avsforum.com/forum/91-audio-the...ml#post29078954 }
In this post, I provide an updated version of level-matched, time-aligned, files for the first two minutes of On_The_Street_Where_You_Live.

If anyone does try comparing X2 and Y2, at a normal, moderate listening volume, and succeeds with an ABX test, I'd be interested in any subjective comments as to how pronounced they found the difference(s) to be for their hearing.

...

The new files have been encoded as flac and can be downloaded from these links:
On_The_Street_Where_You_Live_X2.flac
On_The_Street_Where_You_Live_Y2.flac


If anyone wishes to verify the test files they are free to download SoX  and then run the commands specified in the full wording of the above quoted post. (You may find it convenient to place the original 24/96 .wav file in the same directory as sox.exe and run the command prompt from that directory.)

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #509
Are you ever going to stop trying to shift the burden of proof? Again, it makes you look retarded and impossible to take seriously. Your deluded statements do not help your case either. You may even be partially right, but no one here is going to take you seriously the way you state your case. I am not an engineer so I do not understand the technical details, but I do not need to if one side of this never ending debate is clearly irrational. You lose by default. It's getting old.

Shift the burden of proof?  Proof has been provided.  Every DBT thrown at me I have taken and passed.


Which discredits the body of work. Nobody is perfect. Also the results could be confirmed to a higher degree with Foobar2000 R2, but very little such work has been provided. Even that which has been provided is incomplete - a complete set for a confirmable test includes the files that were compared.

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #510
And so a better test was developed which is the topic of this thread.


Except that neither the paper nor the proposed test are all that wonderful.

The paper is misnamed because in fact no actual "...Typical filters in a HiFi playback system..." were ever used. The Matlab simulations could have been reasonably exact, but several incorrect critical arameters were used.

Second naming issue is the fact that the paper purports to cover sample conversion from 24 bits to 16 bits but again there is debilitating asymmetry between the tests that were done and actual best practice. TPDF dither was not used. Spectrally shaped ditehr was not used. These technologies have been well known since the 1990s or earlier and one of the co-authors proudly designed and sold equipment featuring it. Note that typically the 24 -> conversion is not done in HiFi system by listeners at all, but is instead is done during production. So this part of the paper is completely off-topic as compared to its title, not to mention incorrectly performed to the point of incompetence if not malice. 

The paper falls on its face right out the door by erroneously defining all ABX tests as being the 1950 test that everybody ignored for over 20 years after its publication for evaluating audio gear, because it was so inappropriate insiesitive and hard to use. A far better test was described in the JAES in 1982 and is widely used (and illustrated in the Meyers and Moran paper that this paper criticizes), but the improved test was ignored because long experience has taught us that ignoring ABX1982 is an established tradition in golden-eared circles. Of course Amir, you repeated the same mistake in your own work on this forum so I guess we know who you align yourself with.

The paper attempts a review of previous work but ignores the most serious problem with its immediate predecessor Meyer and Moran, which is that Meyer and Moran made the mistake of taking the music industry at their word and presumed that every recording that was labelled high resolution actually was high resolution. Glossed over was the fact that 1/3 to 1/2 of the entire universe of recordings they chose from were actually low resolution recordings. The paper cites other work that is so bad (Kunchur) that reasonableness forced them to criticize the laughable Kunchur work's major failing, but they did not identify which paper they were criticizing.

The paper bases itself on a goodly number of theories that have never been reliably tested and are therefore controversial. We have the proverbial house of cards built on shifting sands. For example there is a claim that it is reasonable to train listeners using recordings that were downsampled using filters with excessively narrow transition bands. but there is reasonable criticism of this theory on the grounds that the artifacts are ultrasonic.  Examination of some of the program material that was used suggests that far poorer than best practices were used to produce it. For example it seems to contain passages with copious aliasing.

There appears to be no evidence that listener training involved anything but sighted evaluations, which probably partially explains the weak results.  What's wrong with training people do do blind listening tests by letting them practice with blind listening tests? I think that part of the problem was the awkward nature of the blind tests themselves and their execution which seems to be largely manual.

Did I mention weak results? People, we got weak results. There is a tradition that requires an audible situation to be detectable 70% of the time to be worthy of serious consideration, but this paper only obtained 56% reliable detection.  Even though a relatively large number of trials were run, only 95% confidence was achieved. The problem with this is that when there is 95% confidence we can expect about one chance in about 20 that the results were really due to random guessing. 17 different musical segments were tested, so the 1 in 20 chance may be a real possibility.

Furthermore the tests that form the core of the experimental data were also performed using filters with excessively narrow transition bands. If narrow transition bands are such a problem, why ruin your own work with them?  Obviously, best current practices were not tested.

The alleged better test itself is not well described and seems to be restrictive and desensitizing to the listener..  The segments of music were rigidly defined and are too long to allow listeners to home in on critical passages and exploit the fact that memory for small audible details pretty well evaporates after 2 seconds or less. Ironically ABX1982 has always allowed the listener this flexibility and more. Perhaps the authors are behind on their reading.  I don't see discussion of all relevant test parameters such as the listening room or critical details such as switch-over time.

There are many more points that should probably be criticized, but I don't want to beat an obviously dead horse. ;-)

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #511
Did I mention weak results? People, we got weak results. There is a tradition that requires an audible situation to be detectable 70% of the time to be worthy of serious consideration, but this paper only obtained 56% reliable detection.  Even though a relatively large number of trials were run, only 95% confidence was achieved. The problem with this is that when there is 95% confidence we can expect about one chance in about 20 that the results were really due to random guessing. 17 different musical segments were tested, so the 1 in 20 chance may be a real possibility.

I found the paper a bit hard to follow in its presentation of the results in that the analysis was mainly based on lumping together results from the different test segments ("sections") of the music, where some sections yielded what were described as "high yield" results. The paper states (on page 9):

We analysed the percent-correct scores for each of sections 1-17 across all conditions, and found that some sections yielded a higher ratio of correct results than others. For example, sections 2, 6 and 17 gave correct-to-total ratios of 0.714, 0.710, and 0.760 respectively, whereas sections 1, 7 and 10 gave correct-to-total ratios of 0.541, 0.455 and 0.509 respectively; this is a mean difference of about 23%. [emphasis in bold added]

I would have found it helpful if the results for condition 1 alone (the filtering for notional 44.1kHz sampling) had been provided on a section by section basis. The low pass processing for condition 1 used linear Finite Impulse Response filtering with a narrow transition band from 21591 to 22050 Hz.*  If some sections were apparently more "revealing" of the effect of the filtering, it would have been of interest to see what the results were for condition 1 itself,  without the co-mingling of the additional effects of reduction to 16 bits with no dither (condition 2) or with rectangular dither (condition 3).

Replicating the test files

Having said the above, I note that attempts are being made in another thread to review the frequency distribution of the source material. See 15 Haydn_ String Quartet In D, Op_ 76, No_ 5 - Finale - Presto 3 best, 3 best music segments 9174 audibiliity of typical digital filters.

Ideally at least some of the sections of the musical piece used for the paper would be available for download both in their reference form, and their filtered form, for HydrogenAudio members to listen to for themselves,** and to form their own opinions on the apparent extent of any audible difference, and its subjective character. Also, it should be possible for someone to verify that the particular Matlab settings do in fact yield the filtered forms used. I presume the so-called "peer review" would merely have been of the wording in the paper. I presume it would not have involved an audit inspection of the apparatus used to obtain the experimental data on which the paper was based.

_________

* Not from 23500 to 24000 Hz  as I misstated at my post #475 above.  That transition band was for the filtering for notional 48 kHz sampling, condition 4.   
** The files would be stereo 24/192 PCM.

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #512
Ah, so the premium cost of CD over MP3 is justified.  But past that, it is a sin.
The rules we invent.  It is like saying you can go from 3 to 4 bedroom house. But oh, more than that?  It is a sin.

There's some Amirlogic in there somewhere. Unfortunately, only you know where/what it is.
+/- 10% volume method ring a bell? 

Award winning peer-reviewed paper

Yes Amir, reviewed and awarded by 2 anonymous AES members. You and some other member with strong pecuniary interests in "Hi-Rez"?
Is that why the dither doctoring, zero system transparency data, possibility of loudspeaker and switching artifacts were all missed?
Stay tuned....

People have passed ABX DBT tests of high res vs CD's 16/44.

Yes, you and xnor have both showed passing gameable/cheatable online ABX tests is easy. But remember you have admitted to hearing no audible difference with these 16/44 ABX tests, just like xnor.
That your passing is due to other methods. Was it the +/- 10% volume method you invented many years ago for creating desired results?
I think anyone here who has slogged even the page I linked will, realize that you've had a long history of making claims about digital maladies and creating results of your unsupervised "blind" tests that are, umm, slightly unorthodox.
It came as no surprise to anyone here then, that you admitted to not hearing audible differences in the samples and were differentiating them by alternate means.

But we now say live witnesses are required.

For your method of obtaining differences in the files when you admit to not hearing audible differences, yes.
But please also remember, the AES BS paper is based on supervised, formal blind tests, not online cheatable/gameable ABX computer games. Your luminary, BS, appears to dismiss ABX as a valid method anyway, so you can't have it both ways. Claim the results of your non-audible difference ABX tests are valid, when the BS paper says they are not.

cheers,

AJ
Loudspeaker manufacturer

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #513
The paper is misnamed because in fact no actual "...Typical filters in a HiFi playback system..." were ever used.


Yes, I noted this a while back.

"Audibility of Atypical Digital Filters in a Hi-Fi Playback System"....


I probably should also have noted, a playback system with unknown switching, loudspeaker, etc, etc, transparency to the test.

It will be interesting if it's ever revealed who the 2 anonymous reviewers were. See if we know at least one. 

cheers,

AJ

Loudspeaker manufacturer

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #514
The paper is misnamed because in fact no actual "...Typical filters in a HiFi playback system..." were ever used.


Yes, I noted this a while back.

"Audibility of Atypical Digital Filters in a Hi-Fi Playback System"....


I probably should also have noted, a playback system with unknown switching, loudspeaker, etc, etc, transparency to the test.

It will be interesting if it's ever revealed who the 2 anonymous reviewers were. See if we know at least one. 



IME the names of the people on the AES review board are in selected issues of the Journal.  I've been reviewing the last 13 years worth of issue on my Kindle, and I know I've seen that list just lately. There are about 20 people on the list, several of whom I know personally. None were Amir.


Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #515
The paper is misnamed because in fact no actual "...Typical filters in a HiFi playback system..." were ever used.


Yes, I noted this a while back.

"Audibility of Atypical Digital Filters in a Hi-Fi Playback System"....


I probably should also have noted, a playback system with unknown switching, loudspeaker, etc, etc, transparency to the test.


I think we know what speakers were ($80k/pr Meridians) , and they are active speakers so that covers the amplifier part.  A Macbook's internal audio interface was the rest of the system.

What we don't know is what the room was like, listening distance, etc.  I'll bet the speakers were boresighted on the listeners ears.

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #516
I think we know what speakers were ($80k/pr Meridians) , and they are active speakers so that covers the amplifier part.  A Macbook's internal audio interface was the rest of the system.

Right, but my statement you quoted was that we don't know anything about the transparency of the setup to the test. I've raised possible issues with the loudspeakers, the recent online ABX fiascoes show that the switching software needs to be transparent (and non-cheatable of course) also.
There is zero evidence of any of that for this test.

What we don't know is what the room was like, listening distance, etc.  I'll bet the speakers were boresighted on the listeners ears.

Ye, I noticed that with amirs silence when I asked him if he could figure out what the speaker distance was based on the test description. The whole paper seems incredibly vague in many areas. Hopefully all will come to light at some point.

cheers,

AJ
Loudspeaker manufacturer

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #517
This is clearly a hopeless case.

Let me close the chapter "amirm" (all based on evidence found in this thread):
- stereotyping people, which he even admitted to
- keeps on making straw men and red herrings among countless other fallacies
- keeps shifting the burden of proof but doesn't even notice it
- sets up flawed arguments where he either wins or wins (that is all he seems to care about anyway)
- dares to speak about logic and science when he has demonstrated (dare I say it) willful ignorance
- thinks this is a war
- admitted to not hearing differences but still magically produces ABX logs
- rather posts multiple pages of nonsense than answering simple questions, one of which he finally explicitly evaded with a lame excuse
- poor reading comprehension (fun fact: I am from Australia according to him)
- even defends fallacies (!)
... and loads of other nonsense.

By now, and this is probably the worst, I think that most if not everyone here can see that "he has no interest in intellectual honesty or scientific rigor".


I take the paper for what it is. amir on the other hand blindly accepts whatever fits his agenda. amir, do you know that there are peer-reviewed papers for homeopathy, and actually quite a bit more than just 1 paper, but the scientific consensus is still: nonsense, quackery, a sham?
If you had any intellectual honesty, you would have to admit to believe in all kinds of nonsense based on some peer-reviewed papers.


This all boils down to: no credibility, no honesty, no interest in truth. I will simply link back to this post whenever it fits, and trust me, this will be every other post if he continues like that.
I am sorry that it came to that.
"I hear it when I see it."

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #518
Ye, I noticed that with amirs silence when I asked him if he could figure out what the speaker distance was based on the test description.

You did?  I don't read your posts all the time Ammar.  But this one is pretty easy to answer.  From the paper:

For a system gain of 75 dB, the loudest peak passage was measured as 102 dB SPL at the listening position, somewhat lower than the level we would expect from a live performance at a distance of 3 m.

So for us with the broken Imperial system, it was about 10 feet.

Quote
The whole paper seems incredibly vague in many areas. Hopefully all will come to light at some point.

To lay people, sure.  Remember, AES presentations are not for random person on some audio forum.  The audience is expected to be people not only in professional audio field, but with subject matter expertise.  Remember that AES puts a burden on length of the paper:

For the complete-manuscript peer-reviewed convention papers (category 1), authors are asked to submit papers of 4–10 pages to the
submission site. Papers exceeding 10 pages run the risk of rejection without review.


The current paper is 12 pages including its 35 references.

Compare this to 4 pages or so for Meyer and Moran where were note given the source frequency response, the system frequency response, the frequency response and crosstalk characteristics, frequency response of the restricted channel (i.e. 44.1 Khz), room description, etc., etc.

All of this said, sure, more detail is always better as it teaches us how these tests are conducted.
Amir
Retired Technology Insider
Founder, AudioScienceReview.com

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #519
Every DBT thrown at me I have taken and passed.

Amirm, I see you passed a comparison of non-linear filtering on this forum in the 20kHz brickwall filtering thread, and a particular comparison of non-aligned sources on another forum (AVS), in its "take 2" thread. I have not seen your attempt at ABXing linear filtering in the 20kHz brickwall thread, or time-aligned files in the AVS take 2 thread (my own samples X2 and Y2).

Given that your hearing is not as responsive to high frequencies as it used to be, it would be quite reasonable for you to decline. However if you wish to display a current prowess, then I would invite you specifically to try ABXing the linear 20kHz brickwall filter example on this forum,1 and the time-aligned, level aligned, linear filtered for 44.1kHz, On_The_Street_Where_You_Live examples X2 and Y2 on AVS Forum.2 If you try, and hear no differences, please advise.

Hi ML.  Good to see another familiar face here and a more reasonable one at that.

Turns out I did run one of the tests above.  The results were posted in this thread though not that one.  David was kind enough to link to it:

Another ABX report of these samples can be found here:
http://www.hydrogenaud.io/forums/index.php...st&p=880594


Here is the results once more:
----------

I gave it a try on the same clip MLXXX had done:

foo_abx 1.3.4 report
foobar2000 v1.3.5
2014/11/13 08:40:05

File A: C:\Users\Amir\Music\HA Forum Tests\limehouse\limehouse_maximum_phase_100.wav
File B: C:\Users\Amir\Music\HA Forum Tests\limehouse\limehouse_reference.wav

08:40:05 : Test started.
08:40:37 : 00/01  100.0%
08:42:19 : 00/02  100.0%
08:43:22 : 00/03  100.0%
08:44:21 : 01/04  93.8%  <--- Difference found.
08:45:14 : 02/05  81.3%
08:45:21 : 03/06  65.6%
08:45:34 : 04/07  50.0%
08:45:43 : 05/08  36.3%
08:45:52 : 06/09  25.4%
08:46:00 : 07/10  17.2%
08:46:10 : 08/11  11.3%
08:46:20 : 09/12  7.3%
08:46:29 : 10/13  4.6%
08:46:39 : 11/14  2.9%
08:46:51 : 12/15  1.8%
08:47:00 : 13/16  1.1%
08:47:10 : 14/17  0.6%
08:47:18 : 15/18  0.4%
08:47:26 : 16/19  0.2%
08:47:34 : 17/20  0.1%
08:47:42 : 18/21  0.1%
08:47:49 : 19/22  0.0%
08:47:55 : Test finished.

----------
Total: 19/22 (0.0%)



=========
I also re-ran it with the latest ABX plug-in with signatures:

2014-11-13 09:16:06

File A: limehouse_maximum_phase_100.wav
SHA1: 722dc26db8d4ce666dc03875b2c8d4570d22b521
File B: limehouse_reference.wav
SHA1: e8ad96830d23cad4bba5bf822ce875ae452b9e7c

Output:
DS : Primary Sound Driver

09:16:06 : Test started.
09:16:48 : 01/01
09:16:56 : 02/02
09:17:04 : 03/03
09:17:14 : 04/04
09:17:21 : 05/05
09:17:29 : 06/06
09:17:38 : 07/07
09:17:45 : 08/08
09:17:52 : 09/09
09:18:02 : 10/10
09:18:08 : 11/11
09:18:14 : 12/12
09:18:20 : 13/13
09:18:28 : 14/14
09:18:36 : 15/15
09:18:42 : 16/16
09:18:42 : Test finished.

----------
Total: 16/16
Probability that you were guessing: 0.0%




-- signature --
5b42b06c414b6ba77a3998695bf119a2d57663c0


===========

While I have you here, would you please represent if you cheated in any way in running the above test and getting positive outcome?  I am asking because I post the above but I am accused of cheating by xnor and Ammar.  More in the next post.
Amir
Retired Technology Insider
Founder, AudioScienceReview.com

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #520
2014-11-13 09:16:06

File A: limehouse_maximum_phase_100.wav
SHA1: 722dc26db8d4ce666dc03875b2c8d4570d22b521
File B: limehouse_reference.wav
SHA1: e8ad96830d23cad4bba5bf822ce875ae452b9e7c

Output:
DS : Primary Sound Driver

09:16:06 : Test started.
09:16:48 : 01/01
[... snip ...]
09:18:42 : 16/16
09:18:42 : Test finished.

----------
Total: 16/16
Probability that you were guessing: 0.0%


-- signature --
5b42b06c414b6ba77a3998695bf119a2d57663c0


===========

While I have you here, would you please represent if you cheated in any way in running the above test and getting positive outcome?  I am asking because I post the above but I am accused of cheating by xnor and Ammar.  More in the next post.

>>> 0 credibility <<<
"I hear it when I see it."

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #521
Arny, I agree, especially your comments about the filter parameters.

Luckily, even if the effects of pre-ringing at 21+ kHz were audible to some special people with special signals, you can simply re-filter with a less steep filter to reduce the pre-ringing at 21+ kHz.

edit: Depending on what you want you can easily reduce pre-ringing of Meridian's filter down to ~1/6th, better than the ringing in 48 kHz converters if you want. That is without using any imaging tricks.
"I hear it when I see it."

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #522
Ye, I noticed that with amirs silence when I asked him if he could figure out what the speaker distance was based on the test description.

You did?  I don't read your posts all the time Ammar.  But this one is pretty easy to answer.  From the paper:

For a system gain of 75 dB, the loudest peak passage was measured as 102 dB SPL at the listening position, somewhat lower than the level we would expect from a live performance at a distance of 3 m.

So for us with the broken Imperial system, it was about 10 feet.

Right. So were the test subjects sitting 10' from the speakers, or is 102db somewhat lower than the level we would experience with a listener sitting 10' from a "live performance", like an orchestral stage?
You are saying it's absolutely 10' from speakers Amir? No clarification needed? Cause that pushes things up to (ballpark) around 108db @ 1m from loudspeaker, which is awful close to their specified 112db absolute maximum.
I wonder what sort of non-linearties might appear when a DR 1" Beryllium metal dome is driven that hard with and without 22k band limiting? Might there be some down in the audible bandwidth <20k? When 1' DR domes typically start exhibiting as much as 3db compression at a mere 95db? Hmmm...
Let's see from the info provided by the paper:


Compare this to 4 pages or so for Meyer and Moran....

Nope, just another Red Herring by the lay person who is devoid of logic as lay people often are, thus cannot comprehend it has no relevance to the validity of the BS paper results. The BS paper/results/validity is all that matters here.

cheers,

AJ

Loudspeaker manufacturer

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #523
Given that your hearing is not as responsive to high frequencies as it used to be, it would be quite reasonable for you to decline. However if you wish to display a current prowess, then I would invite you specifically to try ABXing the linear 20kHz brickwall filter example on this forum,1 and the time-aligned, level aligned, linear filtered for 44.1kHz, On_The_Street_Where_You_Live examples X2 and Y2 on AVS Forum.2 If you try, and hear no differences, please advise.

I addressed your first request in my last post.  On running your set of converted AVS files, as you know, I did give them a try by downloading the 150 (?) megabyte package:

Quote
First, thanks so much for creating and uploading these files.  This is what I call constructive discussion .

Something is very puzzling or drastically wrong though if I am understanding you right.  I compared X and Y against each other in foobar.  I immediately heard a difference at the start of the tracks.  One has tons more noise added to it. You can hear it both before the music starts and during.  The noise levels are very high and not consistent with proper dither.

I pulled the files into Audition and played them with the same issue.  I zoomed into the start of the "Y" file and it indeed has noise that is elevated to -75 dbFS (~12 bits of signal to noise ratio).  The file shows the 22 Khz cut off so it is the Audacity converted one.  This is really, really broken if that is the conversion that Audacity performed.  Would you please verify your workflow and confirm what I am saying here?  Because if correct, it means Audacity signal processing is worse than junk.  And the generated noise will really screw up any "null" type tests as it will dwarf signal dependent differences.


Members here should notice that I did not provide any ABX results.  Would have been an easy win.  But not an ethical one.  So I didn't and instead let you know what was broken in the test.

As to running them again, I am sorry but I won't do it.  The mountain of ABX results I have provided has meant nothing to the objectors here.  This is tedious work and something I don't enjoy doing.  But let's ask other people to do it and post their results.

Amir
Retired Technology Insider
Founder, AudioScienceReview.com

Audibility of "typical" Digital Filters in a Hi-Fi Playback

Reply #524
Paraphrasing/summarizing the Stuart paper, a copy which I have, in my very layman way, the abstract could be rewritten as,

We have determined that it is possible to create a coin that comes up heads about 56% of the time with high reliability.