HydrogenAudio

CD-R and Audio Hardware => CD Hardware/Software => Topic started by: liekloo on 2002-11-20 15:51:15

Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-11-20 15:51:15
If you rely on C2 info when using EAC, using 'test&copy' is better than just 'copy'.

What if you don't use C2? EAC reads each sector twice and, as a result, has the oportunity to calculate CRC twice, and compare them.


Is that correct? and is the opportunity actually used? (that would mean test&copy is overkill if you disable C2)
Title: EAC T&C without C2. Overkill?
Post by: cmyden on 2002-11-20 16:05:17
What if you don't use C2? EAC reads each sector twice and, as a result, has the oportunity to calculate CRC twice, and compare them.


Is that correct? and is the opportunity actually used? (that would mean test&copy is overkill if you disable C2)


Yes, this is correct.  Providing that....

1) You are in secure mode, and your drive supports accurate stream. (most do)

2) You have the correct cache setting.  To be safe, leave the checkmark on beside 'this drive caches audio data'.    If you know for a fact your drive does *not* cache audio data you can take the checkmark off.

chris
Title: EAC T&C without C2. Overkill?
Post by: Annuka on 2002-11-20 16:25:30
EAC is not exact at all, if your CD-ROM drive is old or slightly broken.

My old Plextor 32TSi works fine for CD-ROMs, but makes a random error in 5% of the albums ripped at full speed. Reducing the speed to 4X reduced the errors to 1%. My new Plextor 40TSi has ripped hundreds of CDs at 17X CAV without any problems.

Using Test&Copy for the first 50-100 cds might not be a bad idea -- until you are convinced your drive works as it should.
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-11-20 17:16:34
Thanks for your replies 


To cMyden:

(Yes, I should have been more carefully, of course "secure mode" is needed.)

Cache setting should be set correctly anyway, and I do understand why it is needed (BTW is determining your drive's caching properties such a tricky thing?). But why the hell is accurate stream a must? (BTW my drive has accurate stream, but I am just curious)
Title: EAC T&C without C2. Overkill?
Post by: Pio2001 on 2002-11-20 20:48:17
Quote
If you rely on C2 info when using EAC, using 'test&copy' is better than just 'copy'.

What if you don't use C2? EAC reads each sector twice and, as a result, has the oportunity to calculate CRC twice, and compare them.

With C2 info, test and copy is better than copy.

Without C2, test and copy gives you the "cache" secureness.

But beware that CRC "OK" with test and copy is the equivalent of "no errors occured - 100% quality". It is not equivalent to "no errors occured - 99.9% quality", it is superior.

Last, test and copy in burst mode, as secure as secure mode due to the CRC checking, can also read error free some CDs that show a few errors in secure mode, because the groove is read in one pass, and no seeking has to be performed by the drive, that may introduce read errors (that should be detected) on bad CDs.
Title: EAC T&C without C2. Overkill?
Post by: spoon on 2002-11-20 22:46:47
If I can hijack this thread -

I am currently tackling the age old problem of getting 100% accurate rips from Audio CDs, I have called my implementation AccurateRip, I will keep my cards close to my chest at the moment as to the technical details, but I will go as far as to say when the system is fully operational it will be the first program in the world to guarantee 100% accurate rips, or tell you the rip was not accurate...I hope to beta within 2 weeks.

Beta Testing will take place in the Beta section of the forum on dBpowerAMP.com
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-11-21 14:56:20
Could anyone please explain why accurate stream is important too (apart from no caching).

The relation CRC - accurate stream isn't completely clear to me. 
Title: EAC T&C without C2. Overkill?
Post by: Case on 2002-11-21 16:15:43
Quote
Could anyone please explain why accurate stream is important too (apart from no caching).

Accurate stream means that drive will not produce jitter errors when extracting (unwanted clicks/pops), if drive doesn't support it EAC needs to sync sector boundaries and this is somewhat slower. Btw, I don't know of any no-name regular CD-ROM drive that supports it.
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-11-21 16:20:33
I am sorry, I apparently didn't put my question clearly enough

When I asked "Why is accurate stream important too, apart from caching", I meant relating to doing CRCs.

Thanks for answering though 
Title: EAC T&C without C2. Overkill?
Post by: Case on 2002-11-21 16:24:56
Quote
When I asked "Why is accurate stream important too, apart from caching", I meant relating to doing CRCs.

It has no effect in CRC calculations.
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-11-25 18:38:59
So, to conclude: in secure mode, with a properly configured cache setting, test&copy should be overkill, even with scratched CDs...
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-11-25 18:53:51
But what in this situation:

A scratched CD...
if our drive did 1000 reads on a sector,
lets say 20% of the reads give value '01111111' and 80% give value '11111111'.

Then it would be possible that
                    the first EAC read gives '01111111'
                    the second '01111111'
                    the third '11111111'
                    and the fourth '11111111'
but eac will stop after the second read and think to have found the correct value, whereas this is not sure (there is a chance of 80% that EAC has mistaken)

Is this one of the situations where even EAC fails? or does EAC have a way around?

In such a situation using Test&Copy would at least enforce an extra reread...
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-11-25 19:20:09
Of course, if sectors are big enough this is not a real issue...

(EAC's documentation doesn't mention how big a sector is, but it would definitely interest me  )
Title: EAC T&C without C2. Overkill?
Post by: Pio2001 on 2002-11-25 22:53:19
The "sectors" re-read by EAC are in fact 27 sectors, that is 15,876 samples, or a little more than 1/3 of a second.
When an error is found, only the erroneous part is reread in order to try to correct the error (no need to risk damaging the data that was fine).

Some discussions about secure ripping :

[EAC beaten??] CD-Freaks - Review - Plextor's PlexTools [comment requested ] (http://www.digital-inn.de/showthread.php?threadid=15197)

Error correction and interpolation in CD ROM drives : Discussion reliability DAEquality test (http://www.digital-inn.de/showthread.php?threadid=15838)

Is accurate C2 error reporting an Utopia? (http://www.digital-inn.de/showthread.php?threadid=15921)

Explanation of C2 support :  Drive options => 'capable C2 info' vs 'use C2 info' (http://www.digital-inn.de/showthread.php?threadid=15572)

Matching CRC for errored rips (http://www.digital-inn.de/showthread.php?threadid=16578)
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-11-26 14:12:32
Thank you very much, this is not too bad  B)

Hydrogenaudio has been beaten 


Anyway, I have the impression that Test&Copy isn't useless after all...

Getting twice the same erroneous info is very rare, but not impossible as SatCP has experienced several times.

In these few situations in which EAC gets twice exactly the same erroneous info, Test&Copy enforces a third read, and since a third same erroneous sector read will 'never' happen, Test&Copy 'eliminates' this kind of statistical hazards (getting twice the same erroneous info I mean)...

It seems that the argument C2 defenders    use, is that C2 info can track this kind of hazards (getting twice the same erroneous info I mean). But if I am not mistaken, Test&Copy will 'always' find it too. Or does someone have an extra argument supporting the claim that using C2 can sometimes give more accurate results?
Title: EAC T&C without C2. Overkill?
Post by: Volcano on 2002-11-26 21:42:27
Just my 0.02€:

Test & Copy without C2 is certainly not overkill in my experience. EAC most of the time reports a clean rip with a track quality of 99.9% on my NEC DV-5700B. I thought, if EAC reports no errors, the rip should be very accurate - but when I started using Test & Copy a week or so ago, I had to discover that the test/read CRCs often didn't match. On scratched CDs, I found it impossible to get matching CRCs with this drive - although there were no errors reported for each rip.

Without Test & Copy, I never would have noticed this, so IMHO it is definitely worth using if you don't mind the speed decrease.
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-11-27 08:38:33
If Volcano's EAC is correctly configured (caching), which is probably the case, and he didn't correct offset or so, this is indeed a problem:

Although CRC mismatches in secure mode happen only very rarely (so that you could say T&C is overkill, and btw CRC mismatches should not have audible effects),

this changes when inserting scratched CDs, as Volcano found. Why? A single scratch will cause an enormous amount of errors on the surface, drastically increasing the chance of what I called earlier "hazards" (getting twice the same erroneous info).
The question is: how drastical can the increase be?? My own CDs are all in good condition, and I never had a CRC mismatch, but I heard from several people that with scratched CDs T&C is more than just 'luxury' or 'overkill'.
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-11-27 08:43:16
Quote
I found it impossible to get matching CRCs with this drive - although there were no errors reported for each rip.


I am quite surprised to see someone (Volcano) having so many CRC mismatches (?)
Is it possible you ripped those scatched earlier in a non-secure mode (often done with badly-scratched CDs)?
BTW CRC mismatches should have no audible effects, that's why the EAC LOG doesn't consider them as 'errors'. Even if there are some CRC fails, the LOG will still say 'no errors occured'.

Thx for reply 
Title: EAC T&C without C2. Overkill?
Post by: user on 2002-11-27 09:16:40
" On scratched CDs, I found it impossible to get matching CRCs with this drive - although there were no errors reported for each rip.

Without Test & Copy, I never would have noticed this, so IMHO it is definitely worth using .. "





This is typical on scratched CDs, independent of used drive, or brand.
And T&C is not worth using it, if you are in secure mode, cashing "feature" correctly set, NO C2.

Volcano gives the point:
"I never would have noticed this"

Has somebody ever heard a bad tune in a song, when eac did not use t&c and reported no errors occurred ?!

It goes further on:

Even when eac reports: "There were errors", then you are often not able to detect a wrong tune at "Suspicious position".


The reason for all this is the physical condition of the CD's surface:
If the scratch reflects the light in other ways, then eac (and any other program) will even think, that these wrong data is the correct one, because the programs read again and again the SAME values (with or without t&C, with t&c you are only doubling the times of reading, that is not much, remember: eac itself reads up to  82 times (5 red lines), even in copy-only mode, without test).
Next reason:
The safety of reading twice (without test, NO c2) for error detection is high, it is not like 50% (would be very unsafe), as eac compares sectors, which contain a lot data, I think, the safety is around 1:10.000 or so ?
Title: EAC T&C without C2. Overkill?
Post by: Pio2001 on 2002-11-27 14:01:35
Quote
" On scratched CDs, I found it impossible to get matching CRCs with this drive - although there were no errors reported for each rip.


Liekloo is right. A minor scratch usually produce an enormous amount of errors. One of them is always detected. However, there are two cases in which CRC can mismatch without a bad rip reported :

1 - the scratch is light enough for all errors to be corrected in less than 80 rereads. Then EAC displays "no errors occured". But as thousands of errors were corrected, it is highly possible that one of them gave more than 8/16 times a wrong value, that was taken for right.

2 - A bad drive combined with a bad media. For example the Hitachi GD-7500, that always finds one or two errors on brand new CDs, reading a Memorex black CDR, will find tenths of isolated errors, all of them corrected in one row. With this combination, on most of the tracks, CRC mismatch while "no errors occured".

Quote
Has somebody ever heard a bad tune in a song, when eac did not use t&c and reported no errors occurred ?!


Yes, in Halcyon's test http://www.digital-inn.de/showthread.php?t...or&pagenumber=2 (http://www.digital-inn.de/showthread.php?threadid=9884&perpage=15&highlight=sony%20plextor&pagenumber=2)
12th message in the link above :

Sony CRX140E
C2: OFF (not available)
Accurate Stream: ON
Disable Audio cache: ON

Copy OK status (from EAC log):
track 3: OK

Track audible quality (listening test):
track 3: Two loud pops 6 seconds from the start of the track

CRC (from EAC test & copy):
track 3: B601AA2C <> EA0EA86C


Quote
If the scratch reflects the light in other ways, then eac (and any other program) will even think, that these wrong data is the correct one, because the programs read again and again the SAME values (...) The safety of reading twice (without test, NO c2) for error detection is high, it is not like 50% (would be very unsafe), as eac compares sectors, which contain a lot data, I think, the safety is around 1:10.000 or so ?


The safety of C2 is very high in theory. From BobHere's documentation http://www.digital-inn.de/showthread.php?t...15&pagenumber=5 (http://www.digital-inn.de/showthread.php?threadid=14600&perpage=15&pagenumber=5)

Quote
The much quoted figures for the 1st generation players (Philips CD100) with their much simpler CIRC implementations are:

sample interpolation rate:
one sample every 10 hours at 10exp-4 BER (Bite error rate)
1000 samples per minute at 10exp-3 BER.

Undetected error samples (clicks) less than 1 every 750 hours at BER 10exp-3, negligible at BER 10exp-4


Reading twice safety is impossible to evaluate. It must be between 1/8 (jitter errors - E32 chipset) and 1/1,099,511,627,776 (damaged CD, E52 chipset). (quoting myself). Explanations in the same link.
Title: EAC T&C without C2. Overkill?
Post by: Pio2001 on 2002-11-27 14:10:16
By the way, this thread is interesting : (http://www.digital-inn.de/showthread.php?t...?threadid=14600 (http://www.digital-inn.de/showthread.php?threadid=14600) above)

Safety of reading twice, caching, and C2 were deeply discussed. Unfortunately we were very long to reach a result about C2. It was this discussion that started the DAE quality analysis project ( http://www.exactaudiocopy.de/eac13.html (http://www.exactaudiocopy.de/eac13.html) ).
Since we only have a theoretical value of the C2accuracy, I've been trying for two monthes to get experimental results. Work still in progress. I'm writing another analysis program.
Title: EAC T&C without C2. Overkill?
Post by: Pio2001 on 2002-11-27 14:48:27
I forgot : http://www.digital-inn.de/showthread.php?t...15&pagenumber=4 (http://www.digital-inn.de/showthread.php?threadid=16260&perpage=15&pagenumber=4) , post number 6 in this page, reports the Sony crx220e1 and Asus crw5224 to have perfect 100% accurate C2 reporting.
Title: EAC T&C without C2. Overkill?
Post by: user on 2002-11-27 14:56:48
For all these reasons and uncertainty, checking in eac capabilty of c2 is not recommended, if your drive should be able to.
Let's see your test results !


hmm, Halcyons test, was carried out with a special test-CD, with black stripes on it ?

Is this very realistic, or was that Sony drive so bad ?

Anyways, many thanks for reminding these test of halcyon, I remember having read it.


I have never denied the addition of safety, if you do t&c, but the question is, how much worth is this extra safety (hmm, you are just reading 2 times again by t&c, but eac has had the chance to read it 82 times in the first (or only) run..) ?
(btw, I am always talking of settings NO c2 in secure mode, c2 is not matter of interest for 'users', until there would be new results... (and they would be dependent to brand of drive etc.))

The question is:

How big is the probability, that eac reads twice (no c2, secure) and thinks: no error, all is well, but it has read twice the same wrong value for that damaged sector.

This probabilty depends on size of sector.

Is there an answer ?

(I know, the theoretical safety of c2 error detection is in theory higher than that reading twice method....)
Title: EAC T&C without C2. Overkill?
Post by: Volcano on 2002-11-27 15:51:06
user:

Quote
Quote
On scratched CDs, I found it impossible to get matching CRCs with this drive - although there were no errors reported for each rip.

Without Test & Copy, I never would have noticed this, so IMHO it is definitely worth using ..


This is typical on scratched CDs, independent of used drive, or brand.


But even with my crappy Acer CD writer I could get matching CRCs on all tracks on one of the scratched CDs. Had that not been the case, I probably wouldn't have worried and would have thought, just like you, that CRC mismatches are perfectly normal for scratched CDs.

There might be an explanation for this - the Acer reported 100% on nearly all tracks, in other words, EAC's error correction never kicked in. On the NEC however, error correction was performed far more often, which leaves more room for minor differences between the reads which aren't audible, but still exist (which a CRC check will, of course, pick up). (I guess that's what you meant with your first point, Pio2001...?)

Anyway, I'm still a little worried about the results of the NEC with Test & Copy.
Title: EAC T&C without C2. Overkill?
Post by: user on 2002-11-27 16:07:53
" But even with my crappy Acer CD writer I could get matching CRCs on all tracks on one of the scratched CDs. Had that not been the case, I probably wouldn't have worried and would have thought, just like you, that CRC mismatches are perfectly normal for scratched CDs. "


Oh, that shows, how uncertain even T&C is.

My opinion, is still:

T&C in secure mode, no c2, does not increase safety by a reasonable amount ?

Unfortunately, if the surface is damaged, the original data is changed.
A Polishing may help in this case.
Title: EAC T&C without C2. Overkill?
Post by: Pio2001 on 2002-11-27 21:28:20
Quote
hmm, Halcyons test, was carried out with a special test-CD, with black stripes on it ?

Is this very realistic, or was that Sony drive so bad ?


I think it is realistic. A deep big scratch parallel to the groove should have quite the same effect.

Quote
you are just reading 2 times again by t&c, but eac has had the chance to read it 82 times in the first (or only) run..)


Yes, but, as discussed in http://www.digital-inn.de/showthread.php?t...?threadid=14600 (http://www.digital-inn.de/showthread.php?threadid=14600) , you might have caching issues reading 82 times. Some drives are reported to cache by Feurio and not by EAC, some by EAC and not by Feurio.
With test and copy, you eliminate any caching issue.

Quote
How big is the probability, that eac reads twice (no c2, secure) and thinks: no error, all is well, but it has read twice the same wrong value for that damaged sector.


Quoting the same link :

Quote
First, let's assume that the chipset can't correct E32 errors, and that the errors come from unreadable parts of the CD.
Therefore errors will be in frames with at least 3 wrong bytes. If they are random, the probability that the detection will fail is
1/256^3=1/16,777,216
It is the probability that the two readings are wrong (three wrong bytes) and identical.
Being 7350 frames per second, if all frames are wrong, there would be about two undetected errors per CD.

But this can vary very much.
1 - recent chipsets must have five wrong bytes per frame in order to generate wrong data : that would lead to one undetected error once every 32,000 CDs.
2 - errors should be random if the CD is completely unreadable, but for the other bytes to be OK, the damage must not be total. So there should be some parts slightly damaged, and these are likely to cause some problems since there can be just jitter errors in some EFM data.
I don't have the EFM table in text format, so I can't check if the possibility to misplace one transition can lead to an error as small as one modified bit in the decoded 8-bits symbol. If I had setup the EFM table myself, I would have tried to do so, in order to get LSB errors if possible in the case of jitter errors.
If it is indeed the case, we can imagine three unstable bytes leading to 1 wrong bit in each.
In this case, these bits being random, there would be one chance out of 8 to get twice the same wrong data.

So the theoretical efficiency is between 1/8 (jitter errors - E32 chipset) and 1/1,099,511,627,776 (damaged CD, E52 chipset).
That's quite an uncertainty isn't it  ?


Quote
which leaves more room for minor differences between the reads which aren't audible, but still exist


Why wouldn't they be audible ?
Isolated errors are often not audible, because the drive interpolates the previous and next sample, which performs a very good click removal, but Halcyon example showed that this was not always the case (it must have been a multisample error, or a drive that doesn't interpolate).

Quote
Unfortunately, if the surface is damaged, the original data is changed.


Yes and no.
It is quite impossible to change valid data into another valid ones by damaging the surface, because of all the CIRC encoding. However, if the error is perfectly localized on some given samples (it is a very uncommon phenomenon), as the drive interpolates, it will return twice the same interpolation because the valid samples have not changed.
The fact that errors can't affect the same samples every time is the key of error detection by reading twice. Any error will always return the same data (provided it doesn't affect contigous samples, which is ensured by the CIRC for light to medium errors), but errors will nearly never affect the same samples twice.

Quote
I'm still a little worried about the results of the NEC with Test & Copy


Try enable the cache option and/or non accurate stream. It already fixed some CRC issues on some drive that are detected as accurate and not caching.
(Memorex DVDMaxx1648, and Teac E540, or maybe Sony DDU1621, I don't remember. It was very hard to get mismatching CRC on "copies OK" anyway).
Title: EAC T&C without C2. Overkill?
Post by: Volcano on 2002-11-28 15:23:25
Pio2001:

Quote
Quote
which leaves more room for minor differences between the reads which aren't audible, but still exist

Why wouldn't they be audible ?


I was just guessing that if EAC's error correction kicks in, two reads may perhaps result in a difference of only a few samples (because an error isn't corrected in exactly the same way each time) - which wouldn't have to be audible at all, but still, a CRC check will pick up the difference.

My question is, is that theory right, or am I way off?

I'll try your suggestions though, and report back.
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-11-28 16:18:58
[Q]QUOTE VOLCANO: My question is, is that theory right, or am I way off? [/Q]

Because the difference is generally so tiny, CRC mismatches are very likely to be inaudible errors (not always, as Pio showed).

Now, why are they so tiny in general?

The reason for this is statistics (not, as you think, varying error correction).
It is rather by accident that 2 reads over a scratch can give identical results. Normally errors on the CD will give different read results every time they are read.
The bigger the error, the less likely it is that the 2 reads will give identical results by accident...
A CRC mismatch means that a third read reveals the previous 2 reads were identical, and therefore accepted by EAC... but by accepting them EAC failed, as the CRC mismatch proves!
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-11-30 11:18:31
In fact Pio2001 already answered the question:

Interpolation will change isolated errors in most cases, so that they become unhearable anyway.
Title: EAC T&C without C2. Overkill?
Post by: spoon on 2002-11-30 21:47:01
Here is what I have found on ripping audio CDs -

Discs with scratches can return constant errors no matter what speed is used,
Ripping the same disc with a different make of drive will highlight the error,
Applying a CD restore liquid helps alot.
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-12-04 08:33:10
T&C should also help to verify whether your drive really supports accurate stream right? (although a modern drive is very likely to)



Then a few more difficult issues...
***About caching, let's say we want to be sure our drive does not cache, so we turn it off and start ripping (T&C). How many CDs should be ripped that way to be sure...? (I know this is a tricky question  )

***Secure reading with T&C is not likely to find CRC mismatches on disks in perfect condition, but if the disk is (slightly) damaged the chance on CRC mismatches increases significantly. As pointed out before, this must be a theoretical chance somewhere between 1/8 - 1/100000000000... (per disk), which means: we cannot draw a conclusion, it's just worth further research.

Hence my qestion: Personal Experiences??? Quite some folks will use T&C if the disk has scratches, just 'to be sure'. So, what's your experience?
(note: one can only draw conclusions in case of a considerable amount of those rips)
Title: EAC T&C without C2. Overkill?
Post by: Pio2001 on 2002-12-04 11:39:17
Quote
***About caching, let's say we want to be sure our drive does not cache, so we turn it off and start ripping (T&C). How many CDs should be ripped that way to be sure...? (I know this is a tricky question  ;) )

One CD with many correctable errors is enough. Note that a CD with only correctable errors is something difficult to find.

Quote
between 1/8 - 1/100000000000... (per disk)


I was wrong, the parity bytes can be corrupted too, leaving only one wrong audio bit beside the two to four wrong parity bytes.
So it's not 1/8 but 1/2.

Quote
Hence my qestion: Personal Experiences??? Quite some folks will use T&C if the disk has scratches, just 'to be sure'. So, what's your experience?
(note: one can only draw conclusions in case of a considerable amount of those rips)


I usually rip CDRs with problems. All CDRs I burned two years ago and more are turning unreadable.
With such CDs, C2 on, no errors occured and CRC mismatch is common. In fact, if a track is short enough to fit entierely in the zone where errors are still correctable, I get no errors and wrong CRC all the time.
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2002-12-05 09:12:30
Quote
So it's not 1/8 but 1/2.


Then it's even better! 

(BTW My personal experiences aren't really useful here - most of my disks are in a too good condition, to get useful results.)

Of course scratching them would give me the opportunity to do a lot of testing... 
but I don't think I'll do that 
Title: EAC T&C without C2. Overkill?
Post by: liekloo on 2003-04-23 20:49:38
Tests have been done meanwhile, and a conclusion is posted here (http://www.hydrogenaudio.org/forums/index.php?act=ST&f=20&t=8575&st=0#entry85941).