Skip to main content

Topic: Quantization Grid (Read 18867 times) previous topic - next topic

0 Members and 1 Guest are viewing this topic.
  • KMD
  • [*][*][*]
Quantization Grid
I have thought that this phenomana may be real for years . I call it the "quantiztion grid". An  analog waveform can change direction or cross the zero line at an infinite number of locations. Sampling and Quantization create a grid to which features of  the waveform are  statistically constrained.  Increasing the sample rate at a fixed bandwidth inreases the quantization grid density. Whether it is perceivable is what is in question.  This experiment may have proved it. I will give some thought to a simillar experiment that forum members can do for themselves  and start a new topic on it.

Quantization Grid
Reply #1
There's no "quantization grid", it's a myth. PCM can and will reproduce audio with sub-sample delay, assuming the signal is band-limited to your sample rate.

Dead horse flogging alert: http://www.stevehoffman.tv/forums/showthread.php?t=85436
http://www.hydrogenaudio.org/forums/index....49043&st=25

Before you ask, it is trivial to band-limit the signal, either using right analog microphones or with a brickwall filter.
  • Last Edit: 10 March, 2012, 11:32:59 AM by AstralStorm
ruxvilti'a

  • KMD
  • [*][*][*]
Quantization Grid
Reply #2
The quantization grid is not caused by sampling it is caused by the interaction of quantization levels  with  sampling points. It may not be perceptable but there is no doubt that a waveform created from  a digital  file must be formed from a selection of points that are selected from a finite number of pre- determined regularly spaced co-ordinates. The digital file is formed from regularly spaced sampling points and reguarly spaced quantization levels therefore the waveform derived from it must have a coresponding regularity.
  • Last Edit: 10 March, 2012, 03:37:55 PM by KMD

  • lvqcl
  • [*][*][*][*][*]
  • Developer
Quantization Grid
Reply #3
The digital file is formed from regularly spaced sampling points

This means that the reconstructed signal doesn't have frequencies >=  Fs/2.

and reguarly spaced quantization levels.

This adds constant white noise to the signal (simplest case: TPDF dither, no noise shaping).


IOW: there is no interaction between sampling and quantisation if the signal is properly dithered.
  • Last Edit: 10 March, 2012, 04:17:42 PM by lvqcl

  • KMD
  • [*][*][*]
Quantization Grid
Reply #4
The output of the D to A is derived from a regularly spaced set of coordinates so it therefore has that reqularity.

  • Speedskater
  • [*][*][*]
Quantization Grid
Reply #5
About a year or so ago, j.j. wrote:

In fact, we can resolve, at 20kHz, for a "Redbook CD", a time resolution proportional to, and very near  1/(2*pi*20000*216) in a mechanical fashion.

That is a very, very large number of time points per second.
It's about 27143360.
  • Last Edit: 10 March, 2012, 04:18:14 PM by Speedskater
Kevin Graf :: aka Speedskater

  • lvqcl
  • [*][*][*][*][*]
  • Developer
Quantization Grid
Reply #6
The output of the D to A is derived from a regularly spaced set of coordinates so it therefore has that reqularity.


Here is the graph of the CD noise floor with a standard TPDF dither:

  • KMD
  • [*][*][*]
Quantization Grid
Reply #7
Just for clarify when I say co-ordinate I mean x and y. The cordinates would be more than just 2^16 *44100 per second. I'm thinking twice that or more. Any Idea how  jj got that figure.
  • Last Edit: 10 March, 2012, 04:31:33 PM by KMD

  • KMD
  • [*][*][*]
Quantization Grid
Reply #8
ivqci - I am talking about regularity in the shape of the waveform

  • lvqcl
  • [*][*][*][*][*]
  • Developer
Quantization Grid
Reply #9
But we cannot hear the shape.

  • KMD
  • [*][*][*]
Quantization Grid
Reply #10
lvqcl-  But whatever we  do hear must be derived from the regularised data set wouuld you concur

  • googlebot
  • [*][*][*][*][*]
Quantization Grid
Reply #11
lvqcl-  But whatever we  do hear must be derived from the regularised data set wouuld you concur


This regularity is effectively removed by dithering.

  • NullC
  • [*][*][*]
  • Developer
Quantization Grid
Reply #12
This regularity is effectively removed by dithering.


Not just "wave your arms"/good enough "effectively".  But it's removed  completely and replaced with your-choice-shaped additive noise by proper dithering&noise shaping.

Like the sampling theorem itself this isn't particular intuitive though it becomes clear if you actually step through the mathematics.  The first couple of sections of this thesis explain it pretty well.

  • KMD
  • [*][*][*]
Quantization Grid
Reply #13
The movement of the quantization levels by dithering averages to zero over a number of points. Statistically the dithered quantization levels still fall on the original quantization points plus a deviation ether side with the statistical distribution  shape determined by the noise used. I think it would be useful to be able to statistically analyse the shape of a piece of audio to asertain what process recorded it.
  • Last Edit: 12 March, 2012, 11:07:49 AM by KMD

  • 2Bdecided
  • [*][*][*][*][*]
  • Developer
Quantization Grid
Reply #14
ivqci - I am talking about regularity in the shape of the waveform
Yes, and what you say is true - easily visible in the waveform, and sometimes visible on a scope (depends on the DAC).

However, there's no mechanism in the ear to pick out that regularity. Once you do any kind of filtering (and the ear contains a continuum of bandpass filters), it disappears. You're just left with what looks like random noise.


Also, the error signal (original minus quantised = dither + quantisation error) contains remnants of the original signal. The classic Lipschitz and Vanderkooy dither paper from 1984 (I think!) showed graphs of error signals for various orders of dither. rectangular = first order, triangular = second order. More orders add more noise, but make the error even less correlated with the original. As the ear seems insensitive to higher orders of correlation, there's no need to go further.

This is all ignoring the real noise and signal levels in most recordings which make this (and even dither itself) academic.

Cheers,
David.

  • KMD
  • [*][*][*]
Quantization Grid
Reply #15
when you say can be seen on a scope I guess you mean before the reconstruction filter.  If so the reconstruction filter forms a waveform from a  product of those samples and quantization points  and  so there is literally trillions of points in just a second to define the smoothed  output
  • Last Edit: 12 March, 2012, 12:29:00 PM by KMD

  • 2Bdecided
  • [*][*][*][*][*]
  • Developer
Quantization Grid
Reply #16
when you say can be seen on a scope I guess you mean before the reconstruction filter.  If so the reconstruction filter forms a waveform from a  product of those samples and quantization points  and  so there is literally trillions of points in just a second to define the smoothed  output
No, with the right test waveform the effect can be quite visible after the reconstruction filter. Mathematically you'll get different values after the oversampling/reconstruction filter, but visually you can see remnants of the original quantisation steps.

Cheers,
David.

  • KMD
  • [*][*][*]
Quantization Grid
Reply #17
Thanks for the discussion.

My conclusion on this is. - There is no quantization grid. And no regimentation effect in amplitude due to quantization when dither is used.
As dither scans the input up and down over the quantization steps, it makes quantization benign like sampling. In fact the word Quantization is innapropriate for the finished process as the resulting waveform is not a quantized waveform!  It has infinite resolution because the dither noise fills the space between quantization steps, so there is no room for anything to go undetected. This is another reason why dither is important.

Cheers

Owen.
  • Last Edit: 19 March, 2012, 06:46:31 AM by KMD

Quantization Grid
Reply #18
Thanks for the discussion.

My conclusion on this is. - There is no quantization grid. And no regimentation effect in amplitude due to quantization when dither is used.
As dither scans the input up and down over the quantization steps, it makes quantization benign like sampling. In fact the word Quantization is innapropriate for the finished process as the resulting waveform is not a quantized waveform!  It has infinite resolution because the dither noise fills the space between quantization steps, so there is no room for anything to go undetected. This is another reason why dither is important.


I question that *any* real world process whether analog or digital, has infinite resolution.  A process with infinite resolution would output a signal that is exactly the input signal. The error that would be calculated by subtracting the input and output signals would always be exactly zero.

In a proper digital process with randomized quantization, the resolution is not infinite and the timing and level errors inherent in quantization are randomized by dither. There are no other errors unless they are intentionally introduced.

In an analog process the resolution of storage, processing and transmission is also not infinite. There is practically speaking no such thing as infinite resolution in the analog domain. The timing and level errors inherent in real world analog audio are produced by natural effects such as thermal noise other noise, as well as transmission and processing losses (or gains). These noises and errors come from many sources. Even reasonably short transmission lines and their line drivers and receivers cause errors. All known forms of analog signal storage introduce relatively massive errors.


Every resistor, capacitor, transducer, transformer, inductor and active or passive device in the analog domain adds noise and amplitude and timing errors unless it is perfect and is operating at absolute zero
. That pretty well excludes everything in every real world audio experiment from the realm of things with infinite resolution.

So, you are comparing errors and non-infinite bandpass and resolution in the analog domain with errors and non-infinite bandpass and resolution in the digital domain.

Nothing in the real world is perfect or perfectible or even close to perfect except relatively abstract things like digital data storage and transmission.

At this time the only things that are even close to be being perfect at performing audio tasks in the analog domain are relatively short transmission lines, a small but enlarging group of operational amplifiers, and digital<-> analog converters. At this time it appears that what drives the development of low noise, low distortion operational amplifiers is the development of digital<-> analog converters.

It has been found by many experimenters and observers that relatively inexpensive digital recorders and players can be free of audible flaws in normal use. This was never achieved and is probably unachievable with purely analog devices.

  • KMD
  • [*][*][*]
Quantization Grid
Reply #19
Hello Arnold


Signal to noise ratio, and resolution, are not the same thing.




Owen.
  • Last Edit: 19 March, 2012, 09:49:13 AM by KMD

  • icstm
  • [*][*][*]
Quantization Grid
Reply #20
Is Arnold not saying that the output signal might replicate the input information perfectly, but will also introduce noise. So actually the output signal is not the same as the input even if all the orginial information is there.

Quote
A process with infinite resolution would output a signal that is exactly the input signal. The error that would be calculated by subtracting the input and output signals would always be exactly zero.
this I agree with

  • KMD
  • [*][*][*]
Quantization Grid
Reply #21
Hi icstm

An analogue recording system has infinite resolution but not infinite signal to noise ratio

A dithered digital recording system has infinite resolution but not infinite signal to noise ratio


Owen.

  • 2Bdecided
  • [*][*][*][*][*]
  • Developer
Quantization Grid
Reply #22
Until you define the meaning of the term "resolution", such statements are meaningless.

If they include the word "infinite", they're probably wrong, too.

Cheers,
David.

  • KMD
  • [*][*][*]
Quantization Grid
Reply #23
Resolution is the smallest detail a system can record. In an undithered digital system that is a detail with height greater than one quantisation step. In a dithered system it is infinitely small.
  • Last Edit: 19 March, 2012, 10:29:54 AM by KMD

  • 2Bdecided
  • [*][*][*][*][*]
  • Developer
Quantization Grid
Reply #24
Resolution is the smallest detail a system can record. In an undithered digital system that is a detail with height greater than one quantisation step. In a dithered system it is infinitely small.
It's only infinitely small if it persists for infinitely long, the system is DC coupled, and I'm allowed to average the result over an infinite number of samples.

Try again

Cheers,
David.