Skip to main content

Topic: Help. How to evaluate a Mp3's quality? Like noise existed in the f (Read 8473 times) previous topic - next topic

0 Members and 1 Guest are viewing this topic.
  • MaiTiano
  • [*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
As mentioned in the title.

Now I am evolving into a project. In this project, we have a 128kbps mp3 library and we need to find which files have the inferior quality, such as noise existed, volume is too small etc.

Any advice?  It would be better if someone know some open-source project which already has the ability to detect the mp3 files with bad quality.

many thanks.

  • halb27
  • [*][*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #1
Sounds like you don't have a reference to the original uncompressed music.
If this is true the only thing that can be achieved IMO is looking for issues like temporal smearing with percussion instruments or impulses for electronic music, or other things like unusual tremolo or other effects. But without reference to the original it's often hard to say whether suspected issues are due to mp3 compression or due to an imperfect recording for instance.
lame3995n -Q0.5

  • Nessuno
  • [*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #2
Now I am evolving into a project. In this project, we have a 128kbps mp3 library and we need to find which files have the inferior quality, such as noise existed, volume is too small etc.


Do you intend lower quality with reference to the lossless source (which, as halb27 already pointed out, is very difficult without the reference), or absolute sound quality in this set, with reference to parameters like, for example, dynamic range, bandwidth, noise etc..., in which case the fact that they are mp3 has less importance?
... I live by long distance.

  • MaiTiano
  • [*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #3
Sounds like you don't have a reference to the original uncompressed music.
If this is true the only thing that can be achieved IMO is looking for issues like temporal smearing with percussion instruments or impulses for electronic music, or other things like unusual tremolo or other effects. But without reference to the original it's often hard to say whether suspected issues are due to mp3 compression or due to an imperfect recording for instance.



Yep, I do not have the reference to the original lossless music.

My goal is to tell whether a mp3 file has a good quality or not just depends on its file only. No matter the bad quality is caused by mp3 compression or imperfect recording, I just need to tell people that it has good quality or not.

  • saratoga
  • [*][*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #4
Determining which will sound better to a person is a subjective process, and no one that can be readily done by a machine.
  • Last Edit: 17 April, 2012, 10:20:33 AM by db1989

  • .alexander.
  • [*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #5
Robot will never replace man © Ogre

  • Nessuno
  • [*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #6
Determining which will sound better to a person is a subjective process, and no one that can be readily done by a machine.


So what the "quality" setting of every lossy encoder does actually mean?
  • Last Edit: 17 April, 2012, 02:44:22 AM by Nessuno
... I live by long distance.

  • MaiTiano
  • [*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #7
Yes,I do think that there is a evaluation rule for the music quality. not only the bitrates can be used to evaluate it(actually bitrates can not be viewed as the accurate quality rule neither:) )
  • Last Edit: 17 April, 2012, 10:21:00 AM by db1989

  • Nessuno
  • [*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #8
Yes?I do think that there is a evaluation rule for the music quality. not only the bitrates can be used to evaluate it(actually bitrates can not be viewed as the accurate quality rule neither:) )


Well, if they are VBR and they have been encoded by the same encoder with the same settings and they all contain similar musical "patterns" (e.g. all symphonic, all piano, all chamber) then actual bitrate might be a very rough estimate of content quality.

Of course "quality" sic et simpliciter is really a very vague criterion....
... I live by long distance.

  • MaiTiano
  • [*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #9
For the simplicity, for the 1st step, at least I want to detect the noise existed in the music which affect the whole listening experience. Any advices?
  • Last Edit: 17 April, 2012, 10:21:12 AM by db1989

  • pdq
  • [*][*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #10
Determining which will sound better to a person is a subjective process, and no one that can be readily done by a machine.


So what the "quality" setting of every lossy encoder does actually mean?

In this case quality has a very specific meaning - how close the audible result is to the original.

  • IgorC
  • [*][*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #11
Starting from previous  knowledge will be something reasonable to do.   
PEAQ.
  • Last Edit: 17 April, 2012, 09:28:47 AM by IgorC

  • Nessuno
  • [*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #12

So what the "quality" setting of every lossy encoder does actually mean?

In this case quality has a very specific meaning - how close the audible result is to the original.


Ok, I'm no expert, but it seems to me that "close to the original" it's not just a matter of analitically measuring the distance between two signals: some assumption of what has more impact in the perceived quality of output are also made, like a larger lowpass on input on higher quality settings (so bandwidth is considered a quality index), clipping prevention (so clipping is considered a low quality index), preserve dynamic, apply weaker masking at certain frequencies and so on...

And in general, to develop a perceptual model, some assumption on which signal characteristics have more influence on its perceived quality should be made, shouldn't they?
  • Last Edit: 17 April, 2012, 12:40:23 PM by Nessuno
... I live by long distance.

  • saratoga
  • [*][*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #13
And in general, to develop a perceptual model, some assumption on which signal characteristics have more influence on its perceived quality should be made, shouldn't they?


Correct.

  • Dynamic
  • [*][*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #14
Any advice?  It would be better if someone know some open-source project which already has the ability to detect the mp3 files with bad quality.


If I wanted a quick-and-dirty survey of quality of MP3 supplied as is, such as a bunch of free releases I had ten years ago, I'd use encSpot (a Windows program that was released freely as encSpot Pro, though I think the source was never opened).

Certain old, bad, encoders such as Xing or Blade can be detected pretty reliably, and will cause the traffic-light indication in encSpot to show red. Other than that, it won't detect the majority of unwise encoder settings.

Newer encoders are a lot better if used wisely. I still hear segments of podcasts with dreadful encoding - usually low bitrate with an excessively high low-pass.

As for the rest, it seems really tough.

Dynamic – the artist formerly known as DickD

  • knutinh
  • [*][*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #15
For the simplicity, for the 1st step, at least I want to detect the noise existed in the music which affect the whole listening experience. Any advices?

I would claim that I have several recordings with excessive noise that are still subjectively important to me - and examples of low-noise material that is worthless to me.

Sounds to me like trying to detect "good art" automatically. It is going to be hard as long as we dont even have an agreement on what is "good art".

-h

  • MaiTiano
  • [*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #16
I would like to add a more specific example to illustrate what I want to do here. 

For example, in the following figure, as the red square pointed, in these area the dB data is not 0 but with a approximate fixed value.  Therefore,  the music in those red rectangle has bad quality just like 'click' or some other very short pause.  These breakpoints make the music sounds very bad, like segmented piece by piece. 



Let me zoom in and give you a even clear view of those rectangle 'breakpoint'.(Also, as shown in the red rectangle area)


  • Dynamic
  • [*][*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #17
You've defined your problem a bit better.

You might want to look into SoX audio toolkit. It can be run from the commandline or a batch script, making it possible to deal with a whole bunch of files. It's also open source, like Audacity, which you used to plot that waveform.

It has switches to detect silences, which you could modify to make it detect or split that file:
http://sox.sourceforge.net/sox.html
... scroll down to the silence section.

You could either modify the source code to do what you want, or run Sox to decode an appropriate file and see if it produces more than one silence

Your use case is not normal, as few people who care about quality will have such bad files because they'll have chosen secure or database-verified ripping or listened to the output with their ears.

I'm sure you'll need to do some coding yourself.
Dynamic – the artist formerly known as DickD

  • MaiTiano
  • [*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #18
You might want to look into SoX audio toolkit. It can be run from the commandline or a batch script, making it possible to deal with a whole bunch of files. It's also open source, like Audacity, which you used to plot that waveform.

It has switches to detect silences, which you could modify to make it detect or split that file:
http://sox.sourceforge.net/sox.html
... scroll down to the silence section.

Many thanks, Dynamic.
I have a problem about your advice. As can be seen from the figure, actually, those horizontal wave which I highlighted in the red box is not on the 0 dB line. In other words, the sound track may not be silence in these area, right?

  • saratoga
  • [*][*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #19
I have a problem about your advice. As can be seen from the figure, actually, those horizontal wave which I highlighted in the red box is not on the 0 dB line. In other words, the sound track may not be silence in these area, right?


Since you can't hear a DC level, that is still silence.

  • MaiTiano
  • [*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #20
Since you can't hear a DC level, that is still silence.


Thanks. Actually, I think it is approximate DC 

  • Dynamic
  • [*][*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #21
I'd assumed, perhaps wrongly, that you were displaying Waveform (dB) rather than linear, in which case those were probably only a fraction offset from zero, and setting silence detection to -80 dB might even be OK.
The other approach is to plot a spectrogram - which SoX can export as a PNG image. The silences, whether or not they contain a DC offset as shown, would appear as black in all frequencies. That might be easier to interpret or to analyse graphically or numerically, particularly if converted to an ASCII-encoded graphical format like PPM or PGM (part of PNM or Netpbm format family).
Dynamic – the artist formerly known as DickD

  • MaiTiano
  • [*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #22
I'd assumed, perhaps wrongly, that you were displaying Waveform (dB) rather than linear, in which case those were probably only a fraction offset from zero, and setting silence detection to -80 dB might even be OK.
The other approach is to plot a spectrogram - which SoX can export as a PNG image. The silences, whether or not they contain a DC offset as shown, would appear as black in all frequencies. That might be easier to interpret or to analyse graphically or numerically, particularly if converted to an ASCII-encoded graphical format like PPM or PGM (part of PNM or Netpbm format family).


I would like to give you a even clear figure which includes the Y axis and even zoomed in view in it.



For the advice of using Sox to draw a DC spectrogram, I have three questions:
[1] I can get the spectrogram PNG image by Sox, but is it standing for the spetrum features of the whole song long? 
[2] How can I get the correct part of these silence area? For example, 57.25s ~ 57.36s is silence part and it would be more likely to see the all black in all frequencies right within this time period. In other words, if I analysis the waveform between 57.15s~57.36s, maybe the spectrum is not all black in all frequencies, right?

Hope to get your help. Many thanks.

  • Dynamic
  • [*][*][*][*][*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #23
[1] - Yes, I think it's the whole song
[2] - It should be black, except perhaps for the very lowest frequencies, but probably for those also. You can show spectrogram view in Audacity - that should be black during the gaps too.
Dynamic – the artist formerly known as DickD

  • MaiTiano
  • [*]
Help. How to evaluate a Mp3's quality? Like noise existed in the f
Reply #24
[1] - Yes, I think it's the whole song
[2] - It should be black, except perhaps for the very lowest frequencies, but probably for those also. You can show spectrogram view in Audacity - that should be black during the gaps too.


I already have finish the program of detecting the silent part in a music file.
Now, the left work should be distinguishing the silent part in the beginning/end part(as the music file usually has silent part in the beginning/end of it) of music file and the irregular silent part.