I performed a few ABX tests on random samples from rarewares to test out what was better at CBR 128kbps FhG or LAME. I used CEP 2.0's mp3 encoder rather than MP3Enc 3.1 or fastenc 1.02 -hq, MP3Enc will crash if bandwidth is higher than 16000hz not sure why, fastenc just won't encode higher than that, CEP also doesn't have the Blackbird clicking artifact & I just think that CEP's is better tunned but I have only tested on 2 samples & CEP was better.
[span style='font-size:8pt;line-height:100%']ABC/HR Version 1.0, 6 May 2004
Testname: FhG vs Lame
1R = C:\Test_Samples\FhG vs LAME\FhG BlackBird.wav
2R = C:\Test_Samples\FhG vs LAME\LAME BlackBird.wav
---------------------------------------
General Comments:
FhG Encoder: Cool Edit Pro 2.0 (Default Settings)
Max Bandwidth: 15804Hz
CBR Bitrate: 128kbps
Sample Rate: 44100Hz
Codec: High Quality Codec (Slowest)
Mid-Side=Yes
Intensity=Yes
LAME Encoder: 3.96, (Default Settings)
Polyphase lowpass filter, transition band: 17249 Hz - 17782 Hz
Encoding as 44.1 kHz 128 kbps j-stereo MPEG-1 Layer III (11x) qval=3, 128.0 kbps LR, MS
Cool Edit's FhG slow codec does not suffer from clicks as MP3Enc 3.1 or Fastenc 1.02 -hq
do in this sample however the max bandwidth is too low making it dull & easy to spot.
---------------------------------------
ABX Results:
Original vs C:\Test_Samples\FhG vs LAME\FhG BlackBird.wav
17 out of 17, pval < 0.001
Original vs C:\Test_Samples\FhG vs LAME\LAME BlackBird.wav
7 out of 17, pval = 0.834[/span]
[span style='font-size:8pt;line-height:100%']ABC/HR Version 1.0, 6 May 2004
Testname: FhG vs Lame
1R = C:\Test_Samples\FhG vs LAME\FhG castanets.wav
2R = C:\Test_Samples\FhG vs LAME\LAME castanets.wav
---------------------------------------
General Comments:
Both are very close I suspect the first sample sounded better
---------------------------------------
ABX Results:
Original vs C:\Test_Samples\FhG vs LAME\FhG castanets.wav
11 out of 16, pval = 0.105
Original vs C:\Test_Samples\FhG vs LAME\LAME castanets.wav
10 out of 16, pval = 0.227[/span]
[span style='font-size:8pt;line-height:100%']ABC/HR Version 1.0, 6 May 2004
Testname: FhG vs Lame
1L = C:\Test_Samples\FhG vs LAME\FhG DaFunk.wav
2R = C:\Test_Samples\FhG vs LAME\LAME DaFunk.wav
---------------------------------------
General Comments:
Sample 1, max bandwidth is too low making it dull
---------------------------------------
ABX Results:
Original vs C:\Test_Samples\FhG vs LAME\FhG DaFunk.wav
23 out of 25, pval < 0.001
Original vs C:\Test_Samples\FhG vs LAME\LAME DaFunk.wav
13 out of 25, pval = 0.500[/span]
[span style='font-size:8pt;line-height:100%']ABC/HR Version 1.0, 6 May 2004
Testname: FhG vs Lame
1L = C:\Test_Samples\FhG vs LAME\LAME experiencia.wav
2L = C:\Test_Samples\FhG vs LAME\FhG experiencia.wav
---------------------------------------
General Comments:
Sample 2, max bandwidth is too low making it dull
---------------------------------------
ABX Results:
Original vs C:\Test_Samples\FhG vs LAME\LAME experiencia.wav
8 out of 16, pval = 0.598
Original vs C:\Test_Samples\FhG vs LAME\FhG experiencia.wav
16 out of 16, pval < 0.001[/span]
[span style='font-size:8pt;line-height:100%']ABC/HR Version 1.0, 6 May 2004
Testname: FhG vs Lame
1R = C:\Test_Samples\FhG vs LAME\FhG Velvet.wav
2L = C:\Test_Samples\FhG vs LAME\LAME Velvet.wav
---------------------------------------
General Comments:
Sample 1, max bandwidth is too low making it dull, slight ringing
Sample 2, slightly dull, very slight ringing
---------------------------------------
ABX Results:
Original vs C:\Test_Samples\FhG vs LAME\FhG Velvet.wav
16 out of 16, pval < 0.001
Original vs C:\Test_Samples\FhG vs LAME\LAME Velvet.wav
14 out of 16, pval = 0.002[/span]
[span style='font-size:8pt;line-height:100%']ABC/HR Version 1.0, 6 May 2004
Testname: FhG vs Lame
1L = C:\Test_Samples\FhG vs LAME\LAME Waiting.wav
2L = C:\Test_Samples\FhG vs LAME\FhG Waiting.wav
---------------------------------------
General Comments:
Sample 1 sounds slightly worse than 2
---------------------------------------
ABX Results:
Original vs C:\Test_Samples\FhG vs LAME\LAME Waiting.wav
16 out of 16, pval < 0.001
Original vs C:\Test_Samples\FhG vs LAME\FhG Waiting.wav
16 out of 16, pval < 0.001[/span]
LAME pretty much kicks ass, LAME keeps a higher bandwidth & still prevents artifacts.
What max bandwidth would I have to set in CEP to match lame's default lowpass?
Note: in ABR/CBR, lame is using sfb21 in the same way as VBR with -Y. It means that the lowpass is not constantly the one reported by Lame. Lame will encode freqs in sfb21 only if possible considering the bit budget.
MP3Enc will crash if bandwidth is higher than 16000hz not sure why
Hmmm ?
Strange...
But are you sure to use win95 or win98 ?
mp3enc31 does not work on NT based systems usually (if bitrate is > 128 or bandwidth is not default), this was a confirmed bug by Fhg.
BTW, mp3enc seems to be the best Fhg mp3 encoder...
So, try compare it to Lame, be more interesting.
Later fast Fhg encoder family was used in Roberto test and losse to Lame already
Later fast Fhg encoder family was used in Roberto test and losse to Lame already
[a href="index.php?act=findpost&pid=226716"][{POST_SNAPBACK}][/a]
Even I probably wouldn't take the results of that test too seriously.
There have been some grave flaws in the planning phase. Some codecs that would probably perform better at CBR (FhG Fast and iTunes) were tested at VBR, and Xing wasn't tested at it's latest version.
There have been some grave flaws in the planning phase.
"Nobody is perfect." (Some like it hot)
Forgot, that FhG encoder was used in VBR mode there, sorry...
west, what commandline did you use for Lame?
Hmmm ?
Strange...
But are you sure to use win95 or win98 ?
mp3enc31 does not work on NT based systems usually (if bitrate is > 128 or bandwidth is not default), this was a confirmed bug by Fhg.
BTW, mp3enc seems to be the best Fhg mp3 encoder...
So, try compare it to Lame, be more interesting.
Later fast Fhg encoder family was used in Roberto test and losse to Lame already
Yes I am using Windows XP, I wasn't aware of this bug.
If I do some more ABX tests with MP3Enc I'll test it against fastenc & CEP before LAME because I'm pretty confident it's inferior to CEP.
west, what command line did you use for Lame?
Just default as with CEP, later I might try optimized settings.
If I do some more ABX tests with MP3Enc I'll test it against fastenc & CEP before LAME because I'm pretty confident it's inferior to CEP.
It depends...
On the bitrate, the samples you choose, and if you're sensitive to high frequency artifacting or not.
If you use mp3enc31 at 128 kbit/s, you'll probably want to override the default lowpass, which is pretty low (I think something like 14.5 kHz or so).
ff123
If I do some more ABX tests with MP3Enc I'll test it against fastenc & CEP before LAME because I'm pretty confident it's inferior to CEP.
Of course, test it by yourself.
And, yes, even FhG themselves recommeded to change lowpass from default to -bw 15995 (numbers can be wrong a bit, it was hell of time ago) for mp3enc 128Kbit encoding.
But except some strange artifacts mp3enc produce here and threre, it is close to perfect (about artifacts - see ff123 page)
Still, it really can loose to last Lame (3.96), this version showed spectacular results (really unawaited) in the last Roberto test
So it seems we can congratulate Gabriel and other Lame team members - at the end Lame surpass FhG in quality !
It will be interesting to see your test results...
speaking of which, i tried playing with L3Enc, but it would just crash no batter what i tried...
ABC/HR Version 1.0, 6 May 2004
Testname: FhG Family BlackBird
1L = C:\Test_Samples\BlackBird\CEP 2.0 BlackBird.wav
2R = C:\Test_Samples\BlackBird\Fastenc 1.02.wav
3L = C:\Test_Samples\BlackBird\Fastenc 1.02 -hq.wav
4L = C:\Test_Samples\BlackBird\MP3Enc 3.1.wav
---------------------------------------
General Comments:
Sample 1= I think I can hear a very slight click but the max bandwidth is too low making it dull sounding is what I can ABX, Easy to ABX
Sample 2= Can't hear a click, slightly less dull than sample 1, Easy to ABX
Sample 3= Not dull sounding but click makes it easy to ABX, I prefer this to the dull sound, Very easy to ABX though
Sample 4=More Dull sound than 3 + click is present as in sample 3
1 & 2 are similar 3 & 4 are similar, I prefer Sample 3.
---------------------------------------
ABX Results:
Original vs C:\Test_Samples\BlackBird\CEP 2.0 BlackBird.wav
16 out of 16, pval < 0.001
Original vs C:\Test_Samples\BlackBird\Fastenc 1.02.wav
16 out of 16, pval < 0.001
Original vs C:\Test_Samples\BlackBird\Fastenc 1.02 -hq.wav
16 out of 16, pval < 0.001
Original vs C:\Test_Samples\BlackBird\MP3Enc 3.1.wav
16 out of 16, pval < 0.001
C:\Test_Samples\BlackBird\CEP 2.0 BlackBird.wav vs C:\Test_Samples\BlackBird\Fastenc 1.02.wav
8 out of 10, pval = 0.055
C:\Test_Samples\BlackBird\Fastenc 1.02 -hq.wav vs C:\Test_Samples\BlackBird\MP3Enc 3.1.wav
10 out of 10, pval < 0.001
Well I belive this is fastenc -hq's worst problem sample & it really is not that bad to my ears, I have tested on some other samples too & I have to say I prefer fastenc -hq more than the others FhG encoders maybe because it has more fidelity, I'm not sure. I know I'm sensitive to high frequencies & that's where it shines also a higher max bandwidth doesn't help the other encoders much I'm not sure why. It may already be common knowledge as the NT crash bug that I was not aware of but in 2 samples I have tested so far fastenc's stereo image has collapsed where fastenc -hq does not, it's possible it doesn't have this bug. My vote would be for fastenc 1.02 -hq as the FhG encoder in the next MP3@128kbps public listening test.
Well I belive this is fastenc -hq's worst problem sample & it really is not that bad to my ears, I have tested on some other samples too & I have to say I prefer fastenc -hq more than the others FhG encoders maybe because it has more fidelity, I'm not sure. I know I'm sensitive to high frequencies & that's where it shines also a higher max bandwidth doesn't help the other encoders much I'm not sure why. It may already be common knowledge as the NT crash bug that I was not aware of but in 2 samples I have tested so far fastenc's stereo image has collapsed where fastenc -hq does not, it's possible it doesn't have this bug. My vote would be for fastenc 1.02 -hq as the FhG encoder in the next MP3@128kbps public listening test.
[a href="index.php?act=findpost&pid=227747"][{POST_SNAPBACK}][/a]
fastencc without -hq does have the stereo collapse bug, as you found out. It's not recommended in this mode. fastencc -hq is liked by many with good high frequency hearing, but it is verrry slow. And you will get occasional glitches, knocking sounds, blips, etc., which may or may not disturb you too much, depending on your hearing and preferences. I would also like to have seen it compared against other top-knotch mp3 encoders.
ff123