HydrogenAudio

I did a VS 2017 compile done from the source of the official 1.3.3 Xiph release.
I don't do these things often atm. It would be nice someone can check it.
It should be a bit faster against a GCC version.

Verion 1.3.3 was borked because the version number in CMakeLists.txt did
not get updated.

https://github.com/xiph/flac/pull/119

Quote from: NetRanger on 2019-08-14 12:57:32

https://github.com/xiph/flac/pull/119

Thanks for the info.
The compiled versions report as libFLAC 1.3.3 20190804 and one day later as libFLAC 1.3.4 20190805
I wonder why 1.3.4 didn't make it to any official xiph page yet?

Verion 1.3.3 was borked because the version number in CMakeLists.txt did
not get updated.

52 49 46 46 86 8C 80 02 57 41 56 45    RIFF†Œ€.WAVE

52 49 46 46 9E 8C 80 02 57 41 56 45    RIFFžŒ€.WAVE

66 6D 74 20 10 00 00 00 01 00 02 00    fmt ........

66 6D 74 20 28 00 00 00 FE FF 02 00    fmt (...þÿ..

You can compile libFLAC_dynamic.dll? Thanks

You can compile libFLAC_dynamic.dll? Thanks

Date: 2020-03-06
Commit: c8fca6b
Compiler: MSVC 2019 (v142) SDK version 10.0.18362.0

FLAC 1.3.3 + LibFLAC_dynamic.dll  (x86 & x64)

./timer64.exe ./flac.exe --verify --best --exhaustive-model-search --qlp-coeff-precision-search ./test.flac -o test_grieverv.flac

test.flac: Verify OK, wrote 377669674 bytes, ratio=0.992


Kernel  Time =     1.171 =    0%
User    Time =   335.281 =   99%
Process Time =   336.453 =   99%    Virtual  Memory =     15 MB
Global  Time =   337.578 =  100%    Physical Memory =     14 MB

./timer64.exe ./flac.exe --verify --best --exhaustive-model-search --qlp-coeff-precision-search ./test.flac -o test_netranger.flac

test.flac: Verify OK, wrote 377669674 bytes, ratio=0.992


Kernel  Time =     1.531 =    0%
User    Time =   409.140 =   99%
Process Time =   410.671 =   99%    Virtual  Memory =     15 MB
Global  Time =   411.926 =  100%    Physical Memory =     14 MB

CPPFLAGS="-D__USE_MINGW_ANSI_STDIO=1 -D_FORTIFY_SOURCE=0"
CFLAGS="-march=x86-64 -O3 -fno-plt -fno-semantic-interposition -fno-stack-protector -falign-functions=32 -flto -ffat-lto-objects -mtune=skylake -pipe"
CXXFLAGS="-march=x86-64 -O3 -fno-plt -fno-semantic-interposition -fno-stack-protector -falign-functions=32 -flto -ffat-lto-objects -mtune=skylake -pipe"
LDFLAGS="-Wl,-O1,--sort-common,--as-needed -pipe"

LDFLAGS+=" -Wl,-Bstatic"
./configure \
  --disable-shared \
  --enable-static \
  --disable-xmms-plugin \
  --disable-rpath \
  --prefix=${MINGW_PREFIX} \
  --build=${MINGW_CHOST} \
  --host=${MINGW_CHOST} \
  --target=${MINGW_CHOST}

His build just doesn't work on my computer. It starts, shows help, but when it needs to encode, it just... exits.

-march=haswell

flac_Griever_1d5299d.exe
Kernel  Time =     2.203 =    5%
User    Time =    38.453 =   91%
Process Time =    40.656 =   96%    Virtual  Memory =     14 MB
Global  Time =    42.164 =  100%    Physical Memory =     14 MB

Case´s build:
Kernel  Time =     2.562 =    6%
User    Time =    35.390 =   90%
Process Time =    37.953 =   96%    Virtual  Memory =     14 MB
Global  Time =    39.238 =  100%    Physical Memory =     14 MB

flac_GrieverV_1d5299d_haswell.exe
Kernel  Time =     2.390 =    5%
User    Time =    36.468 =   90%
Process Time =    38.859 =   96%    Virtual  Memory =     14 MB
Global  Time =    40.137 =  100%    Physical Memory =     14 MB

PS C:\Program Files (x86)\foobar2000\Encoders\skylakeflac> Measure-Command { ..\flac.exe --verify --best E:\flac_reenc_AIO\Image.wav -o E:\flac_reenc_AIO\Image_new.flac }

flac 1.3.2
Copyright (C) 2000-2009  Josh Coalson, 2011-2016  Xiph.Org Foundation
flac comes with ABSOLUTELY NO WARRANTY.  This is free software, and you are
welcome to redistribute it under certain conditions.  Type `flac' for details.

Image.wav: Verify OK, wrote 2816137583 bytes, ratio=0,789


Days              : 0
Hours             : 0
Minutes           : 1
Seconds           : 50
Milliseconds      : 85
Ticks             : 1100852308
TotalDays         : 0,00127413461574074
TotalHours        : 0,0305792307777778
TotalMinutes      : 1,83475384666667
TotalSeconds      : 110,0852308
TotalMilliseconds : 110085,2308

PS C:\Program Files (x86)\foobar2000\Encoders\skylakeflac> Measure-Command { .\flac_1d5299d_skylake_2020-03-25.exe --verify --best E:\flac_reenc_AIO\Image.wav -o E:\flac_reenc_AIO\Image_new.flac }

flac 1.3.3
Copyright (C) 2000-2009  Josh Coalson, 2011-2016  Xiph.Org Foundation
flac comes with ABSOLUTELY NO WARRANTY.  This is free software, and you are
welcome to redistribute it under certain conditions.  Type `flac' for details.

Image.wav: Verify OK, wrote 2816138302 bytes, ratio=0,789


Days              : 0
Hours             : 0
Minutes           : 1
Seconds           : 23
Milliseconds      : 653
Ticks             : 836538482
TotalDays         : 0,000968215835648148
TotalHours        : 0,0232371800555556
TotalMinutes      : 1,39423080333333
TotalSeconds      : 83,6538482
TotalMilliseconds : 83653,8482

flac133_ GrieverV_7a35c528.exe:
Kernel  Time =     2.921 =    7%
User    Time =    35.781 =   89%
Process Time =    38.703 =   96%    Virtual  Memory =     14 MB
Global  Time =    40.034 =  100%    Physical Memory =     14 MB

flac133_ GrieverV_7a35c528_haswell.exe:
Kernel  Time =     2.359 =    6%
User    Time =    35.359 =   90%
Process Time =    37.718 =   96%    Virtual  Memory =     14 MB
Global  Time =    39.087 =  100%    Physical Memory =     14 MB

flac133_Case.exe:
Kernel  Time =     2.812 =    7%
User    Time =    35.109 =   89%
Process Time =    37.921 =   96%    Virtual  Memory =     14 MB
Global  Time =    39.223 =  100%    Physical Memory =     14 MB

@sanskrit44: What CPU are you running, and which of GrieverV's compiles did you test?

--best:                                                                 4.5%
--verify --best:                                                        5.8%
--verify --best --qlp-coeff-precision-search:                           2.5%
--verify --best --exhaustive-model-search --qlp-coeff-precision-search: 1.2%

Are you able to reproduce similar results with different FLAC files or the one linked above?

PS C:\Program Files (x86)\foobar2000\Encoders> Measure-Command { .\flac.exe --verify --best E:\Musik_reenc_AIO\Image.w64 -o E:\Musik_reenc_AIO\imageout.flac }

flac 1.3.3
Copyright (C) 2000-2009  Josh Coalson, 2011-2016  Xiph.Org Foundation
flac comes with ABSOLUTELY NO WARRANTY.  This is free software, and you are
welcome to redistribute it under certain conditions.  Type `flac' for details.

Image.w64: Verify OK, wrote 4116685875 bytes, ratio=0,779


Days              : 0
Hours             : 0
Minutes           : 2
Seconds           : 16
Milliseconds      : 485
Ticks             : 1364857502
TotalDays         : 0,00157969618287037
TotalHours        : 0,0379127083888889
TotalMinutes      : 2,27476250333333
TotalSeconds      : 136,4857502
TotalMilliseconds : 136485,7502

PS C:\Program Files (x86)\foobar2000\Encoders> Measure-Command { .\flacneu\flac.exe --verify --best E:\Musik_reenc_AIO\Image.w64 -o E:\Musik_reenc_AIO\imageout2.flac }

flac 1.3.3
Copyright (C) 2000-2009  Josh Coalson, 2011-2016  Xiph.Org Foundation
flac comes with ABSOLUTELY NO WARRANTY.  This is free software, and you are
welcome to redistribute it under certain conditions.  Type `flac' for details.

Image.w64: Verify OK, wrote 4116686510 bytes, ratio=0,779


Days              : 0
Hours             : 0
Minutes           : 1
Seconds           : 58
Milliseconds      : 800
Ticks             : 1188007802
TotalDays         : 0,00137500903009259
TotalHours        : 0,0330002167222222
TotalMinutes      : 1,98001300333333
TotalSeconds      : 118,8007802
TotalMilliseconds : 118800,7802

why are those called haswell builds when they are compiled with -mtune=skylake?

Size difference?

• Rebuilt against a newer Mingw-w64 git snapshot
• Haswell binaries are now built without FMA support which should allow reproducible compression sizes with other builds

CPPFLAGS="-D_FORTIFY_SOURCE=0"
CFLAGS="-march=x86-64 -O3 -fno-common -fno-plt -fno-semantic-interposition -fno-stack-protector -fno-math-errno -fno-trapping-math -falign-functions=32 -fdevirtualize-at-ltrans -fgraphite-identity -floop-nest-optimize -fipa-pta -flto -ffat-lto-objects -funroll-loops -m64 -mtune=skylake -pipe"
CXXFLAGS="$CFLAGS"
LDFLAGS="-Wl,-O1,--sort-common,--as-needed ${CFLAGS}"

CPPFLAGS="-D_FORTIFY_SOURCE=0"
CFLAGS="-march=haswell -O3 -fno-common -fno-plt -fno-semantic-interposition -fno-stack-protector -fno-math-errno -fno-trapping-math -falign-functions=32 -fdevirtualize-at-ltrans -fgraphite-identity -floop-nest-optimize -fipa-pta -flto -ffat-lto-objects -funroll-loops -m64 -mno-fma -pipe"
CXXFLAGS="$CFLAGS"
LDFLAGS="-Wl,-O1,--sort-common,--as-needed ${CFLAGS}"

./configure \
--disable-shared \
--enable-static \
--disable-xmms-plugin \
--disable-rpath \
--prefix=${MINGW_PREFIX} \
--build=${MINGW_CHOST} \
--host=${MINGW_CHOST} \
--target=${MINGW_CHOST} \
--enable-64-bit-words \
--disable-stack-smash-protection

Intel Core i7-6700 CPU @ 3.40GHz, 24 GB RAM, Samsung SSD 850 EVO 500GB
Windows 10 Pro 64-bit, Version 1909, Build 18363.720

flac133_case.exe:
39.303 sec (avg. runtime/5 runs, fastest run: 39.228 sec)
total size of FLAC files: 1.167.279.038 bytes -> different build!

flac133_GrieverV_7a35c528_haswell_FMA.exe (07.04.2020):
38.964 sec (avg. runtime/5 runs, fastest run: 38.814 sec)
total size of FLAC files: 1.167.276.028 bytes

flac133_GrieverV_7a35c528_haswell_noFMA.exe (12.04.2020):
39.169 sec (avg. runtime/5 runs, fastest run: 39.055 sec)
total size of FLAC files: 1.167.278.241 bytes

flac133_GrieverV_7a35c528.exe (12.04.2020):
40.192 sec (avg. runtime/5 runs, fastest run: 40.068 sec)
total size of FLAC files: 1.167.278.241 bytes

Somewhat step-by-step for MSYS2:

#-- Compiler and Linker Flags
# -march (or -mcpu) builds exclusively for an architecture
# -mtune optimizes for an architecture, but builds for whole processor family
CPPFLAGS="-D__USE_MINGW_ANSI_STDIO=1"
CFLAGS="-march=x86-64 -mtune=generic -O2 -pipe"
CXXFLAGS="-march=x86-64 -mtune=generic -O2 -pipe"
LDFLAGS="-pipe"

#-- Compiler and Linker Flags
# -march (or -mcpu) builds exclusively for an architecture
# -mtune optimizes for an architecture, but builds for whole processor family
CPPFLAGS="-D__USE_MINGW_ANSI_STDIO=1"
CFLAGS="-march=x86-64 -mtune=sandybridge -O2 -pipe"
CXXFLAGS="-march=x86-64 -mtune=sandybridge -O2 -pipe"
LDFLAGS="-pipe"

#-- Compiler and Linker Flags
# -march (or -mcpu) builds exclusively for an architecture
# -mtune optimizes for an architecture, but builds for whole processor family
CPPFLAGS="-D__USE_MINGW_ANSI_STDIO=1"
CFLAGS="-march=sandybridge -mtune=generic -O2 -pipe"
CXXFLAGS="-march=sandybridge -mtune=generic -O2 -pipe"
LDFLAGS="-pipe"

• The FLAC format supports only integer samples, not floating-point. It can handle any PCM bit resolution from 4 to 32 bits per sample, any sampling rate from 1 Hz to 65,535 Hz in 1 Hz increments or from 10 Hz to 655,350 Hz in 10 Hz increments, and any number of channels from 1 to 8.[9] To Date (Vers. 1.3.3 of the reference encoder), FLAC encoding is limited to 24 bits per sample since no encoder for 32 bits per sample exists.[10]
  
• Channels can be grouped in some cases, for example stereo and 5.1 channel surround, to take advantage of interchannel correlations to increase compression.
• CRC checksums are used for identifying corrupted frames when used in a streaming protocol. The file also includes a complete MD5 hash of the raw PCM audio in its STREAMINFO metadata header. FLAC allows for a Rice parameter between 0 and 16.
  
• FLAC uses linear prediction to convert the audio samples. There are two steps, the predictor and the error coding. The predictor can be one of four types (Zero, Verbatim, Fixed Linear and Finite Impulse Response[dubious – discuss] (FIR) Linear). The difference between the predictor and the actual sample data is calculated and is known as the residual. The residual is stored efficiently using Golomb-Rice coding. It also uses run-length encoding for blocks of identical samples, such as silent passages.

$ gcc -march=native -Q --help=target | grep march
  -march=                               skylake
  Known valid arguments for -march= option:

1.3.3 was released over 6 months ago and never even made the news on the homepage, that's a little sad IMHO
https://xiph.org/flac/news.html

What about official win compiles?

Erik has already made it quite clear that he couldn't care any less about proprietary ("dead") operating systems.

Erik has already made it quite clear that he couldn't care any less about proprietary ("dead") operating systems.

I seem to be a little late to the party here!! ;)

I can generate Intel compiles and/or Visual Studio compiles. What does everybody want?

Quote from: john33 on 2020-06-11 18:24:39

I seem to be a little late to the party here!! ;)

I can generate Intel compiles and/or Visual Studio compiles. What does everybody want?

I'd prefer Intel compiles (that's what you currently have on the RW site, correct?), but either would be great.  :)

I'll get to this when I am able but the git repositories at xiph.org are inaccessible at the moment. :(

New compiles now at Rarewares. :)

Quote from: john33 on 2020-06-12 16:21:58

New compiles now at Rarewares. :)

Thanks, but the libFLAC links are pointing to the FLAC executables downloads ;)

Why there's no exe file of 1.3.3 for windows?

Note: flac.exe is a command-line tool.
As I interpret the message, an issue with the official 1.3.3 source code prevented an official Windows build.
So stick with 1.3.2, wait for 1.3.4, or use one of the unofficial builds for 1.3.3.

There is a GUI: https://sourceforge.net/projects/flacfrontend/

Sorry for the noob question  :)) I am on Windows 10. I would like to update flac.exe that ships with Flac Frontend to version 1.3.3 but I do not know whether I should use the 64-bit or 32-bit version. Any help? Thanks.

Open a command-line window (hold down Win key and press r, then type "cmd" without quotation marks, and press Enter).
In the command-line window, type
wmic os get osarchitecture
and press enter.

I’m curious what happened to 1.3.4... it seems we went backwards to 1.3.3 again?

#!/bin/bash
export CC=clang CXX=clang++
git clone https://github.com/xiph/flac.git --recursive
cd flac
cmake -B build -G Ninja -S ./ \
    -DCMAKE_BUILD_TYPE=Release \
    -DWITH_OGG=OFF \
    -DBUILD_EXAMPLES=OFF \
    -DBUILD_DOCS=OFF \
    -DINSTALL_MANPAGES=OFF \
    -DCMAKE_EXE_LINKER_FLAGS='-fstack-protector-strong -static'
ninja -C build

@john33  i noticed a small increase in compression after installing your compile for FLAC 1.3.3 over my previous vanilla 1.3.2 install. Is that just the regular difference between the two versions or did you tweak anything, do you have an update log available somewhere?
The difference is very minor, about 5000 bytes in 239 files, but still.

There was only a <1 KB difference between any of the builds or 1.3.2 for 44/16, using Muse's "Take a Bow" from that old post.

Those get beat with the Level 8 stick out of spite.

Quote from: sheik124 on 2021-09-18 20:26:10

There was only a <1 KB difference between any of the builds or 1.3.2 for 44/16, using Muse's "Take a Bow" from that old post.

Just to be sure that it isn't padding or seektable ... tried
metaflac.exe --dont-use-padding --remove-all
?
(It will also remove the vendor (version) string, so make a copy first.)

FOR /F "tokens=*" %G IN ('dir /b /s *.flac') DO metaflac.exe --dont-use-padding --remove-all "%G"

Before:
2021-09-18  01:04 PM        32,819,331 01 Take A Bow 1.3.2.flac
2021-09-18  01:09 PM        32,819,357 01 Take A Bow flac-v1.3.3.git-ce6dd6b-x64.flac
2021-09-18  01:07 PM        32,819,370 01 Take A Bow 1.3.3_313ab58-Ozz.flac
2021-09-18  01:10 PM        32,819,379 01 Take A Bow mingw-w64-x86_64-flac-git-1.3.3.r3909.7a35c528.flac
After:
2021-09-18  11:46 PM        32,689,426 01 Take A Bow 1.3.2.flac
2021-09-18  11:46 PM        32,689,452 01 Take A Bow flac-v1.3.3.git-ce6dd6b-x64.flac
2021-09-18  11:46 PM        32,689,474 01 Take A Bow mingw-w64-x86_64-flac-git-1.3.3.r3909.7a35c528.flac
2021-09-18  11:46 PM        32,689,476 01 Take A Bow 1.3.3_313ab58-Ozz.flac
The "giant" 4616 kbps FLAC out of curiosity:
2019-10-22  06:18 PM       189,548,998 01 - Beautiful World.flac - Before
2021-09-18  11:53 PM       183,454,510 01 - Beautiful World.flac - After
2021-09-18  03:09 PM       183,586,602 01 - Beautiful World.wav - Still tagged with embedded album art too BTW...
2021-09-18  03:05 PM           446,533 heart station.jpg

"uncompressed"
I think it's a WAV wrapped in a FLAC.  I could be wrong.

EZ

...so, finally, I don't exact understand which build is recommended (compression efficiency oriented) to use inside CUEtools 2.1.9: any suggestion ?

MSVC 2019 (v142) SDK version 10.0.19041.0

(All built using the VS sln.)

Quote from: john33 on 2022-02-13 14:18:50

(All built using the VS sln.)

Note that building with the sln files supplied in git or tarball will be deprecated in favor of building with sln files configured with CMake starting with release 1.3.4. ...

Noted, thanks. It will still be a pain in the rear having to modify all the compiler options as it is now.

Quote from: john33 on 2022-02-14 13:57:24

Noted, thanks. It will still be a pain in the rear having to modify all the compiler options as it is now.

That, or you could make sure those compiler options are included in the CMake config, i.e. have your changed merged. If you want, I can help with that. The major benefit of CMake is that you can configure a build instead of having to modify the sln files by hand to change build behaviour.

Is ARM optimization ever happening, or is that unnecessary?

#pragma clang attribute push (__attribute__((target("lzcnt"))), apply_to=function)
...
#pragma clang attribute pop

Code: [Select]

#pragma clang attribute push (__attribute__((target("lzcnt"))), apply_to=function)
...
#pragma clang attribute pop

Quote from: john33 on 2022-02-14 13:57:24

Noted, thanks. It will still be a pain in the rear having to modify all the compiler options as it is now.

That, or you could make sure those compiler options are included in the CMake config, i.e. have your changed merged. If you want, I can help with that. The major benefit of CMake is that you can configure a build instead of having to modify the sln files by hand to change build behaviour.

find_package(PkgConfig)
pkg_check_modules(_OGG QUIET ogg)

file(GLOB _OGG_DIR "./include")
file(GLOB _OGG_STATIC_LIB "./objs/Release/lib")

find_path(
    OGG_INCLUDE_DIR
    NAMES "ogg/ogg.h"
    PATHS ${_OGG_DIR}
#    HINTS "${_OGG_DIR}/include"
    )

find_library(
    OGG_LIBRARY
    NAMES libogg_static.lib
#    PATH ${_OGG_STATIC_LIB}
    HINTS "${_OGG_STATIC_LIB}"
    )

mark_as_advanced(
    OGG_INCLUDE_DIR
    OGG_LIBRARY)
include(FindPackageHandleStandardArgs)
find_package_handle_standard_args(Ogg
    REQUIRED_VARS OGG_INCLUDE_DIR OGG_LIBRARY
    VERSION_VAR _OGG_VERSION)
if(OGG_FOUND AND NOT TARGET Ogg::ogg)
    add_library(Ogg::ogg UNKNOWN IMPORTED)
    set_target_properties(Ogg::ogg PROPERTIES
        INTERFACE_INCLUDE_DIRECTORIES "${OGG_INCLUDE_DIR}"
        IMPORTED_LOCATION "${OGG_LIBRARY}")
endif()

Quote from: Ozz on 2022-02-10 19:34:10

MSVC 2019 (v142) SDK version 10.0.19041.0

Just curious, do you build these with the sln files or with CMake?

cmake -B build/dir -G Ninja -DBUILD_SHARED_LIBS=yes -DCMAKE_PREFIX_PATH=path/to/libogg/dir