HydrogenAudio

Lossy Audio Compression => Ogg Vorbis => Ogg Vorbis - Tech => Topic started by: enzo on 2018-04-02 20:17:21

Title: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: enzo on 2018-04-02 20:17:21
I have updated my aoTuV and Lancer patches (see old thread (https://hydrogenaud.io/index.php/topic,109766.0.html) for reference) for Vorbis 1.3.7.

The patches now apply on top of the official libvorbis 1.3.7 sources and must be applied in order.


Also see my GitHub repository (https://github.com/enzo1982/vorbis-aotuv-lancer) with these changes.

Edit: Updated post for Vorbis 1.3.7.
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: john33 on 2018-04-02 22:12:17
Thanks. :) I'll look at these over the next few days.
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: estudiosyue1 on 2018-04-03 03:36:16
Gracias por el aporte he estado esperando una actualizaciĆ³n desde hace muchos aƱos. :'(
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: sanskrit44 on 2018-04-03 08:39:00
that is great news, thank you enzo and john for keeping lancer alive :)
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: madmax on 2018-04-04 20:07:12
thank you!
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: morbit on 2018-04-29 12:13:08
Code: [Select]
New logical stream (#1, serial: 6c7a3d84): type vorbis
Vorbis headers parsed for stream 1, information follows...
Version: 0
Vendor: BS; LancerMod(SSE3) (based on aoTuV 6.03 (2018))

Great work, thanks!
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: soundping on 2018-04-29 15:19:51
rarewares needs to updated.
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: john33 on 2018-04-30 17:32:28
Working on it! ;) Just taking longer than expected - life getting in the way!!
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: Sajadi on 2018-08-11 16:26:33
Anyone has windows binaries for this? :)
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: 145dBSPL on 2018-08-14 09:58:50
You might try these ones. Patched according to enzo's note. Compiled with GCC 8.2. AVX instruction set used.
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: Surfi on 2018-08-14 16:28:20
::

Thanks!

::
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: sanskrit44 on 2018-08-14 19:47:15
thank you.
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: Sajadi on 2018-08-21 10:46:39
Thank you very much :)
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: eahm on 2018-11-09 06:56:50
@john33, thanks for the builds.

-v shows 1.3.5.
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: john33 on 2018-11-09 11:54:30
@john33, thanks for the builds.

-v shows 1.3.5.
That's the program version string - which is wrong, the library is actually correct but I'll update the compiles to correct that. Thanks for letting me know. :)
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: john33 on 2018-11-09 15:29:42
They've now been updated. :)
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: eahm on 2018-11-09 16:32:34
Thank you @john33, I don't follow Vorbis much, does this last version have the enzo patches and all that stuff?
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: john33 on 2018-11-09 18:22:33
Yes, it does. I haven't got to the Lancer patches yet as they don't seem to want to patch automatically and it's a large manual exercise!! It may be something I'm doing wrong, but I'll get there, eventually! ;)
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: eahm on 2018-11-09 18:31:50
Perfect, thank you :)
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: sanskrit44 on 2018-11-16 12:01:27
They've now been updated. :)
thanks a lot @john33.

do you mind updating the flac compiles with fastcrc patch as well? https://freac.org/developer-blog-mainmenu-9/14-freac/277-fastcrc
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: john33 on 2018-11-16 19:18:18
They've now been updated. :)
thanks a lot @john33.

do you mind updating the flac compiles with fastcrc patch as well? https://freac.org/developer-blog-mainmenu-9/14-freac/277-fastcrc
I assume from the site that it's merged into the current git. If so, updated compiles are available. :) If not, let me know, please! ;)
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: eahm on 2018-11-17 02:09:20
@NetRanger always updates to the latest git too https://hydrogenaud.io/index.php/topic,113391.msg962516.html#msg962516
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: enzo on 2018-11-17 09:21:02
I assume from the site that it's merged into the current git.
Yes, I can confirm that. The fast CRC patches have been merged into the official Ogg and FLAC Git repositories in April/May.
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: john33 on 2018-11-17 09:34:07
Thanks for the confirmation.
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: sanskrit44 on 2018-11-17 09:42:56
great job, thank you john33   :)
Title: Re: Vorbis 1.3.6 aoTuV and Lancer patches
Post by: q3cpma on 2019-01-31 20:45:11
Hello, would it be possible to get the standalone Lancer patch?
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: enzo on 2020-07-05 17:09:53
Updated top post (https://hydrogenaud.io/index.php?topic=115774.0) for the Vorbis 1.3.7 release.
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: morbit on 2020-07-05 21:03:34
Updated top post (https://hydrogenaud.io/index.php?topic=115774.0) for the Vorbis 1.3.7 release.

Thank you for your kindness, that is very much appreciated.
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: Jebus on 2020-07-07 17:01:32
Updated top post (https://hydrogenaud.io/index.php?topic=115774.0) for the Vorbis 1.3.7 release.

I might just be doing something wrong, but it seems to be missing xmmlib.h/xmmlib.c in the lib directory vs the previous release.
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: john33 on 2020-07-07 17:58:29
Updated top post (https://hydrogenaud.io/index.php?topic=115774.0) for the Vorbis 1.3.7 release.

I might just be doing something wrong, but it seems to be missing xmmlib.h/xmmlib.c in the lib directory vs the previous release.
They are contained in the lancer patch file, towards the end.
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: Jebus on 2020-07-07 23:37:29
Two issues with Enzo's repo merging these

1) Missing xmmlib.h, xmmlib.c and cpu.c in the lib directory.
2) I compiled the Windows build using cmake, and on Ubuntu using ./autogen.h, ./configure and make. The output files have different vendor strings:

On Windows (cmake built):
AO; aoTuV 6.03 (2020) (based on libVorbis 1.3.7)

On Ubuntu (autogen, configure, make)
BS; LancerMod(SSE2) (based on aoTuV 6.03 (2018))

I think these should probably match, no? Is the Windows build missing the lancer patch? Sorry i'm pretty bad at this C toolchain stuff.
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: enzo on 2020-07-08 00:11:37
Indeed, the cpu.c and xmmlib.c/.h files were part of the patch, but missing in the repository. Fixed now.

As for the vendor strings, you'll have to build with SSE2 enabled on Windows. Otherwise the Lancer code will not be enabled. Not sure how to do that with cmake, though. I use MinGW/autotools on Windows too.
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: kode54 on 2020-07-08 02:22:01
Visual Studio 2017 and newer default to SSE2 if you don't change any of the settings.
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: Jebus on 2020-07-09 17:07:26
I got the included Visual Studio 2010 solution to build with some jiggering... might be worth including a disclaimer in there that the cmake system doesn't include the Lancer bits. Or just remove the cmakefiles.
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: enzo on 2020-07-09 21:19:06
The Lancer code will work with cmake just fine. You just need to make sure to tell cmake to create project files with SSE2 optimizations enabled. I don't know how to do that. Not a big fan of cmake.
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: john33 on 2020-07-10 16:58:50
Thanks enzo for the updates. All 1.3.7 and derivative builds are now on Rarewares. :)
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: fabiorug on 2020-07-10 18:40:26
Is it on freac?
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: enzo on 2020-07-10 19:34:28
Is it on freac?
Only in the continuous builds for Linux as of now. It will be included with fre:ac 1.1.3.

You can use the Rarewares builds with fre:ac 1.1.2b, though. To do that, replace both, Vorbis.dll and VorbisEnc.dll in fre:ac's codecs folder with the DLL from Rarewares (i.e. copy the libvorbis.dll to the codecs folder, then change its name to Vorbis.dll, then do the same again changing the name to VorbisEnc.dll, so you'll have two copies of the new DLL as Vorbis.dll and VorbisEnc.dll).
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: gorman on 2020-08-05 21:01:05
Thanks enzo for the updates. All 1.3.7 and derivative builds are now on Rarewares. :)
I don't see any reference to Lancer at Rarewares. Is it normal?
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: john33 on 2020-08-05 21:12:10
Oggenc2.88 using libVorbis v1.3.7 - aoTuVb6.03 (Lancer Builds)

oggdropXPd V.1.9.2 using libVorbis v1.3.7 - aoTuVb6.03 - Lancer

libvorbis.dll using libvorbis v1.3.7 - aoTuVb6.03 (Lancer Builds)

ogg vorbis dlls using libvorbis v1.3.7 + aoTuVb6.03 (Lancer Builds)

vorbis.dll - for HeadAC3he using libvorbis v1.3.7 - aoTuVb6.03 (Lancer Builds)

They're all there. ;)
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: Lii on 2020-08-14 12:38:25
I'd like to report something minor (cosmetic) about oggenc2.88-1.3.7-aoTuVb6.03-P4.zip on RareWares. With my previous version, oggenc2 --version gives me "OggEnc v2.88 (libvorbis 1.3.6-aoTuV-b6.03)". It's now "OggEnc v2.88 (libvorbis 1.3.6)", still 1.3.6 and not saying aoTuV.

A vorbis file encoded with it does says "Tool : AO; aoTuV 6.03 (2020) (based on libVorbis 1.3.7)" so the above is not a real problem. Just potentially confusing. Thanks!
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: john33 on 2020-08-17 15:59:24
I'd like to report something minor (cosmetic) about oggenc2.88-1.3.7-aoTuVb6.03-P4.zip on RareWares. With my previous version, oggenc2 --version gives me "OggEnc v2.88 (libvorbis 1.3.6-aoTuV-b6.03)". It's now "OggEnc v2.88 (libvorbis 1.3.6)", still 1.3.6 and not saying aoTuV.

A vorbis file encoded with it does says "Tool : AO; aoTuV 6.03 (2020) (based on libVorbis 1.3.7)" so the above is not a real problem. Just potentially confusing. Thanks!
Thanks for the notification. I'll correct and re-upload shortly. (Actually, I notice it applies to all the oggenc2 compiles!!)

Edit: Corrected compiles now at Rarewares. :)
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: Lii on 2020-08-17 23:30:09
Thanks! :D
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: eightstar on 2020-09-17 00:49:44
Thank you. One question, aoTuVb6.03 has not been updated for many years, is it currently better than Xiph 1.3.4 at all bitrates? For example at 160 kbps.
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: madmax on 2020-12-20 12:59:42
another question: is

vorbis-aotuv-lancer-master.zip

the same as

libvorbis-1.3.7.zip + libvorbis-1.3.7-aotuv-b6.03.patch + libvorbis-1.3.7-aotuv-b6.03-lancer.patch  ?
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: Julien on 2021-01-21 21:50:14
Oggenc2.88 using libVorbis v1.3.7 - aoTuVb6.03 (Lancer Builds)

oggdropXPd V.1.9.2 using libVorbis v1.3.7 - aoTuVb6.03 - Lancer

libvorbis.dll using libvorbis v1.3.7 - aoTuVb6.03 (Lancer Builds)

ogg vorbis dlls using libvorbis v1.3.7 + aoTuVb6.03 (Lancer Builds)

vorbis.dll - for HeadAC3he using libvorbis v1.3.7 - aoTuVb6.03 (Lancer Builds)

They're all there. ;)

Hi John,

When using the oggdropXPd V.1.9.2 builds avalaible on your website , I have noticed that encodings  made with the Lancer version of the program are about 35% larger than the ones encoded with the Libvorbis version (at q4).

My understanding is that aotuv b6.03 tunings were merged with Libvorbis a while ago and that Lancer is only optimizing the encoding speed. I assume from that the output should be in the same ballpark in terms of filesize at a given q setting.

Could you please shed some light on why the aotuv Lancer version produces larger files than the libvorbis version at the same q setting?

Thank you for your help.

Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: john33 on 2021-01-22 14:32:48
IIRC, the aoTuV tunings were merged into libvorbis at a much earlier level than 6.03 and, yes, the Lancer builds are about speed but they do have a small effect on the output bitrate, although I don't believe anyone has been able to discern an audible difference. I can't reproduce the large file size difference that you mention, my testing produces files that are "in the same ballpark in terms of filesize at a given q setting", as expected. If you have something that you can share that illustrates this, I'll gladly look at it.

Just to be clear, I am only the person who provides the compiles for general use. I have no input to the detail of the encoding libraries and I lack the technical knowledge so to do!! ;)
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: Julien on 2021-01-22 22:17:00
IIRC, the aoTuV tunings were merged into libvorbis at a much earlier level than 6.03 and, yes, the Lancer builds are about speed but they do have a small effect on the output bitrate, although I don't believe anyone has been able to discern an audible difference. I can't reproduce the large file size difference that you mention, my testing produces files that are "in the same ballpark in terms of filesize at a given q setting", as expected. If you have something that you can share that illustrates this, I'll gladly look at it.

Just to be clear, I am only the person who provides the compiles for general use. I have no input to the detail of the encoding libraries and I lack the technical knowledge so to do!! ;)

Hi John, thank you for your reply.

I'm PMing you a 40' flac sample with which the behavior I described can be reproduced.

Using OggdropXP v1.92 at q4, I get:
- BS; LancerMod(SSE3) (based on aoTuV 6.03 (2020)) -->229 kbps
- Xiph.Org libVorbis I 20200704 (Reducing Environment) -->170 kbps

Thanks a lot.
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: john33 on 2021-01-23 11:43:17
Hmm, interesting sample! I can confirm that I get the same results as you with that sample. The Lancer build and the standard aoTuV non-Lancer builds provide very similar results. I can only assume that with this and, no doubt, many other 'difficult' samples the aoTuV tunings provide a more generous bitrate allocation.
Title: Re: Vorbis 1.3.7 aoTuV and Lancer patches
Post by: Julien on 2021-01-23 13:43:52
Thank you John.
SimplePortal 1.0.0 RC1 © 2008-2021