Notice
Please note that most of the software linked on this forum is likely to be safe to use. If you are unsure, feel free to ask in the relevant topics, or send a private message to an administrator or moderator. To help curb the problems of false positives, or in the event that you do find actual malware, you can contribute through the article linked here.
Recent Topics
Board News
Server updates
2021-08-26 23:26:55 by spoon | Views: 412 | Comments: 2
FYI: our servers are undergoing updates over the next 24 hours, dbpoweramp, accuraterip, perfecttunes, hydrogenaudio, foobar2000, and this forum will be unavailable for a short time.
TAK 2.3.1
2021-03-28 18:36:10 by TBeck | Views: 6055 | Comments: 32
Final release of TAK 2.3.1 ((T)om's lossless (A)udio (K)ompressor)
It consists of:
- TAK Applications 2.3.1
- TAK Winamp plugin 2.3.1
- TAK Decoding library 2.3.1
- TAK SDK 1.1.1
Download
Lyra: AI powered speech codec from Google
2021-02-27 09:39:31 by birdie | Views: 1548 | Comments: 2
Quote
Lyra is a high-quality, very low-bitrate speech codec that makes voice communication available even on the slowest networks. To do this, we’ve applied traditional codec techniques while leveraging advances in machine learning (ML) with models trained on thousands of hours of data to create a novel method for compressing and transmitting voice signals.
Lyra Overview
The basic architecture of the Lyra codec is quite simple. Features, or distinctive speech attributes, are extracted from speech every 40ms and are then compressed for transmission. The features themselves are log mel spectrograms, a list of numbers representing the speech energy in different frequency bands, which have traditionally been used for their perceptual relevance because they are modeled after human auditory response. On the other end, a generative model uses those features to recreate the speech signal. In this sense, Lyra is very similar to other traditional parametric codecs, such as MELP.
However traditional parametric codecs, which simply extract from speech critical parameters that can then be used to recreate the signal at the receiving end, achieve low bitrates, but often sound robotic and unnatural. These shortcomings have led to the development of a new generation of high-quality audio generative models that have revolutionized the field by being able to not only differentiate between signals, but also generate completely new ones. DeepMind’s WaveNet was the first of these generative models that paved the way for many to come. Additionally, WaveNetEQ, the generative model-based packet-loss-concealment system currently used in Duo, has demonstrated how this technology can be used in real-world scenarios.
A New Approach to Compression with Lyra
Using these models as a baseline, we’ve developed a new model capable of reconstructing speech using minimal amounts of data. Lyra harnesses the power of these new natural-sounding generative models to maintain the low bitrate of parametric codecs while achieving high quality, on par with state-of-the-art waveform codecs used in most streaming and communication platforms today. The drawback of waveform codecs is that they achieve this high quality by compressing and sending over the signal sample-by-sample, which requires a higher bitrate and, in most cases, isn’t necessary to achieve natural sounding speech.
One concern with generative models is their computational complexity. Lyra avoids this issue by using a cheaper recurrent generative model, a WaveRNN variation, that works at a lower rate, but generates in parallel multiple signals in different frequency ranges that it later combines into a single output signal at the desired sample rate. This trick enables Lyra to not only run on cloud servers, but also on-device on mid-range phones in real time (with a processing latency of 90ms, which is in line with other traditional speech codecs). This generative model is then trained on thousands of hours of speech data and optimized, similarly to WaveNet, to accurately recreate the input audio.
Comparison with Existing Codecs
Since the inception of Lyra, our mission has been to provide the best quality audio using a fraction of the bitrate data of alternatives. Currently, the royalty-free open-source codec Opus, is the most widely used codec for WebRTC-based VOIP applications and, with audio at 32kbps, typically obtains transparent speech quality, i.e., indistinguishable from the original. However, while Opus can be used in more bandwidth constrained environments down to 6kbps, it starts to demonstrate degraded audio quality. Other codecs are capable of operating at comparable bitrates to Lyra (Speex, MELP, AMR), but each suffer from increased artifacts and result in a robotic sounding voice.
Lyra is currently designed to operate at 3kbps and listening tests show that Lyra outperforms any other codec at that bitrate and is compared favorably to Opus at 8kbps, thus achieving more than a 60% reduction in bandwidth. Lyra can be used wherever the bandwidth conditions are insufficient for higher-bitrates and existing low-bitrate codecs do not provide adequate quality.
Source
It looks like this is no longer an audio "codec" - it's basically the AI to recognize speech and synthesize it which is simply amazing. Perhaps future video codecs will work similarly. NVIDIA has already created a working AI powered video codec for video conferences which requires a much lower bitrate than standard codecs.
-
Re: WMP Tag Plus - MP... by Tim De BaetsLast post:
-
Re: Server updates by spoonLast post:
-
News Submissions
Submit news for validation. Validated news will appear in the "Validated News"-section and on the front page.
Google AI Blog: Sound... by rajasLast post:
-
Re: By screenshot, is... by lvqclLast post:
-
Site Related Discussion
Hydrogenaudio.org site discussion. Feedback, suggestions, problems etc. related to the the site and forums.
Re: #hydrogenaudio IR... by includemeoutLast post:
-
Re: Personal blind so... by Kamedo2Last post:
-
Scientific Discussion
Discussion of psychoacoustic phenomena and models, coding architectures and algorithms, and other general DSP related subjects.
Re: Is DSD conversion... by sldLast post:
-
Uploads
This is the forum for regular members to upload files for use by others. Hydrogenaudio.org takes no responsibility for the content that may be present here, but states that any misuse of this forum, as deemed by the staff, may result in revocation of the offending users account. Acceptable content includes freely and legally distributable data of the following types: audio programs, audio samples (under 30 second clips), misc. audio related data, or other utilities which are immediately relevant to the Hydrogenaudio.org community.
Mobile (Android) Foob... by simon_owlLast post:
-
Re: Mediawiki update? by korthLast post:
-
Re: AAC Gapless playb... by snotlickerLast post:
-
-
Sub-boards:
- AAC - General
- AAC - Tech
-
-
Re: MP3 file encoded ... by PorcusLast post:
-
-
Sub-boards:
- MP3 - General
- MP3 - Tech
-
-
Re: Vorbis 1.3.7 aoTu... by deus-exLast post:
-
-
Sub-boards:
- Ogg Vorbis - General
- Ogg Vorbis - Tech
-
-
Other Lossy Codecs
Discussion of other lossy audio codecs like AC3, ADPCM, Atrac, Dolby Pro logic/II, DTS, MP1, MP2, Real Audio, VQF, Wavpack lossy, WMA etc.
Re: exhale - Open Sou... by celonaLast post:
-
Speech Codecs
Discussion of speech codecs like Speex, GSM-FR, GSM-EFR, iLBC, G.723.1, G.728, G.729, AMR-NB, AMR-WB, VSELP, ACELP.xxx etc.
Re: Google Lyra goes ... by IgorCLast post:
-
MPC
Discussion of MPC (Musepack) audio compression. The official forum is at http://forum.musepack.net/
Re: Musepack in 2020 by synclagzLast post:
-
Re: wav 16bit 44.1 kh... by jmvalinLast post:
-
-
-
Lossless / Other Codecs
General discussion of lossless audio compression and other lossless codecs like ALAC, Monkey's Audio, WMA Lossless, OptimFrog, LA, LPAC, Shorten, TAK etc.
-
Re: Audacity will spy... by shadowkingLast post:
-
General A/V
Discussion of general A/V topics such as DivX/XviD, AVC (H.264), DVD ripping, VirtualDub, container formats, streaming, and so on.
Moderator: smok3
Re: Verify that a mus... by j7nLast post:
-
Re: Ambisonic C++ Lib... by OctocontrabassLast post:
-
CD Hardware/Software
Discussion of CD-ROM/-R/-RW/DVD-hardware, copying, ripping and burning of CD media, EAC, CDex, Plextools etc.
Moderator: Pio2001
Re: CUE sheets and tr... by AlexandrovLast post:
-
Re: CUETools DB by maldataLast post:
-
Audio Hardware
Discussion of Audio Hardware, Soundcards, Hi-Fi equipment, stand-alone CD players, portable MP3 players, headphones etc.
Moderator: Pio2001
Re: Revive Logitech s... by ajinflaLast post:
-
Re: If you can't stan... by NateHigsLast post:
-
foobar2000
Official foobar2000 forum. Discussion about Peter Pawlowski's advanced and compact audio player for Microsoft Windows called foobar2000.
Native MP3, Ogg Vorbis, MPC, FLAC, Ogg FLAC, WAV, MOD -support.Re: Computer Slows Do... by DrystLast post:
-
Re: How to download s... by jakobjkraftLast post:
-
-
Recycle Bin
The trashcan of HydrogenAudio. These posts represent the kind of messages we wouldn't like to see any more. These include: trolls, offensive, zealotry, spam and other useless and redundant messages.
[Off Topic - TOS#5] F... by SwiLast post: