lucidrains/audiolm-pytorch

Health v2 · maintenance only

Adoption not part of the score

2627 stars · 278 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A PyTorch implementation of AudioLM, Google Research's language modeling approach to audio generation, including a MIT-licensed SoundStream implementation compatible with EnCodec. It extends the original work with T5 classifier-free guidance conditioning, enabling text-to-audio and TTS (VALL-E style) training.

Use cases

• generate audio with a language model in pytorch
• train a text-to-speech model like VALL-E
• implement AudioLM from the Google Research paper
• train a SoundStream or EnCodec neural audio codec
• do text-to-audio generation with T5 conditioning
• replicate AudioLM research experiments

When to choose

• you want a PyTorch codebase to train or experiment with AudioLM-style audio generation
• you need an open-source SoundStream implementation or EnCodec-compatible codec training
• you want to train a VALL-E-like TTS model from scratch

When to avoid

• you need a production-ready, pretrained text-to-speech service out of the box
• you want a simple inference-only audio generation tool without training
• you need a maintained product with guaranteed support rather than a research implementation

Facets

library · maturity active

machine-learning deep-learning audio-processing tts llm-training deep-learning artificial-intelligence machine-learning python audiolm audio-generation pytorch transformers soundstream text-to-audio research-implementation audio

Member repositories

For agents

markdown · JSON · MCP: product_card(name="lucidrains/audiolm-pytorch")