haoheliu/AudioLDM

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

2907 stars · 271 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

AudioLDM is a Python library and research model for text-to-audio generation using latent diffusion models conditioned on CLAP embeddings. It generates speech, sound effects, and music from text, and supports audio-to-audio generation, style transfer, inpainting, and super-resolution.

Use cases

• generate sound effects from a text description
• create background music from a prompt
• synthesize speech from text
• transfer the style of one audio to another using a text description
• do audio inpainting and super-resolution
• run a web app for text-to-audio generation

When to choose

• you need to generate audio (speech, music, sound effects) from text prompts
• you want zero-shot text-guided audio manipulation like style transfer
• you want a research-grade text-to-audio model with a Gradio demo and CLI

When to avoid

• you need production-grade, commercially licensed audio generation (license is non-standard)
• you need real-time or low-latency audio synthesis
• you only need text-to-speech with fine voice control

Facets

library · maturity maintenance

audio-processing machine-learning deep-learning artificial-intelligence deep-learning python cross-platform text-to-audio latent-diffusion sound-effects music-generation speech-synthesis style-transfer gradio audio gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="haoheliu/AudioLDM")