QwenAudio/ThinkSound

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1378 stars · 82 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

ThinkSound is a PyTorch implementation of a NeurIPS 2025 framework that generates and edits audio from video, text, or audio inputs using Chain-of-Thought reasoning from multimodal large language models to guide a flow-matching audio foundation model. It also includes the AudioCoT dataset and hosts the follow-up PrismAudio project on a separate branch.

Use cases

• generate foley sound effects for videos
• convert video into audio soundscapes
• generate audio from text descriptions
• edit audio in a video with natural language instructions
• add soundtracks to AI-generated videos
• research chain-of-thought reasoning for audio generation
• train or fine-tune video-to-audio models

When to choose

• you need state-of-the-art video-to-audio or any-to-audio generation with reasoning guidance
• you want interactive, object-centric audio refinement for video content
• you are doing research on CoT-guided audio synthesis and need the AudioCoT dataset

When to avoid

• you need a production-ready, licensed product with no research code caveats (no license is specified)
• you lack GPU resources for large multimodal model inference
• you need simple text-to-speech rather than generative foley/sound effects

Facets

library · maturity active

machine-learning audio-processing llm-inference deep-learning artificial-intelligence machine-learning python text-to-audio video-to-audio foley-sound-synthesis chain-of-thought flow-matching aigc-audio pytorch multimodal audio-editing research-code audio video natural-language-processing gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="QwenAudio/ThinkSound")