jixiaozhong/Sonic

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

3273 stars · 291 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Sonic is the official PyTorch implementation of the CVPR 2025 paper 'Sonic: Shifting Focus to Global Audio Perception in Portrait Animation'. It animates a still portrait image using an audio clip to generate a talking-head video with natural motion and lip sync.

Use cases

• animate a portrait photo with audio to make a talking head video
• generate lip-synced avatar videos from a single image and voice clip
• create talking portrait animations for research on audio-driven video generation
• bring anime or sculpture images to life with speech audio
• reproduce CVPR 2025 portrait animation research results

When to choose

• you need audio-driven portrait animation from a single image
• you want a research-grade talking-head model with a paper backing
• you need non-photorealistic support like anime portraits
• you want to try it quickly via the Gradio or Hugging Face demo

When to avoid

• you need a commercially licensed solution - the license is CC BY-NC-SA (non-commercial)
• you lack a GPU or cannot run large diffusion models locally
• you need real-time streaming avatar generation
• you want a polished end-user app rather than a research codebase

Facets

library · maturity active

video-processing audio-processing machine-learning deep-learning image-processing computer-vision artificial-intelligence deep-learning python cross-platform portrait-animation talking-head audio-driven lip-sync cvpr-2025 diffusion non-commercial-license gradio-demo video audio gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="jixiaozhong/Sonic")