OpenTalker/SadTalker

Health v2 · maintenance only

Flags: no_license

Adoption not part of the score

14040 stars · 2691 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

SadTalker is a CVPR 2023 deep learning tool that generates realistic talking head videos from a single portrait image and an audio clip by predicting 3DMM motion coefficients (head pose, expression) from audio. It is available as a Python codebase with Gradio demos, Hugging Face Spaces, Colab, and Stable Diffusion WebUI integrations.

Use cases

• animate a portrait photo with speech audio
• generate talking head video from a single image
• create lip-synced avatar videos from voice recordings
• make a digital avatar speak from text-to-speech audio
• research audio-driven face animation
• produce deepfake-style talking face videos

When to choose

• you need to animate a single still portrait with an audio track
• you want a research-grade, widely cited talking-head generation model
• you want ready-made demos via Hugging Face, Colab, or Stable Diffusion WebUI
• you need controllable head pose and expression styles

When to avoid

• you need real-time lip sync for live streaming or video calls
• you require full-body avatar animation rather than a single face
• you need a commercially supported product with SLAs
• you lack a GPU and cannot tolerate slow inference

Facets

application · maturity maintenance

deep-learning video-processing audio-processing machine-learning llm-inference deep-learning computer-vision artificial-intelligence python cross-platform talking-head talking-face-generation audio-driven-animation deepfake face-animation cvpr2023 3dmm generative-ai audio video gpu docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="OpenTalker/SadTalker")