Fantasy-AMAP/fantasy-talking

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1628 stars · 128 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

FantasyTalking is a research codebase and model for generating realistic talking portrait videos from a single image and an audio clip, built on the Wan2.1 video diffusion transformer with audio-visual alignment. It provides inference scripts and pretrained weights for lip-synced, motion-controllable avatar generation.

Use cases

• generate a talking head video from a photo and audio
• make a portrait lip-sync to speech
• animate a static face with realistic expressions and body motion
• control expression and motion intensity of an avatar
• research audio-driven portrait video generation
• integrate talking-head generation into ComfyUI workflows

When to choose

• you need high-fidelity, research-grade talking portrait generation from a single image
• you want controllable motion intensity and identity preservation beyond simple lip-sync
• you have GPU resources and want to build on Wan2.1 diffusion transformer models

When to avoid

• you need a lightweight real-time lip-sync tool for production apps
• you lack a GPU or cannot download multi-gigabyte base models
• you need training code or a polished end-user application rather than inference scripts

Facets

library · maturity active

video-processing machine-learning deep-learning audio-processing llm-inference deep-learning computer-vision artificial-intelligence python talking-head diffusion-models diffusion-transformer lip-sync audio-driven-avatar portrait-animation acm-mm-2025 research-code video audio linux gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Fantasy-AMAP/fantasy-talking")