MeiGen-AI/MultiTalk

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

2992 stars · 497 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

MultiTalk is an audio-driven framework for generating multi-person conversational videos from multi-stream audio, a reference image, and a text prompt, with lip motions synchronized to each speaker. It supports conversation, singing, interaction control, and cartoon-style video generation.

Use cases

• generate talking head videos from audio
• create multi-person conversation videos with lip sync
• make a person sing from an audio track
• animate a reference photo to speak given dialogue audio
• generate cartoon character conversation videos
• control interactions between people in generated video

When to choose

• you need audio-driven video generation with accurate per-speaker lip sync
• you want to animate multiple people in one video from separate audio streams
• you need a research-grade, actively maintained model with published results (NeurIPS 2025)

When to avoid

• you need real-time or low-latency video generation
• you lack a GPU or cannot run heavy diffusion models
• you only need single-image animation without audio alignment

Facets

library · maturity active

video-processing machine-learning deep-learning audio-processing image-processing deep-learning computer-vision artificial-intelligence python talking-head-generation lip-sync audio-driven-video multi-person-conversation video-generation diffusion-models research-code neurips-2025 video audio gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="MeiGen-AI/MultiTalk")