mayuelala/FollowYourPose

Health v2 · maintenance only

Adoption not part of the score

1358 stars · 96 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Official PyTorch implementation of Follow-Your-Pose (AAAI 2024), a pose-guided text-to-video generation model that tunes a text-to-image model like Stable Diffusion to generate character videos from pose sequences and text descriptions. It trains on pose-free videos and supports text-editable, pose-controllable video synthesis.

Use cases

• generate character videos from pose sequences and text prompts
• create pose-controllable digital human animations
• restyle a reference motion video with a text description
• generate cartoon or stylized dancing videos from skeleton poses
• research text-to-video diffusion model tuning
• animate a character in a given style following a pose video

When to choose

• you need pose-guided text-to-video generation with editable text prompts
• you want a research baseline or official implementation of the AAAI 2024 paper
• you have pose sequences (e.g., from OpenPose) and want to synthesize stylized character videos
• you want to fine-tune or extend a Stable Diffusion-based video generation model

When to avoid

• you need production-grade, high-resolution, long-duration video generation
• you have no GPU available, as inference and training are compute-heavy
• you want a polished end-user application rather than research code
• you need real-time video generation

Facets

library · maturity maintenance

video-processing machine-learning deep-learning stable-diffusion image-processing deep-learning computer-vision artificial-intelligence image-processing python text-to-video pose-guided-generation diffusion-models aigc research-code aaai-2024 character-animation video gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="mayuelala/FollowYourPose")