YudongGuo/AD-NeRF

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1072 stars · 177 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A PyTorch implementation of AD-NeRF, an ICCV 2021 paper that synthesizes talking-head videos by driving neural radiance fields with audio input. It trains head and torso NeRFs from a portrait video and renders novel talking-head animations from arbitrary audio files.

Use cases

• generate a talking head video from audio
• animate a portrait photo or video with speech audio
• reconstruct a person's head and torso as a neural radiance field
• drive a target person's face with another person's audio
• research audio-driven neural rendering for talking head synthesis

When to choose

• you need research-grade audio-driven NeRF talking head synthesis
• you want to reproduce or build on the ICCV 2021 AD-NeRF paper
• you have a portrait video with voice audio and a GPU to train head and torso NeRFs

When to avoid

• you need fast real-time talking head generation
• you lack a GPU or the patience for per-identity NeRF training
• you want a production-ready application with a simple UI rather than research code

Facets

library · maturity maintenance

machine-learning deep-learning audio-processing video-processing graphics simulation deep-learning computer-vision artificial-intelligence python nerf talking-head audio-driven neural-radiance-fields face-synthesis pytorch research-code iccv-2021 audio video linux gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="YudongGuo/AD-NeRF")