hecomi/uLipSync

Health v2 · maintenance only

Adoption not part of the score

1660 stars · 195 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

uLipSync is a Unity plug-in that performs lip-sync by analyzing audio in real time or pre-baked, extracting MFCC features via the Job System and Burst Compiler without native plugins. It maps detected phonemes to character blend shapes, with per-character calibration profiles, Timeline integration, AnimationClip baking, VRM support, and WebGL builds.

Use cases

• lip sync a Unity character from audio clips
• drive VRM avatar mouth blendshapes from microphone input
• pre-bake lip sync animation for cutscenes with Timeline
• real-time voice-driven avatar animation for streaming
• bake lip sync to AnimationClip for offline playback
• cross-platform lip sync in Unity without native plugins

When to choose

• you need lip sync in Unity across many platforms including WebGL with no native dependencies
• you want per-character calibration profiles or Timeline/AnimationClip pre-bake workflows
• you use VRM avatars or need runtime microphone-driven lip sync

When to avoid

• you need out-of-the-box phoneme accuracy comparable to OVRLipSync without tuning
• your project is not Unity-based
• you need full speech recognition rather than vowel/consonant estimation

Facets

plugin · maturity active

audio-processing machine-learning animation plugin-system computer-vision cross-platform game-engine windows unity lip-sync mfcc burst-compiler job-system vrm timeline microphone-input blendshapes vtuber game-development audio real-time webgl macos linux android ios

Member repositories

For agents

markdown · JSON · MCP: product_card(name="hecomi/uLipSync")