datascale-ai/opentalking

Health v2 · maintenance only

Flags: young

Adoption not part of the score

2897 stars · 580 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

OpenTalking is an open-source Python framework for building real-time AI digital-human (talking avatar) conversation products. It orchestrates a full pipeline including LLM, STT, TTS, interruption control, subtitles, WebRTC audio/video playback, and pluggable model backends like Wav2Lip, FlashTalk, and FasterLivePortrait.

Use cases

• build a real-time talking avatar chatbot
• deploy a private digital human assistant
• stream an LLM-driven avatar over WebRTC
• create lip-synced talking head videos from audio
• clone a digital human from an uploaded video
• run a self-hosted voice conversation agent with TTS and STT

When to choose

• you need an end-to-end, self-hosted digital-human conversation stack
• you want pluggable LLM/STT/TTS and lip-sync model backends
• you need real-time WebRTC streaming with interruption handling
• you want video creation or avatar cloning workflows included

When to avoid

• you only need a simple text chatbot without an avatar
• you need a fully managed cloud service rather than self-hosting
• you lack GPU resources for the video model backends
• you need a lightweight avatar renderer rather than a full pipeline

Facets

framework · maturity active

llm-inference tts speech-recognition rag chatbot web-framework websocket video-processing audio-processing agent-framework artificial-intelligence large-language-models chatbots speech-processing web-development self-hosted python self-hosted cross-platform digital-human avatar webrtc talking-head lip-sync wav2lip liveportrait real-time-conversation private-deployment virtual-assistant real-time docker web-server gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="datascale-ai/opentalking")