collabora/WhisperFusion

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1647 stars · 126 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

WhisperFusion is a real-time voice chat application that combines WhisperLive speech-to-text, a Mistral/Phi LLM, and WhisperSpeech text-to-speech for ultra-low latency AI conversations. It runs the models as optimized TensorRT engines on a single NVIDIA GPU with a web-based GUI.

Use cases

• talk to an AI assistant by voice with ultra-low latency
• build a real-time speech-to-speech chatbot
• run a local voice assistant on an RTX 4090 GPU
• demo low-latency LLM voice conversations
• integrate Whisper transcription with an LLM and speech synthesis

When to choose

• you need real-time voice conversations with an AI on NVIDIA GPUs
• you want a self-hosted speech-to-text + LLM + TTS pipeline
• you need minimal latency between speaking and hearing a response

When to avoid

• you lack a 24GB+ NVIDIA GPU
• you need a production-ready, licensed product
• you want cloud-hosted or CPU-only voice assistants

Facets

application · maturity experimental

speech-recognition llm-inference tts chatbot gpu-computing artificial-intelligence large-language-models speech-processing python voice-assistant tensorrt real-time-conversation whisper low-latency real-time linux gpu docker web-server

Member repositories

For agents

markdown · JSON · MCP: product_card(name="collabora/WhisperFusion")