QuentinFuxa/WhisperLiveKit

Health v2 · maintenance only

Adoption not part of the score

10962 stars · 1133 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

WhisperLiveKit is a self-hosted, ultra-low-latency real-time speech-to-text pipeline built on state-of-the-art simultaneous speech research (SimulWhisper, WhisperStreaming, Streaming Sortformer). It provides streaming transcription, speaker diarization, and simultaneous translation via WebSocket and OpenAI/Deepgram-compatible APIs.

Use cases

• transcribe live audio in real time locally
• add real-time captions to a meeting or stream
• diarize speakers in a live conversation
• translate speech simultaneously across 200 languages
• self-host an OpenAI-compatible transcription API
• build a voice assistant with low-latency ASR

When to choose

• you need low-latency streaming transcription rather than batch file transcription
• you want everything running locally without sending audio to cloud APIs
• you need speaker diarization or simultaneous translation alongside transcription
• you want an OpenAI/Deepgram-compatible endpoint you can drop into existing clients

When to avoid

• you only need to transcribe pre-recorded audio files offline
• you have no GPU and need high-throughput transcription
• you want a fully managed hosted service with no infrastructure to run

Facets

library · maturity active

speech-recognition websocket http-server api-framework nlp speech-processing machine-learning self-hosted python cross-platform whisper streaming-asr speaker-diarization simultaneous-translation fastapi pytorch transcription openai-compatible-api natural-language-processing real-time gpu web-server docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="QuentinFuxa/WhisperLiveKit")