modal-labs/quillman

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1213 stars · 158 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

QuiLLMan is a voice chat application built on Kyutai's Moshi speech-to-speech language model, deployed serverlessly on Modal with a FastAPI websocket backend and React frontend. It streams audio bidirectionally using the Opus codec and Mimi encoder/decoder for near-instantaneous, human-cadence voice conversations.

Use cases

• build a real-time voice chatbot with an LLM
• deploy a speech-to-speech AI assistant
• stream audio to a language model over websockets
• run Moshi voice model on serverless GPUs
• prototype a low-latency voice AI app
• learn how to serve streaming audio inference in the cloud

When to choose

• you want a working reference implementation of real-time voice chat with Moshi
• you want to deploy GPU inference serverlessly on Modal without managing infrastructure
• you need bidirectional websocket audio streaming with low latency
• you want a starting point for building your own LLM-based voice apps

When to avoid

• you need a production-ready commercial voice assistant out of the box
• you don't want a Modal account or its serverless platform
• you need on-premise or self-hosted deployment without cloud dependencies
• you need a text-only chatbot or traditional STT/TTS pipeline instead of speech-to-speech

Facets

application · maturity active

speech-recognition llm-inference websocket chatbot audio-processing artificial-intelligence large-language-models speech-processing chatbots web-development python cloud voice-chat moshi speech-to-speech bidirectional-streaming modal serverless-gpu opus-codec fastapi react-frontend web-server docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="modal-labs/quillman")