pipecat-ai/pipecat

Health v2 · maintenance only

Adoption not part of the score

14769 stars · 2556 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Pipecat is an open-source Python framework (BSD-2) for building real-time voice and multimodal conversational AI agents. It orchestrates speech recognition, LLMs, text-to-speech, and transports like WebRTC, WebSocket, SIP, and PSTN into composable, ultra-low-latency pipelines with support for single agents and distributed multi-agent systems.

Use cases

• build a voice assistant that talks to users in a browser
• create a real-time AI phone agent over SIP or PSTN
• build a multimodal agent that sees and hears via video and audio
• orchestrate multiple AI agents that hand off or fan out in parallel
• build a customer support or intake voice bot
• create an AI companion or meeting assistant
• stream speech-to-text, LLM, and text-to-speech with low latency
• swap between 150+ AI providers for STT, LLM, and TTS in one pipeline

When to choose

• you need real-time, low-latency voice or video AI agents in Python
• you want pluggable pipelines that work with many AI providers
• you need interruption handling, turn detection, and natural conversation flow
• you want client SDKs for web, mobile, and native platforms
• you plan to scale from a single bot to distributed multi-agent systems

When to avoid

• you only need offline batch speech transcription or TTS without real-time interaction
• you need a non-Python language for the server-side agent logic
• you want a fully managed turnkey voice bot with no code
• your use case is simple text-only chat without audio or video

Facets

framework · maturity active

agent-framework speech-recognition tts llm-inference websocket chatbot rag streaming middleware cli artificial-intelligence chatbots speech-processing large-language-models web-development developer-tools python cross-platform self-hosted cloud voice-agents realtime-ai multimodal webrtc sip voice-assistant pipeline-orchestration multi-agent stt tts conversational-ai ai-agents real-time web-server docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="pipecat-ai/pipecat")