Open-source speech-processing software
556 open-source libraries, tools and applications tagged speech-processing, ranked by how closely speech-processing is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
556 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| openai/whisper OpenAI's Whisper is a general-purpose speech recognition model and Python library built on a Transformer sequence-to-sequence architecture.… | 64 | 109525 | stable |
| debpalash/VoiceStudio VoiceStudio is an open‑source desktop application that provides local text‑to‑speech, voice cloning, transcription and video dubbing across… | 81 | 73493 | active |
| RVC-Boss/GPT-SoVITS GPT-SoVITS is a Python-based few-shot voice cloning and text-to-speech system with an integrated WebUI. It supports zero-shot TTS from a 5-… | 65 | 62169 | active |
| jamiepine/voicebox Voicebox is an open‑source, local‑first AI voice studio that lets you clone voices, generate speech in many languages, and dictate into any… | 74 | 57872 | active |
| microsoft/VibeVoice VibeVoice is an open‑source framework for high‑quality text‑to‑speech and speech‑to‑text generation. It combines autoregressive and diffusi… | 60 | 54432 | active |
| ggml-org/whisper.cpp A high-performance C/C++ port of OpenAI's Whisper automatic speech recognition model with no external dependencies. It supports CPU, GPU (M… | 99 | 54397 | stable |
| 2noise/ChatTTS ChatTTS is a generative text-to-speech model optimized for conversational dialogue scenarios such as LLM assistants, supporting English and… | 64 | 39885 | active |
| OpenBMB/VoxCPM VoxCPM is a tokenizer-free text-to-speech system built on a diffusion autoregressive architecture that generates continuous speech represen… | 74 | 37924 | active |
| myshell-ai/OpenVoice OpenVoice is a Python library and audio foundation model for instant voice cloning, requiring only a short reference audio clip to replicat… | 31 | 37608 | active |
| cjpais/Handy Handy is a free, open‑source desktop application that transcribes spoken words into text locally on your computer. It works on Windows, mac… | 83 | 33373 | active |
| Fish Speech Fish Speech is an open‑source, state‑of‑the‑art text‑to‑speech system built on transformer and VITS architectures. It provides a Python lib… | 70 | 33062 | active |
| Fish Speech Fish Speech is an open-source state-of-the-art text-to-speech system (Fish Audio S2) trained on over 10 million hours of audio across ~50 l… | 70 | 33062 | active |
| XiaoZhi AI Chatbot XiaoZhi is an ESP32‑based chatbot that runs large language models via the MCP protocol, offering voice interaction, device control, and mul… | 91 | 31445 | active |
| XiaoZhi AI Chatbot XiaoZhi is an open-source MCP-based AI voice chatbot firmware for ESP32-family microcontrollers, connecting large language models like Qwen… | 91 | 31445 | active |
| Zackriya-Solutions/meetily Meetily is a privacy‑first AI meeting assistant that records, transcribes, diarizes speakers and generates summaries of meetings. It runs e… | 81 | 31410 | active |
| svc-develop-team/so-vits-svc SoftVC VITS is an open‑source Python application for singing voice conversion, allowing a source voice to be transformed into another targe… | 10 | 28100 | active |
| resemble-ai/chatterbox Chatterbox is a family of state-of-the-art open-source text-to-speech models by Resemble AI, including multilingual and low-latency Turbo v… | 49 | 26574 | active |
| mozilla-ai/llamafile Llamafile packages LLMs and Whisper models into a single, portable executable. It runs locally on most operating systems without any instal… | 90 | 26224 | active |
| SYSTRAN/faster-whisper A fast reimplementation of OpenAI's Whisper speech-to-text model built on the CTranslate2 inference engine, offering up to 4x speedup and l… | 52 | 25631 | active |
| m-bain/whisperX WhisperX is a Python library providing fast automatic speech recognition with word-level timestamps and speaker diarization. It combines Wh… | 92 | 24736 | active |
| index-tts/index-tts IndexTTS is an industrial-level zero-shot text-to-speech system that clones a voice from a single reference audio clip. The latest IndexTTS… | 76 | 24518 | active |
| QwenAudio/CosyVoice CosyVoice is a multilingual large voice generation model (TTS) with full-stack inference, training, and deployment support. It offers zero-… | 58 | 23763 | active |
| chidiwilliams/buzz Buzz is a cross-platform desktop application that transcribes and translates audio and video offline using OpenAI's Whisper models. It offe… | 92 | 21899 | active |
| modelscope/FunASR FunASR is an open-source Python toolkit for speech recognition, offering offline, streaming, and edge deployment capabilities. It includes … | 93 | 20568 | active |
| DrewThomasson/ebook2audiobook ebook2audiobook is an open‑source Python tool that converts e‑books (ePub, PDF, etc.) into audiobooks using advanced TTS and voice‑cloning … | 93 | 20335 | active |
| nari-labs/dia Dia is a 1.6B-parameter open-weight text-to-speech model from Nari Labs that generates ultra-realistic multi-speaker dialogue in a single p… | 40 | 19401 | active |
| Pipecat Pipecat is an open-source Python framework (BSD-2) for building real-time voice and multimodal conversational AI agents. It orchestrates sp… | 89 | 16579 | active |
| KittenML/KittenTTS KittenTTS is an open-source, ultra-lightweight text-to-speech library built on ONNX, with models ranging from 15M to 80M parameters (25-80 … | 66 | 16161 | active |
| k2-fsa/sherpa-onnx sherpa-onnx is an offline speech processing toolkit built on next-gen Kaldi and onnxruntime, supporting speech-to-text, text-to-speech, spe… | 94 | 15357 | active |
| SWivid/F5-TTS F5-TTS is the official implementation of a fully non-autoregressive text-to-speech system based on flow matching with a Diffusion Transform… | 84 | 15313 | active |
| Vosk Vosk is an offline open source speech recognition toolkit supporting 20+ languages with small models and a streaming API. It provides bindi… | 62 | 15164 | stable |
| livekit/agents LiveKit Agents is an open-source framework for building realtime, multimodal voice AI agents that run as programmable participants in LiveK… | 91 | 14870 | active |
| k2-fsa/OmniVoice OmniVoice is a massively multilingual zero-shot text-to-speech model supporting 600+ languages, built on a diffusion language model-style a… | 77 | 14762 | active |
| SesameAILabs/csm CSM (Conversational Speech Model) is Sesame's speech generation model that produces conversational audio from text and audio context, using… | 27 | 14728 | active |
| QwenLM/Qwen3-TTS Qwen3-TTS is a series of open-source text-to-speech models from Alibaba's Qwen team, supporting expressive and streaming speech generation,… | 45 | 13545 | active |
| huggingface/speech-to-speech A low-latency, fully modular voice-agent pipeline (VAD -> STT -> LLM -> TTS) built from open-source models, exposed via the OpenAI Realtime… | 85 | 13485 | active |
| Vaibhavs10/insanely-fast-whisper A CLI tool for transcribing audio files on-device using OpenAI's Whisper models, powered by Hugging Face Transformers, Optimum, and Flash A… | 46 | 13063 | active |
| abus-aikorea/voice-pro Voice-Pro is a Gradio-based web UI for AI speech processing, combining TTS engines (Edge-TTS, kokoro), zero-shot voice cloning (E2/F5-TTS, … | 79 | 12967 | active |
| PaddleSpeech PaddleSpeech is an open-source speech and audio toolkit built on the PaddlePaddle deep learning platform, covering ASR with punctuation, st… | 63 | 12689 | active |
| rany2/edge-tts A Python module and CLI that lets you use Microsoft Edge's online neural text-to-speech service without needing Edge, Windows, or an API ke… | 73 | 12021 | active |
| altic-dev/FluidVoice FluidVoice is an open-source (GPLv3) macOS dictation app that transcribes speech to text entirely on-device using models like Parakeet, Whi… | 83 | 11931 | active |
| facebookresearch/seamless_communication A library of foundational multilingual multimodal AI models from Meta for speech and text translation, including SeamlessM4T, SeamlessExpre… | 71 | 11889 | active |
| SpeechBrain SpeechBrain is an open-source PyTorch-based speech toolkit for building conversational AI systems. It provides training recipes, pretrained… | 85 | 11845 | active |
| CorentinJ/Real-Time-Voice-Cloning A Python implementation of the SV2TTS (Transfer Learning from Speaker Verification to Multispeaker TTS) framework that clones a voice from … | 61 | 60174 | maintenance |
| kyutai-labs/moshi Moshi is a speech-text foundation model and full-duplex spoken dialogue framework from Kyutai, built around the Mimi streaming neural audio… | 56 | 11263 | active |
| TEN-framework/ten-framework TEN is an open-source framework for building real-time multimodal conversational AI agents, with a focus on low-latency voice assistants. I… | 86 | 11173 | active |
| Moonshine Voice Moonshine Voice is an open-source on-device AI toolkit providing very low latency speech-to-text, intent recognition, and text-to-speech fo… | 84 | 11126 | active |
| WhisperLiveKit WhisperLiveKit is a self-hosted, ultra-low-latency real-time speech-to-text pipeline built on state-of-the-art simultaneous speech research… | 85 | 11096 | active |
| SparkAudio/Spark-TTS Spark-TTS is an LLM-based text-to-speech system built on Qwen2.5 that generates speech directly from single-stream decoupled speech tokens.… | 24 | 10998 | active |
| xiaozhi-esp32 A self-hosted backend server for the xiaozhi-esp32 open-source smart hardware project, implementing the Xiaozhi communication protocol over… | 83 | 10810 | active |
| nexmoe/VidBee VidBee is a free, open-source Electron desktop app for downloading video and audio from 1000+ sites (via yt-dlp) and importing local media.… | 80 | 10689 | active |
| pyannote.audio pyannote.audio is an open-source Python toolkit built on PyTorch for speaker diarization, providing neural building blocks like voice activ… | 92 | 10593 | active |
| NVIDIA/personaplex PersonaPlex is a real-time, full-duplex speech-to-speech conversational model from NVIDIA that supports persona control via text role promp… | 44 | 10567 | active |
| snakers4/silero-vad Silero VAD is a pre-trained, enterprise-grade Voice Activity Detector model available via PyPI, runnable with PyTorch or ONNX Runtime. It d… | 93 | 10317 | stable |
| open-mmlab/Amphion Amphion is an open-source Python toolkit for audio, music, and speech generation, supporting tasks like text-to-speech, voice conversion, s… | 48 | 10304 | active |
| KoljaB/RealtimeSTT RealtimeSTT is a Python library for low-latency, real-time speech-to-text with voice activity detection, wake word activation, and streamin… | 94 | 10194 | active |
| ESPnet ESPnet is an end-to-end speech processing toolkit built on PyTorch covering speech recognition, text-to-speech, speech translation, enhance… | 94 | 9989 | active |
| kyutai-labs/pocket-tts Pocket TTS is a lightweight 100M-parameter text-to-speech model and Python library from Kyutai that runs efficiently on CPUs without a GPU.… | 83 | 9923 | active |
| OpenWhispr/openwhispr OpenWhispr is an open-source, privacy-first voice-to-text dictation desktop app for macOS, Windows, and Linux. It supports fully local tran… | 83 | 9595 | active |
| QwenAudio/SenseVoice SenseVoice is an open-source speech foundation model (SenseVoiceSmall) providing multilingual ASR, spoken language identification, speech e… | 87 | 9386 | active |
| Kokoro TTS An inference library for Kokoro-82M, an open-weight text-to-speech model with 82 million parameters that delivers quality comparable to lar… | 34 | 9340 | active |
| coqui-ai/TTS Coqui TTS is a deep learning toolkit for text-to-speech synthesis, providing pretrained models in over 1100 languages plus tools for traini… | 23 | 46107 | maintenance |
| Uberi/speech_recognition A Python library for performing speech recognition with support for multiple engines and APIs, both online (Google, Azure, Wit.ai, OpenAI W… | 90 | 8994 | active |
| jianchang512/clone-voice A voice cloning tool with a web interface built on the coqui.ai xtts_v2 model, letting users synthesize speech in any voice from text or co… | 10 | 8969 | active |
| santinic/audiblez Audiblez is a Python CLI tool (with an optional GUI) that converts .epub e-books into .m4b audiobooks using the Kokoro-82M text-to-speech m… | 49 | 8675 | active |
| jasonppy/VoiceCraft VoiceCraft is a token infilling neural codec language model for zero-shot speech editing and text-to-speech on in-the-wild data like audiob… | 60 | 8576 | active |
| netease-youdao/EmotiVoice EmotiVoice is an open-source text-to-speech engine supporting English and Chinese with over 2000 voices and prompt-controlled emotional syn… | 60 | 8529 | active |
| ASRT SpeechRecognition ASRT is a deep-learning-based Chinese speech recognition (speech-to-text) system built with TensorFlow/Keras, using CNN, LSTM, attention me… | 53 | 8391 | active |
| GetStream/Vision-Agents An open-source Python framework by Stream for building low-latency real-time voice and video AI agents. It provides 35+ provider plugins (O… | 83 | 8172 | active |
| suno-ai/bark Bark is Suno's open-source transformer-based text-to-audio model that generates highly realistic multilingual speech, music, background noi… | 31 | 39276 | maintenance |
| MLX-Audio MLX-Audio is a Python library built on Apple's MLX framework for fast text-to-speech (TTS), speech-to-text (STT), and speech-to-speech (STS… | 88 | 8012 | active |
| thewh1teagle/vibe Vibe is a cross-platform desktop app for fully offline audio and video transcription using Whisper, Nemotron, and Parakeet models. It suppo… | 91 | 7673 | active |
| jianchang512/ChatTTS-ui A local web interface for the ChatTTS text-to-speech model that synthesizes speech from mixed Chinese/English text, numbers, and symbols. I… | 65 | 7664 | active |
| myshell-ai/MeloTTS MeloTTS is a high-quality multi-lingual text-to-speech library supporting English (multiple accents), Spanish, French, Chinese, Japanese, a… | 17 | 7644 | active |
| babysor/MockingBird MockingBird is a PyTorch-based AI voice cloning toolbox that can clone a voice from a 5-second sample and generate arbitrary speech in real… | 51 | 36895 | maintenance |
| Zyphra/Zonos Zonos-v0.1 is an open-weight text-to-speech model trained on over 200k hours of multilingual speech, with a Python library for inference. I… | 22 | 7236 | active |
| wzpan/wukong-robot wukong-robot is a modular Chinese-language voice assistant / smart speaker project in Python that combines offline wake-word detection, ASR… | 32 | 7127 | active |
| openai/openai-realtime-agents A Next.js TypeScript demo application showcasing advanced agentic patterns (Chat-Supervisor and Sequential Handoff) built on the OpenAI Rea… | 45 | 6989 | active |
| CapsWriter-Offline CapsWriter-Offline is a fully offline voice input tool for Windows that transcribes speech to text when you hold CapsLock or mouse side but… | 88 | 6955 | active |
| espeak-ng/espeak-ng eSpeak NG is a compact open-source text-to-speech synthesizer supporting over 100 languages and accents, using formant synthesis for small … | 66 | 6937 | active |
| PaddlePaddle/models PaddlePaddle's officially maintained industry-grade model repository containing 600+ models across computer vision, NLP, speech, recommenda… | 23 | 6931 | active |
| TalAter/annyang annyang is a tiny (2 KB), dependency-free JavaScript library that adds speech recognition and voice commands to websites using the Web Spee… | 72 | 6818 | stable |
| Beingpax/VoiceInk VoiceInk is a native macOS voice-to-text dictation app that transcribes speech to text almost instantly using local AI models (Parakeet, Wh… | 84 | 6693 | active |
| WhisperKit A Swift SDK providing turn-key on-device speech AI frameworks for Apple Silicon, including WhisperKit (speech-to-text with Whisper), Speake… | 89 | 6397 | active |
| StyleTTS StyleTTS 2 is a PyTorch text-to-speech model that uses style diffusion and adversarial training with large speech language models (e.g., Wa… | 30 | 6362 | active |
| canopyai/Orpheus-TTS Orpheus TTS is an open-source text-to-speech system built on a Llama-3b backbone that produces human-sounding speech with emotion control a… | 42 | 6347 | active |
| modelscope/FunClip FunClip is an open-source, locally deployed video clipping tool that uses FunASR Paraformer models for speech recognition and subtitle gene… | 93 | 6337 | active |
| neuphonic/neutts NeuTTS is a collection of open-source, on-device text-to-speech models built on small LLM backbones, with instant voice cloning from as lit… | 57 | 6286 | active |
| tyiannak/pyAudioAnalysis pyAudioAnalysis is a Python library for audio analysis covering feature extraction (MFCCs, spectrograms, chromagrams), supervised and unsup… | 44 | 6268 | active |
| bytedance/MegaTTS3 MegaTTS 3 is ByteDance's open-source PyTorch text-to-speech model with a lightweight 0.45B-parameter Diffusion Transformer backbone. It pro… | 56 | 6096 | active |
| dograh-hq/dograh Dograh is an open-source, self-hostable voice AI platform for building production voice agents, positioned as an alternative to Vapi and Re… | 85 | 5903 | active |
| xiph/rnnoise RNNoise is a C library that uses a hybrid DSP/recurrent neural network approach for real-time full-band speech noise suppression. It also s… | 23 | 5878 | stable |
| Piper Text-to-Speech Piper is a fast, fully local neural text-to-speech engine that embeds espeak-ng for phonemization and ships with a CLI, HTTP web server, Py… | 85 | 5821 | active |
| SmartSub SmartSub (妙幕) is a free, open-source cross-platform desktop application that provides an end-to-end subtitle and dubbing pipeline: speech-t… | 92 | 5776 | active |
| dnhkng/GLaDOS A real-life implementation of GLaDOS, the sardonic AI from Valve's Portal series, built as a proactive voice assistant with vision, memory,… | 66 | 5735 | active |
| MahmoudAshraf97/whisper-diarization A pipeline that combines OpenAI Whisper transcription with speaker diarization using Voice Activity Detection (MarbleNet) and speaker embed… | 72 | 5664 | active |
| xiangyuecn/Recorder A JavaScript HTML5 audio recording library for browsers and hybrid apps, supporting mp3, wav, pcm, ogg, amr, webm, and g711 formats with re… | 77 | 5638 | active |
| Parler‑TTS Parler-TTS is a lightweight text-to-speech library from Hugging Face that generates high-quality, natural-sounding speech controllable via … | 26 | 5587 | active |
| modstart-lib/aigcpanel AIGCPanel is an open-source, all-in-one AI digital human desktop application built with TypeScript, Vue3, and Electron for Windows, macOS, … | 86 | 5572 | active |
| remsky/Kokoro-FastAPI A Dockerized FastAPI wrapper around the Kokoro-82M text-to-speech model exposing an OpenAI-compatible speech endpoint with CPU, NVIDIA, AMD… | 87 | 5543 | active |
page 1 / 6 next →