Open-source speech-processing software
556 open-source libraries, tools and applications tagged speech-processing, ranked by how closely speech-processing is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
556 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| ysharma3501/LuxTTS LuxTTS is a lightweight zipvoice-based text-to-speech model for high-quality zero-shot voice cloning, generating clear 48kHz speech at up t… | 51 | 5433 | active |
| wenet-e2e/wenet WeNet is a production-first, end-to-end automatic speech recognition (ASR) toolkit built on PyTorch with transformer/conformer models. It p… | 65 | 5243 | active |
| Plachtaa/VITS-fast-fine-tuning A Python pipeline for fast fine-tuning of VITS text-to-speech models, enabling speaker adaptation in under an hour from short audio, long a… | 10 | 5009 | active |
| Picovoice/porcupine Porcupine is a highly-accurate, lightweight on-device wake word detection engine powered by deep neural networks. It enables always-listeni… | 71 | 4945 | stable |
| jianchang512/stt An offline local speech-to-text tool based on faster-whisper models that transcribes audio and video files into JSON, SRT subtitles, or pla… | 42 | 4829 | active |
| Rikorose/DeepFilterNet DeepFilterNet is a low-complexity speech enhancement framework that performs real-time noise suppression on full-band 48kHz audio using dee… | 23 | 4757 | active |
| Kimi-Audio Kimi-Audio is an open-source audio foundation model (7B parameters) that unifies audio understanding, generation, and speech conversation i… | 28 | 4736 | active |
| WhisperSpeech/WhisperSpeech WhisperSpeech is an open-source text-to-speech system built by inverting OpenAI's Whisper model, aiming to be 'Stable Diffusion for speech'… | 54 | 4652 | active |
| gradio-app/fastrtc FastRTC is a Python library that turns any Python function into a real-time audio and video stream over WebRTC or WebSockets. It includes b… | 53 | 4631 | active |
| fixie-ai/ultravox Ultravox is a fast multimodal LLM that understands human speech directly without a separate ASR stage, by projecting audio into the LLM's e… | 40 | 4577 | active |
| tts-server An Android system-wide text-to-speech (TTS) app that provides a TTS engine service with built-in Microsoft demo API support, custom HTTP TT… | 66 | 4520 | active |
| modelscope/ClearerVoice-Studio ClearerVoice-Studio is an open-source, AI-powered speech processing toolkit from ModelScope/Alibaba offering state-of-the-art pretrained mo… | 35 | 4515 | active |
| PocketSphinx PocketSphinx is Carnegie Mellon's lightweight, speaker-independent continuous speech recognition engine, available as a C library, a comman… | 79 | 4350 | active |
| collabora/WhisperLive WhisperLive is a nearly-live speech-to-text application built on OpenAI's Whisper, serving real-time transcription over WebSocket and REST … | 91 | 4311 | active |
| tmoroney/auto-subs AutoSubs is a local-first desktop application that generates AI subtitles on-device using Whisper, Moonshine, and Parakeet models, with spe… | 96 | 4302 | active |
| leetcode-mafia/cheetah Cheetah is a macOS app that provides real-time AI coaching for software engineering interviews. It transcribes conversation audio locally w… | 21 | 4260 | active |
| echo-loop/Echo-Loop Echo Loop is an open-source Flutter-based English listening and speaking training app that guides learners through a structured listen-to-s… | 81 | 4163 | active |
| MOSS-TTS MOSS-TTS-Nano is an open-source 0.1B-parameter multilingual speech generation (TTS) model from MOSI.AI and the OpenMOSS team, designed for … | 58 | 4137 | active |
| huggingface/distil-whisper Distil-Whisper is a distilled version of OpenAI's Whisper model for English speech recognition, offering 6x faster inference, 49% fewer par… | 28 | 4120 | active |
| QwenLM/Qwen2.5-Omni Qwen2.5-Omni is an end-to-end multimodal model from Alibaba's Qwen team that understands text, images, audio, and video, and generates stre… | 29 | 4075 | active |
| KoljaB/RealtimeTTS RealtimeTTS is a Python library that converts text, generators, and LLM token streams into speech audio with low latency. It supports multi… | 95 | 4042 | active |
| QwenLM/Qwen3-Omni Qwen3-Omni is a natively end-to-end omni-modal large language model from Alibaba Cloud's Qwen team that understands text, images, audio, an… | 49 | 4028 | active |
| Speakr Speakr is a self-hosted web application that transcribes audio recordings and turns them into organized, searchable notes. It supports mult… | 84 | 3987 | active |
| digimata/quill Quill is an ultra-minimalist, fully local macOS meeting recorder and transcriber that runs as a single Swift menu-bar binary. It records mi… | 57 | 3938 | active |
| openai/openai-agents-js A lightweight, provider-agnostic TypeScript/JavaScript framework from OpenAI for building multi-agent LLM workflows, including text agents,… | 82 | 3921 | active |
| Open-Less/openless OpenLess is an open-source cross-platform voice input application that lets users hold a hotkey, speak, and have AI-polished text inserted … | 79 | 3811 | active |
| SakiRinn/LiveCaptions-Translator A lightweight Windows application that combines the built-in Windows 11 LiveCaptions speech-to-text feature with translation APIs (includin… | 72 | 3769 | active |
| speaches-ai/speaches Speaches is an OpenAI API-compatible self-hosted server for speech-to-text (via faster-whisper), translation, and text-to-speech (via Kokor… | 75 | 3689 | active |
| facebookresearch/sam-audio SAM-Audio is Meta's foundation model for isolating any sound in audio using text, visual, or temporal prompts. This repository provides inf… | 52 | 3654 | active |
| kaldi-asr/kaldi Kaldi is a C++ toolkit for speech recognition research and development, including acoustic modeling, feature extraction, decoding, and spea… | 48 | 15502 | maintenance |
| 0xShug0/audio.cpp audio.cpp is a pure C++ inference engine for audio models built on ggml, supporting TTS, STT, VAD, voice conversion, music generation, and … | 82 | 3646 | active |
| Qwen3-ASR Qwen3-ASR is a family of open-source speech recognition models from Alibaba's Qwen team, supporting ASR and language identification across … | 52 | 3605 | active |
| Soul-AILab/SoulX-Podcast SoulX-Podcast is the official inference codebase for a text-to-speech model that generates long-form, multi-turn, multi-speaker podcast-sty… | 39 | 3561 | active |
| neonbjb/tortoise-tts Tortoise TTS is a multi-voice text-to-speech library built on PyTorch that prioritizes highly realistic prosody and intonation. It combines… | 32 | 14877 | maintenance |
| huangjunsen0406/py-xiaozhi py-xiaozhi is an open-source, cross-platform multimodal AI voice assistant client written in Python, compatible with the xiaozhi-esp32 ecos… | 84 | 3513 | active |
| Mozilla Common Voice Mozilla Common Voice is a web platform for crowdsourcing voice donations to build public-domain speech datasets for training voice recognit… | 99 | 3493 | active |
| Linly Digital Human System Linly-Talker is a Python-based digital avatar conversational system that combines LLMs (Linly, Qwen, Gemini), speech recognition (Whisper, … | 44 | 3468 | active |
| WEIFENG2333/AsrTools AsrTools is a Python desktop application with a PyQt5-based GUI that converts audio and video files to text using online ASR engines, witho… | 34 | 3465 | active |
| libAudioFlux/audioFlux audioFlux is a C-based library with Python bindings for audio and music analysis and feature extraction. It supports dozens of time-frequen… | 50 | 3372 | active |
| ahmetoner/whisper-asr-webservice A Dockerized REST webservice that wraps OpenAI Whisper (plus Faster Whisper and WhisperX engines) for automatic speech recognition. It expo… | 95 | 3352 | active |
| xenova/whisper-web A browser-based speech recognition app that runs OpenAI's Whisper models entirely client-side using Transformers.js. It transcribes audio w… | 31 | 3345 | active |
| Opus libopus is the reference implementation of the Opus audio codec, an IETF-standardized (RFC 6716) royalty-free codec for interactive speech … | 65 | 3330 | stable |
| wendy7756/AI-Video-Transcriber An open-source AI tool that transcribes, summarizes, and archives videos and podcasts from 30+ platforms (YouTube, TikTok, Bilibili, etc.) … | 61 | 3314 | active |
| rsxdalv/TTS-WebUI TTS WebUI is a free, open-source web interface combining Gradio and React that unifies 30+ AI models for text-to-speech, voice conversion, … | 92 | 3274 | active |
| VOICEVOX VOICEVOX is a free, mid-quality text-to-speech (and singing synthesis) software whose editor is built with Electron, TypeScript, and Vue. I… | 90 | 3256 | active |
| MisoLabsAI/MisoTTS Miso TTS 8B is an open-source text-to-speech model based on an RVQ Transformer architecture with a Llama 3.2-style 8B backbone, designed fo… | 49 | 3240 | active |
| zai-org/GLM-4-Voice GLM-4-Voice is an end-to-end bilingual (Chinese/English) speech dialogue model from Zhipu AI, built on GLM-4-9B with a speech tokenizer and… | 22 | 3237 | active |
| Purfview/whisper-standalone-win Standalone Windows/Linux/macOS executables of OpenAI's Whisper and Faster-Whisper that transcribe audio and video to text and subtitles wit… | 44 | 3194 | active |
| matthartman/ghost-pepper A free, open-source macOS menu bar app providing fully on-device speech-to-text dictation and meeting transcription using local Whisper, Pa… | 72 | 3186 | active |
| modelscope/3D-Speaker 3D-Speaker is an open-source Python toolkit for single- and multi-modal speaker verification, speaker recognition, and speaker diarization,… | 53 | 3148 | active |
| BayLing-Models/BayLing-Speech LLaMA-Omni is an end-to-end speech interaction model built on Llama-3.1-8B-Instruct that generates simultaneous text and speech responses f… | 30 | 3144 | active |
| FluidAudio A Swift SDK providing fully local, low-latency audio AI on Apple devices, including speech-to-text (Parakeet), speaker diarization (Pyannot… | 82 | 3139 | active |
| ElevenLabs API SDKs The official Python SDK for the ElevenLabs API, providing programmatic access to text-to-speech, speech-to-text, voice cloning, dubbing, mu… | 93 | 3138 | active |
| HeyWillow/willow Willow is an open source, self-hosted voice assistant platform for ESP32-S3-BOX hardware, designed as a privacy-focused alternative to Amaz… | 84 | 3127 | active |
| AutoArk/GPA GPA (General Purpose Audio) is a unified autoregressive audio-language model that performs text-to-speech, automatic speech recognition, an… | 51 | 3109 | active |
| kyutai-labs/delayed-streams-modeling Kyutai's repository of Speech-To-Text and Text-To-Speech models built on the Delayed Streams Modeling framework, with implementations in Py… | 44 | 3041 | active |
| CheshireCC/faster-whisper-GUI A desktop GUI application built with PySide6 for running faster-whisper and whisperX speech-to-text transcription. It lets users transcribe… | 61 | 3003 | active |
| Starmel/OpenSuperWhisper OpenSuperWhisper is a macOS dictation application that records audio and transcribes it locally using Whisper or Parakeet models. It suppor… | 71 | 2962 | active |
| KevinWang676/Bark-Voice-Cloning A one-click hub of Gradio Web UIs and Colab notebooks for open-source voice cloning, TTS, and voice conversion models including Bark, GPT-S… | 64 | 2946 | active |
| facebookresearch/omnilingual-asr An open-source multilingual speech recognition library from Meta AI supporting over 1,600 languages, including hundreds never previously co… | 47 | 2941 | active |
| davabase/whisper_real_time A Python demo application that performs real-time speech-to-text transcription using OpenAI's Whisper model. It records audio continuously … | 36 | 2936 | active |
| kitlangton/Hex Hex is a macOS application that converts your voice to text: press-and-hold a global hotkey to record, and it transcribes on-device and pas… | 10 | 2902 | active |
| openai/openai-fm OpenAI.fm is an interactive web demo showcasing OpenAI's text-to-speech models, built with Next.js and the OpenAI Speech API. It lets users… | 48 | 2898 | active |
| jhj0517/Whisper-WebUI A Gradio-based web interface for OpenAI's Whisper models that generates subtitles from files, YouTube videos, or microphone input. It suppo… | 58 | 2897 | active |
| Vexa-ai/vexa Vexa is an open-source (Apache-2.0) meeting transcription API that dispatches bots to join Google Meet, Microsoft Teams, and Zoom calls and… | 86 | 2864 | active |
| linto-ai/whisper-timestamped A Python library extending OpenAI's Whisper models to produce accurate word-level timestamps and confidence scores during multilingual spee… | 77 | 2855 | active |
| dscripka/openWakeWord openWakeWord is an open-source Python library for detecting wake words (or phrases) in streaming audio, with pre-trained models for common … | 46 | 2837 | active |
| VieNeu-TTS VieNeu-TTS is an on-device Vietnamese text-to-speech library with instant zero-shot voice cloning from short reference clips, supporting bi… | 84 | 2828 | active |
| Camb-ai/MARS5-TTS MARS5 is an open-source English text-to-speech model from CAMB.AI that uses a two-stage AR-NAR pipeline to generate expressive speech with … | 15 | 2821 | active |
| zachlatta/freeflow FreeFlow is a free, open-source macOS dictation app that transcribes speech via Groq's fast API and pastes cleaned text into any focused te… | 74 | 2794 | active |
| rhasspy/piper Piper is a fast, local neural text-to-speech system that runs offline on modest hardware, including Raspberry Pi devices. It offers many pr… | 10 | 11290 | maintenance |
| QwenAudio/qwen-audio-agent A realtime voice runtime and frontend for AI coding agents like Claude Code, Codex, and Qwen Code, letting agents talk, listen, and report … | 78 | 2763 | active |
| thewh1teagle/kokoro-onnx A Python library that runs the Kokoro text-to-speech model via ONNX Runtime, supporting CPU and GPU inference. It provides multi-language T… | 65 | 2750 | active |
| rhasspy/rhasspy Rhasspy is a fully offline, privacy-focused set of voice assistant services supporting many human languages. It converts spoken voice comma… | 10 | 2746 | active |
| hahahumble/speechgpt SpeechGPT is an open-source web application that lets users have voice conversations with ChatGPT using speech recognition and speech synth… | 59 | 2745 | active |
| Const-me/Whisper A Windows port of whisper.cpp that runs OpenAI's Whisper speech recognition model on the GPU via DirectCompute (Direct3D 11 compute shaders… | 66 | 10678 | maintenance |
| FeatherTalk An ultralight talking-head (digital human) model that animates a person's face from audio input and runs in real time on mobile devices. It… | 61 | 2648 | active |
| ZeframLou/call-me A minimal Claude Code plugin that places real phone calls to notify you when an AI coding agent finishes a task, gets stuck, or needs a dec… | 48 | 2645 | active |
| pndurette/gTTS gTTS is a Python library and CLI tool that interfaces with Google Translate's text-to-speech API to generate spoken MP3 audio from text. It… | 53 | 2632 | stable |
| asteroid-team/asteroid Asteroid is a PyTorch-based audio source separation toolkit for researchers, providing modular building blocks (filterbanks, encoders, mask… | 66 | 2593 | active |
| ChatTTS_colab A one-click deployment wrapper around ChatTTS providing a Gradio web UI for text-to-speech, runnable in Google Colab or via an offline Wind… | 50 | 2592 | active |
| microsoft/foundry-local Foundry Local is Microsoft's end-to-end local AI runtime and SDK suite (C#, JavaScript, Python, Rust) for running optimized models entirely… | 87 | 2587 | active |
| ahmedeltaher/Android-MVVM-Architecture-Android-Voice-AI-SDK A reusable Android library (Kotlin, MVVM) that provides a full voice-driven AI conversation pipeline: microphone capture with VAD, speech-t… | 67 | 2582 | active |
| zixiiu/Digital_Life_Server A Python server backend for a 'digital life' voice assistant that combines speech recognition, ChatGPT-based conversation, sentiment analys… | 30 | 2549 | active |
| mozilla/TTS A deep learning library for advanced text-to-speech generation, built on PyTorch with models like Tacotron2, Glow-TTS, and various vocoders… | 23 | 10173 | maintenance |
| AIGC-Audio/AudioGPT AudioGPT is a Python framework that wraps multiple audio foundation models (for speech, singing, sound, and talking-head tasks) behind a GP… | 31 | 10168 | maintenance |
| harry0703/AudioNotes AudioNotes is a locally-run web application that transcribes audio and video files into text and organizes them into structured Markdown no… | 64 | 2535 | active |
| nateshmbhat/pyttsx3 pyttsx3 is an offline text-to-speech synthesis library for Python 3 that wraps system TTS engines like Sapi5, NSSpeechSynthesizer, and espe… | 61 | 2534 | active |
| janhq/ichigo Ichigo is a Python speech package for developers offering local realtime voice AI capabilities, including a compact 22M-parameter speech to… | 47 | 2495 | active |
| Live-GalGame/LiveGalGame LiveGalGame is a playful app that overlays a visual-novel (galgame) interface onto real-life conversations, providing real-time speech-to-t… | 52 | 2477 | active |
| erew123/alltalk_tts AllTalk TTS is a text-to-speech application built on the Coqui TTS engine, usable standalone or as an extension for Text-generation-webui, … | 41 | 2439 | active |
| resemble-ai/resemble-enhance Resemble Enhance is an AI-powered Python tool that improves speech quality through denoising and enhancement, using a denoiser module and a… | 18 | 2434 | active |
| VoiceInput A macOS menu-bar voice input app (Swift, macOS 14+) that lets users hold the Fn key to record and release to inject streaming-transcribed t… | 47 | 2419 | active |
| jik876/hifi-gan The official PyTorch implementation of HiFi-GAN, a generative adversarial network that converts mel-spectrograms into high-fidelity 22.05 k… | 32 | 2377 | stable |
| TransWithAI/Faster-Whisper-TransWithAI-ChickenRice A high-performance audio/video transcription and translation application built on Faster Whisper, optimized for Japanese-to-Chinese transla… | 71 | 2366 | active |
| cosin2077/easyVoice EasyVoice is an open-source text-to-speech application that converts long texts and novels into high-quality audio with streaming playback … | 88 | 2344 | active |
| iver56/audiomentations Audiomentations is a Python library for audio data augmentation with an API inspired by albumentations. It provides fast CPU-based waveform… | 61 | 2323 | stable |
| yan5xu/ququ QuQu is an open-source, free desktop voice dictation app built with Electron, designed as a privacy-first Wispr Flow alternative optimized … | 26 | 2296 | active |
| TEN-framework/ten-vad TEN VAD is a lightweight, low-latency voice activity detection library with an ONNX model for real-time speech detection. It supports C, Py… | 47 | 2277 | active |
| meizhong986/WhisperJAV WhisperJAV is a local, privacy-preserving subtitle generator for Japanese adult videos, combining Qwen3-ASR, Whisper, TEN-VAD/FireRedVAD vo… | 92 | 2258 | active |