Ross ROSS = Recommend OSS · open-source software intelligence for agents

Open-source audio-processing software

1694 open-source libraries, tools and applications tagged audio-processing, ranked by how closely audio-processing is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.

1694 products, primary matches first, then adoption-weighted; health v2 shown.

ProductHealth v2StarsMaturity
Shirakumo/trial
Trial is a modular game engine written in Common Lisp, built around OpenGL rendering with subsystems for animation, physics, audio, assets,…
101139active
MagicFoundation/Alcinoe
Alcinoe is a library of components and utilities for Delphi/FireMonkey (FMX) that helps developers build fast, modern, cross-platform appli…
941134active
rayenfeng/riko_project
Project Riko is an anime-themed conversational voice assistant that combines OpenAI's GPT for dialogue, GPT-SoVITS for voice synthesis, and…
281134active
Xilinx/Vitis_Libraries
A collection of open-source, performance-optimized accelerated libraries for the AMD Vitis Unified Software Platform, offering out-of-the-b…
901130active
PromtEngineer/Verbi
Verbi is a modular Python voice assistant application for experimenting with state-of-the-art transcription, LLM response generation, and t…
451122active
HITsz-TMG/Uni-MoE
Uni-MoE is a family of open-source Mixture-of-Experts (MoE) based omnimodal large language models that understand and generate across text,…
651118active
KoljaB/RealtimeVoiceChat
A Python client-server application enabling natural spoken conversations with LLMs, streaming browser audio via WebSockets through Realtime…
303857maintenance
brenpoly/be-more-agent
An offline-first conversational AI agent that turns a Raspberry Pi into a fully local voice assistant. It combines OpenWakeWord, Whisper.cp…
591110active
ARM-software/CMSIS-DSP
CMSIS-DSP is ARM's optimized embedded compute library providing DSP and math kernels for Cortex-M and Cortex-A processors, including FFT, f…
951106stable
vocodedev/vocode-core
Vocode is an open-source Python library for building real-time, voice-based LLM applications and agents. It orchestrates streaming transcri…
223797maintenance
doxas/twigl
twigl.app is an online editor for writing ultra-compact 'one tweet' GLSL shaders for WebGL and WebGL2, with modes that auto-complete boiler…
601093active
EchoMimic
EchoMimic is a series of open-source models (V1-V3) from Ant Group for audio-driven human animation, generating lifelike talking-head, port…
471075active
AILab-CVC/UniRepLKNet
UniRepLKNet is a large-kernel ConvNet architecture (CVPR 2024, TPAMI 2025) that provides universal perception across image, audio, video, p…
401074stable
ufal/whisper_streaming
A Python library that turns Whisper-like speech recognition models into a real-time streaming transcription and translation system using a …
503674maintenance
X-LANCE/SLAM-LLM
SLAM-LLM is a deep learning toolkit for training custom multimodal large language models focused on speech, language, audio, and music proc…
521066active
PatterAI/Patter
Patter is an open-source, MIT-licensed SDK (Python and TypeScript) that connects AI agents to real phone calls, handling telephony, speech-…
731062active
C-Loftus/QuickPiperAudiobook
A Go CLI tool that converts text content from formats like epub, PDF, mobi, txt, HTML, and docx into natural-sounding audiobooks with a sin…
361059active
Crafty
Crafty is an open-source JavaScript/HTML5 game engine built around an entity-component-system architecture. It provides components for 2D g…
233613maintenance
Goekdeniz-Guelmez/Local-NotebookLM
A local, open-source alternative to Google's NotebookLM that converts PDF documents into audio content like podcasts, summaries, and interv…
681037active
99AI
99AI is a commercially viable, self-hostable AI web platform built with Vue and Node.js that bundles AI chat, image/video/music generation,…
321027active
Towhee
Towhee is a Python framework for building ETL pipelines that process unstructured data (images, video, text, audio) into embeddings using s…
233451maintenance
pingostack/pingos
PingOS is an NGINX-based streaming media server supporting RTMP, HTTP-FLV, HTTP-TS, HLS, HLS+, and DASH live streaming protocols with H.264…
231013active
TensorSpeech/TensorFlowASR
TensorFlowASR is a Python library implementing automatic speech recognition architectures such as DeepSpeech2, Jasper, RNN Transducer, Cont…
861011active
GitLqr/LQRWeChat
An open-source Android app that closely replicates WeChat 6.5.7, built on the RongCloud IM SDK with RxJava, Retrofit, MVP, and Glide. It su…
693424maintenance
siyuanchen0214/Scam-AI-Multi-modal-Evaluation-System
A Python-based multi-modal AI system for detecting fraudulent content across text, image, audio, and video, with provenance tracing and cro…
361002active
DAMO-NLP-SG/Video-LLaMA
Video-LLaMA is an instruction-tuned audio-visual language model that extends LLaMA with video and audio understanding via cross-modal pretr…
303140maintenance
lynckia/licode
Licode is an open-source WebRTC communications platform for hosting your own videoconference provider, built around the C++ Erizo MCU, a No…
683133maintenance
starRTC
StarRTC is a free cross-platform real-time communication SDK and self-hostable server suite providing instant messaging, one-to-one video c…
233075maintenance
CainKernel/CainCamera
An open-source Android app and set of libraries demonstrating how to build a beauty camera, image editor, and short-video editor. It implem…
322966maintenance
yerfor/GeneFace
GeneFace is the official PyTorch implementation of an ICLR 2023 paper on generalized, high-fidelity audio-driven 3D talking face synthesis …
222656maintenance
mravanelli/pytorch-kaldi
PyTorch-Kaldi is a toolkit for developing state-of-the-art DNN/HMM hybrid speech recognition systems, combining PyTorch-managed neural netw…
322406maintenance
ivansafrin/Polycode
Polycode is a cross-platform C++ framework for creative coding that provides accelerated 2D and 3D graphics, hardware shaders, sound, netwo…
232382maintenance
kisence-mian/MyUnityFrameWork
A pluggable Unity game development framework written in C# covering resource loading, config/data loading, UI management, audio, logging, a…
322191maintenance
fatchord/WaveRNN
A PyTorch implementation of DeepMind's WaveRNN neural vocoder plus a Tacotron text-to-speech system, trained on LJSpeech. It supports train…
322190maintenance
jadepeng/XMusicDownloader
A C# desktop application that aggregates music search across Baidu, NetEase, QQ, Kugou, and Migu music sites and supports batch downloading…
232174maintenance
SeanNaren/deepspeech.pytorch
A PyTorch implementation of the DeepSpeech2 speech recognition model, built on PyTorch Lightning, supporting training, testing, and inferen…
232134maintenance
WangShuo1143368701/WSLiveDemo
An Android live-streaming SDK providing RTMP pushing, video recording, and GPU-based filters including adjustable beauty effects. It uses O…
232060maintenance
vsitzmann/siren
Official PyTorch implementation of SIREN, a neural network architecture using periodic (sine) activation functions for implicit neural repr…
322000maintenance
orangeduck/Corange
Corange is a pure C game engine built on SDL and OpenGL, providing asset, entity, and UI management plus a modern deferred renderer. It ser…
321993maintenance
nobody132/masr
MASR is an end-to-end Mandarin Chinese automatic speech recognition project built on a gated convolutional neural network (similar to Wav2L…
231966maintenance
Kyubyong/tacotron
A heavily documented TensorFlow implementation of Tacotron, a fully end-to-end text-to-speech synthesis model. It includes training, prepro…
321835maintenance
iqiqiya/iqiqiya-API
A PHP-based collection of free web API endpoints for parsing media from Chinese platforms (Douyin, Kuaishou, Bilibili, NetEase Music, Ximal…
101741maintenance
Lightning-Universe/lightning-flash
Lightning Flash is a high-level PyTorch library built on PyTorch Lightning that provides ready-made 'recipes' for over 15 AI tasks across 7…
101726maintenance
GarageGames/Torque2D
Torque 2D is an MIT-licensed open source C++ 2D game engine originally from GarageGames, featuring OpenGL batched rendering, Box2D physics,…
231662maintenance
invictus717/MetaTransformer
Meta-Transformer is a research framework for unified multimodal learning that maps inputs from 12 modalities (text, images, point clouds, a…
201643maintenance
HumanAIGC/EMO
EMO (Emote Portrait Alive) is a research codebase from Alibaba's Institute for Intelligent Computing that generates expressive talking port…
267580experimental
supermedium/superframe
Superframe is a curated collection of components for A-Frame, the web framework for building VR experiences. It includes components for ani…
661412maintenance
innnky/emotional-vits
Emotional VITS is a voice synthesis (TTS) model based on VITS that enables emotion-controllable speech generation without requiring manual …
321390maintenance
guangqiang-liu/OneM
OneM is a comprehensive React Native app combining magazine browsing, music playback, and video playback, built with Redux state management…
321376maintenance
CSTR-Edinburgh/merlin
Merlin is a toolkit from the University of Edinburgh's CSTR for building deep neural network models for statistical parametric speech synth…
231321maintenance
YuanxunLu/LiveSpeechPortraits
A PyTorch implementation of the SIGGRAPH Asia 2021 paper 'Live Speech Portraits', which generates photorealistic personalized talking-head …
321283maintenance
PlayVoice/vits_chinese
A Chinese text-to-speech library combining VITS with BERT-based prosody embeddings and NaturalSpeech infer-loss features, supporting ONNX c…
231228maintenance
kylestetz/slang
Slang is a small audio programming language implemented entirely in JavaScript, running in the browser on top of the Web Audio API. It uses…
321202maintenance
google/lullaby
Lullaby is a collection of high-performance C++ libraries from Google for building virtual and augmented reality experiences. It provides a…
101198maintenance
MaurycyLiebner/enve
enve is an open-source 2D animation application for Linux and Windows, supporting vector and raster animation as well as sound and video fi…
101196maintenance
AnyListen/YaVipCore
A .NET Core music interface service that aggregates search and playback across Chinese music platforms such as NetEase, QQ, Kugou, Kuwo, Ba…
231181maintenance
kpreid/shinysdr
ShinySDR is a software-defined radio receiver application built on GNU Radio with a web-based user interface and a plugin system. Combined …
321145maintenance
snuffyDev/Beatbump
Beatbump is a privacy-respecting alternative frontend for YouTube Music built with SvelteKit, offering ad-free audio playback, playlist man…
101130maintenance
MRzzm/DINet
DINet is the official PyTorch implementation of an AAAI 2023 paper on realistic face visually dubbing, which deforms and inpaints mouth reg…
321129maintenance
maelfabien/Multimodal-Emotion-Recognition
A real-time multimodal emotion recognition web app built with Flask that analyzes emotions from text, audio, and video inputs using deep le…
321093maintenance
HurTeng/StormPlane
StormPlane (Desert Storm) is an open-source vertical-scrolling shoot-'em-up game for Android, inspired by Raiden and WeChat's plane game, b…
231074maintenance
OFA-Sys/ONE-PEACE
ONE-PEACE is a general multimodal representation model that jointly encodes vision, audio, and language modalities without initializing fro…
301060maintenance
NATSpeech/NATSpeech
A PyTorch framework for non-autoregressive text-to-speech (NAR-TTS), containing official implementations of PortaSpeech (NeurIPS 2021) and …
231004maintenance
HailToDodongo/pyrite64
Pyrite64 is a visual editor and runtime game engine for creating 3D games that run on real Nintendo 64 consoles or accurate emulators, buil…
843268experimental
enhuiz/vall-e
An unofficial PyTorch implementation of the VALL-E text-to-speech audio language model, built on the EnCodec tokenizer. It provides trainin…
322967experimental
vanilla-wiiu/vanilla
Vanilla is a software clone of the Wii U Gamepad that lets compatible devices act as a wireless second screen and controller for a Wii U co…
782335experimental
jbilcke-hf/clapper
Clapper is an open-source AI story visualization tool - a video synthesizer and sequencer for creating AI-generated cinema. Users iterate o…
362326experimental
EQMG/Acid
Acid is an open-source, cross-platform 3D game engine written in modern C++17, using Vulkan as its sole graphics API (with Metal support vi…
322027experimental
Standard-Intelligence/hertz-dev
Hertz-dev is an open-source 8.5B parameter autoregressive base model for full-duplex conversational audio, released by Standard Intelligenc…
221799experimental
hugoam/toy
toy is a thin and modular C++ game engine built on top of the 'two' library, aiming to provide the simplest technology stack for making 2D …
321594experimental
lyuchenyang/Macaw-LLM
Macaw-LLM is a multi-modal language modeling framework that integrates image, video, audio, and text data, built on CLIP, Whisper, and LLaM…
301591experimental
lucidrains/naturalspeech2-pytorch
A PyTorch implementation of NaturalSpeech 2, a zero-shot text-to-speech and singing synthesizer that combines a neural audio codec with a l…
211334experimental
Magenta
Magenta is a Google Brain research project and Python TensorFlow library for generating music, images, and drawings with machine learning. …
1019787abandoned
benawad/dogehouse
DogeHouse is an open-source social audio platform (a Clubhouse-style voice conversation app) with an Elixir API, voice server, Next.js web …
239017abandoned
CatchChat/Yep
Yep is an open-source iOS social networking app written in Swift, themed around 'meeting geniuses' to help users find experts and learners …
105863abandoned
amhndu/SimpleNES
SimpleNES is an NES (Nintendo Entertainment System) emulator written in C++ using SFML, supporting games that use no mapper or mappers 1, 2…
395108abandoned
qTox/qTox
qTox is a cross-platform instant messaging desktop client supporting encrypted text chat, voice and video calls, and file transfer over the…
104976abandoned
chentao0707/SimplifyReader
SimplifyReader is an Android client app built with Google Material Design, featuring five modules: news reading, image browsing, video watc…
324538abandoned
accord-net/framework
Accord.NET is a C# framework for .NET providing machine learning, statistics, computer vision, image and audio processing, and general scie…
104531abandoned
xhzengAIB/MessageDisplayKit
An Objective-C iOS library providing a WeChat-like instant messaging app experience, with UI components for sending text, pictures, audio, …
234212abandoned
agermanidis/autosub
Autosub is a Python command-line utility that auto-generates subtitles for video or audio files. It performs voice activity detection, tran…
324191abandoned
SeriousCache/UABE
UABE (Asset Bundle Extractor) is a Windows desktop editor for Unity .assets and AssetBundle files, supporting export/import of textures, te…
104138abandoned
buriburisuri/speech-to-text-wavenet
A TensorFlow implementation of end-to-end English speech recognition based on DeepMind's WaveNet architecture, trained with CTC loss on sen…
324003abandoned
blackjack4494/yt-dlc
youtube-dlc is a Python-based command-line media downloader and library for downloading videos from YouTube and other video platforms, fork…
233043abandoned
zzw922cn/Automatic_Speech_Recognition
An end-to-end automatic speech recognition system implemented in TensorFlow, supporting Mandarin and English with models like DeepSpeech2, …
322833abandoned
replit/kaboom
Kaboom is a JavaScript game library for building 2D games quickly in the browser, using a component-based system to compose game objects wi…
102734abandoned
idootop/open-xiaoai
Open-XiaoAI is a Rust-based client/server project that takes over the audio input and output of Xiaomi XiaoAI smart speakers (LX06 and OH2P…
102617abandoned
nacker/LZEasemob3
An open-source iOS application that closely clones WeChat's UI and features (chat, contacts, Moments feed, voice messages, red packets) usi…
321926abandoned
Onju Voice
A hackable AI home assistant platform that replaces the internals of a Google Nest Mini with a custom ESP32-S3 PCB, paired with a server th…
601732abandoned
elevenlabs/elevenlabs-mcp
The official ElevenLabs Model Context Protocol (MCP) server, exposing ElevenLabs text-to-speech, speech-to-text, voice design, and conversa…
101535abandoned
artyshko/smd
A Python application that downloads high-quality music from Spotify playlists, albums, and songs by fetching audio from sources like YouTub…
231496abandoned
aFarkas/webshim
Webshims Lib is a modular, capability-based polyfill-loading library that extends jQuery with HTML5 features in legacy browsers. It conditi…
231399abandoned
Raival-e/Prism-File-Explorer
Prism File Explorer is a modern, lightweight file manager for Android built entirely with Kotlin and Jetpack Compose, featuring a Material …
591371abandoned
MediaCrush/MediaCrush
MediaCrush is a self-hostable website for uploading and sharing images, audio, and video via fast, shareable links. It is a full web applic…
321330abandoned

← prev page 17 / 17