Open-source deep-learning software
2663 open-source libraries, tools and applications tagged deep-learning, ranked by how closely deep-learning is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
2663 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| facebookresearch/lingua Meta Lingua is a minimal, fast LLM training and inference library built on easy-to-modify PyTorch components for research purposes. It supp… | 33 | 4771 | active |
| deepseek-ai/Engram Official implementation of Engram, a conditional memory module from DeepSeek that modernizes N-gram embeddings for O(1) lookup as a new spa… | 41 | 4735 | active |
| modelscope/ClearerVoice-Studio ClearerVoice-Studio is an open-source, AI-powered speech processing toolkit from ModelScope/Alibaba offering state-of-the-art pretrained mo… | 35 | 4515 | active |
| tloen/alpaca-lora A repository of scripts for reproducing Stanford Alpaca-style instruction tuning of LLaMA models using low-rank adaptation (LoRA) on consum… | 31 | 18899 | maintenance |
| SysCV/sam-hq HQ-SAM (Segment Anything in High Quality) upgrades Meta's Segment Anything Model with a learnable High-Quality Output Token for accurate ze… | 45 | 4262 | active |
| ZhengPeng7/BiRefNet BiRefNet is a PyTorch implementation of the CAAI AIR 2024 paper 'Bilateral Reference for High-Resolution Dichotomous Image Segmentation'. I… | 64 | 4247 | active |
| cvg/Hierarchical-Localization hloc is a modular Python toolbox for state-of-the-art 6-DoF visual localization, combining image retrieval and feature matching (SuperPoint… | 44 | 4232 | active |
| QwenLM/Qwen2.5-Omni Qwen2.5-Omni is an end-to-end multimodal model from Alibaba's Qwen team that understands text, images, audio, and video, and generates stre… | 29 | 4075 | active |
| StarsfieldAI/R1-V R1-V is an open-source research codebase for training vision-language models with reinforcement learning (RLVR/GRPO), demonstrating strong … | 18 | 4063 | active |
| thu-ml/SageAttention SageAttention is a family of quantized attention kernels (INT8/FP8/FP4) that accelerate transformer inference 2-5x over FlashAttention with… | 38 | 3956 | active |
| stanford-futuredata/ColBERT ColBERT is a fast and accurate neural retrieval model that encodes passages and queries into token-level embedding matrices and scores them… | 40 | 3941 | active |
| huggingface/smollm Hugging Face's repository for the SmolLM and SmolVLM families of compact, fully open language and vision-language models, including trainin… | 67 | 3926 | active |
| Avatarify Avatarify is an open-source application that drives photorealistic avatars in real time for video-conferencing apps like Zoom and Skype, ba… | 23 | 16520 | maintenance |
| IDEA-Research/Grounded-SAM-2 Grounded SAM 2 is a foundation-model pipeline that combines open-set detectors (Grounding DINO, Grounding DINO 1.5/1.6, Florence-2, DINO-X)… | 34 | 3780 | active |
| xinyu1205/recognize-anything Recognize Anything is a collection of open-source image recognition foundation models, including RAM, RAM++, and Tag2Text, that perform ima… | 31 | 3728 | active |
| zai-org/ChatGLM2-6B ChatGLM2-6B is an open-source bilingual (Chinese-English) 6B-parameter conversational large language model built on the GLM architecture. I… | 29 | 15505 | maintenance |
| ToTheBeginning/PuLID PuLID is the official PyTorch implementation of a NeurIPS 2024 method for inserting a specific person's identity into text-to-image generat… | 37 | 3556 | active |
| ob-f/OpenBot OpenBot is an open-source project that turns Android smartphones into the brains of low-cost robots, paired with a ~$50 electric vehicle bo… | 64 | 3505 | active |
| jixiaozhong/Sonic Sonic is the official PyTorch implementation of the CVPR 2025 paper 'Sonic: Shifting Focus to Global Audio Perception in Portrait Animation… | 46 | 3273 | active |
| prs-eth/Marigold Marigold is a family of diffusion-based models and a fine-tuning protocol that adapts pretrained latent diffusion models like Stable Diffus… | 69 | 3233 | active |
| Djdefrag/QualityScaler QualityScaler is a Windows GUI application that uses AI deep-learning models to upscale, enhance, and de-noise images and videos. It is wri… | 89 | 3207 | active |
| tekaratzas/RustGPT A transformer-based large language model implemented entirely in pure Rust with no external ML frameworks, using only ndarray for matrix op… | 35 | 3175 | active |
| z-x-yang/Segment-and-Track-Anything An open-source pipeline (SAM-Track) that segments and tracks arbitrary objects in videos using the Segment Anything Model for key-frame seg… | 58 | 3140 | active |
| naver/mast3r MASt3R is the official PyTorch implementation of 'Grounding Image Matching in 3D with MASt3R' (ECCV 2024), a model that performs dense 3D r… | 34 | 3114 | active |
| ridgerchu/matmulfreellm A Python implementation of MatMul-Free LM, a language model architecture that eliminates matrix multiplication operations using ternary wei… | 76 | 3093 | active |
| microsoft/MoGe MoGe is a deep learning model from Microsoft Research that recovers 3D geometry from a single open-domain image, predicting metric point ma… | 68 | 3077 | active |
| luminal-ai/luminal Luminal is a high-performance general-purpose ML inference compiler written in Rust that lowers models to a minimal 15-op dataflow IR and c… | 77 | 3026 | active |
| Doubiiu/DynamiCrafter DynamiCrafter is an open-source research model that animates open-domain still images into short videos using pre-trained video diffusion p… | 27 | 3005 | active |
| williamyang1991/Rerender_A_Video The official PyTorch implementation of 'Rerender A Video', a SIGGRAPH Asia 2023 zero-shot text-guided video-to-video translation framework.… | 30 | 2997 | stable |
| sherlockchou86/VideoPipe VideoPipe is a C++ framework for video analysis and structuring that works like a pipeline of independent, composable nodes. It integrates … | 50 | 2960 | active |
| facebookresearch/omnilingual-asr An open-source multilingual speech recognition library from Meta AI supporting over 1,600 languages, including hundreds never previously co… | 47 | 2941 | active |
| NVlabs/FoundationStereo FoundationStereo is NVIDIA's official PyTorch implementation of a foundation model for zero-shot stereo depth estimation, published as a CV… | 44 | 2923 | active |
| ModelTC/LightX2V LightX2V is a lightweight, high-performance inference framework for image and video generation, supporting tasks like text-to-video, image-… | 83 | 2914 | active |
| UX-Decoder/Semantic-SAM Official PyTorch implementation of Semantic-SAM, a universal image segmentation model that segments and recognizes anything at any desired … | 30 | 2855 | active |
| TMElyralab/MuseV MuseV is a diffusion-based framework for generating high-fidelity virtual human videos of infinite length using a Visual Conditioned Parall… | 26 | 2843 | active |
| VieNeu-TTS VieNeu-TTS is an on-device Vietnamese text-to-speech library with instant zero-shot voice cloning from short reference clips, supporting bi… | 84 | 2828 | active |
| Camb-ai/MARS5-TTS MARS5 is an open-source English text-to-speech model from CAMB.AI that uses a two-stage AR-NAR pipeline to generate expressive speech with … | 15 | 2821 | active |
| kha-white/manga-ocr Manga OCR is a Python library providing optical character recognition for Japanese text, focused on Japanese manga. It uses a custom end-to… | 77 | 2809 | stable |
| Autodistill Autodistill is a Python library that uses large foundation vision models (like Grounding DINO, Grounded SAM, and CLIP) to automatically lab… | 64 | 2784 | active |
| magic-research/magic-animate MagicAnimate is the official implementation of a CVPR 2024 diffusion-based human image animation framework that animates a reference image … | 41 | 10889 | maintenance |
| DDSP-SVC DDSP-SVC is an open-source singing voice conversion system built on Differentiable Digital Signal Processing, designed as a free AI voice c… | 65 | 2682 | active |
| luca-medeiros/lang-segment-anything A Python library combining Meta's Segment Anything Model 2 with GroundingDINO to generate segmentation masks for objects in images specifie… | 35 | 2600 | active |
| data-infra/cube-studio CubeStudio is an open-source, cloud-native, all-in-one AI platform covering the full machine learning lifecycle (MLOps/MaaS/LLMOps), includ… | 74 | 2546 | active |
| facebookresearch/nougat Nougat is Meta's neural OCR model that parses academic PDFs into structured Markdown, understanding LaTeX math and tables. It ships as a Py… | 20 | 10082 | maintenance |
| FacePlugin Face Recognition SDK An open-source face recognition SDK by Faceplugin providing face detection, landmark extraction, feature embedding generation, and face tem… | 65 | 2526 | active |
| ipazc/mtcnn A Python library implementing the MTCNN (Multitask Cascaded Convolutional Networks) algorithm for face detection and facial landmark alignm… | 23 | 2490 | stable |
| learnhouse/learnhouse LearnHouse is a next-generation open-source learning management system (LMS) for creating, sharing, and selling educational content. It com… | 100 | 2404 | active |
| ailia models A collection of 400+ pre-trained state-of-the-art AI models (object detection, pose estimation, speech recognition, LLMs, image generation,… | 76 | 2393 | active |
| jik876/hifi-gan The official PyTorch implementation of HiFi-GAN, a generative adversarial network that converts mel-spectrograms into high-fidelity 22.05 k… | 32 | 2377 | stable |
| XiaomiMiMo/MiMo Xiaomi's MiMo is a 7B-parameter reasoning language model trained from pretraining through posttraining with reinforcement learning, release… | 28 | 2373 | active |
| MouseLand/cellpose Cellpose is a generalist deep learning algorithm for cellular and nucleus segmentation in microscopy images, with human-in-the-loop capabil… | 80 | 2371 | active |
| LabML A Python library for tracking and monitoring deep learning experiments, with a self-hostable server app for viewing metrics and hardware us… | 26 | 2327 | active |
| THU-MIG/yoloe YOLOE is the official PyTorch implementation of an open-vocabulary object detection and segmentation model presented at ICCV 2025. It unifi… | 30 | 2297 | active |
| OlafenwaMoses/ImageAI ImageAI is a Python library that lets developers add computer vision capabilities like image classification, object detection, and video ob… | 23 | 8888 | maintenance |
| ermig1979/Simd Simd Library is a free open-source C++ image processing and machine learning library with a C API and Python wrapper. Its algorithms are ha… | 98 | 2272 | active |
| MVIG-SJTU/AlphaPose AlphaPose is an open-source real-time multi-person full-body pose estimation and tracking system built on PyTorch. It detects human keypoin… | 32 | 8605 | maintenance |
| DigitalPhonetics/IMS-Toucan IMS Toucan is a PyTorch-based toolkit for training and running state-of-the-art, controllable text-to-speech synthesis, home of the massive… | 48 | 2209 | active |
| MoonshotAI/MoBA MoBA (Mixture of Block Attention) is a PyTorch implementation of a trainable block-sparse attention mechanism for long-context large langua… | 24 | 2191 | active |
| Tencent-Hunyuan/HunyuanVideo-Avatar HunyuanVideo-Avatar is Tencent's open-source model and inference code for high-fidelity audio-driven human animation, generating talking av… | 42 | 2173 | active |
| intel/intel-extension-for-transformers Intel's toolkit for accelerating transformer-based GenAI/LLM workloads on Intel platforms, offering state-of-the-art compression (e.g., INT… | 10 | 2169 | active |
| espressif/esp-who ESP-WHO is an image processing development platform from Espressif providing face detection, face recognition, pedestrian detection, and QR… | 63 | 2156 | active |
| LiheYoung/Depth-Anything Depth Anything is a monocular depth estimation foundation model trained on 1.5M labeled and 62M+ unlabeled images, released as a Python lib… | 26 | 8240 | maintenance |
| bigcode-project/starcoder2 StarCoder2 is a family of open code generation language models (3B, 7B, 15B) trained on 600+ programming languages from The Stack v2, with … | 27 | 2095 | active |
| visomaster/VisoMaster VisoMaster is a Python-based desktop application for AI-powered face swapping and face editing in images and videos. It supports multiple s… | 24 | 2089 | active |
| PaddlePaddle/PaddleGAN PaddleGAN is a Python library providing high-performance implementations of classic and state-of-the-art Generative Adversarial Networks bu… | 23 | 8048 | maintenance |
| jd-opensource/JoyAI-Echo JoyAI-Echo is a Python framework for long-horizon audio-visual generation, producing coherent multi-shot videos up to ~5 minutes with paire… | 57 | 2057 | active |
| serengil/retinaface RetinaFace is a Python library for deep learning based face detection, built on TensorFlow and derived from the insightface project's Retin… | 66 | 2042 | active |
| juanmc2005/diart Diart is a Python framework for building AI-powered real-time audio applications, best known for state-of-the-art streaming speaker diariza… | 59 | 2041 | active |
| Yi Yi is a family of open-source large language models trained from scratch by 01.AI, including base and chat models in multiple sizes, with b… | 28 | 7830 | maintenance |
| Anime4KCPP Anime4KCPP is a high-performance anime image and video upscaler built on CNN-based algorithms, written in C++. It ships as a library plus V… | 72 | 2033 | active |
| Tencent-Hunyuan/HunyuanOCR HunyuanOCR-1.5 is a lightweight end-to-end OCR vision-language model from Tencent, with a unified inference environment, llama.cpp PC-side … | 60 | 2025 | active |
| hkchengrex/XMem XMem is a PyTorch model for semi-supervised video object segmentation that tracks objects through long videos using an Atkinson-Shiffrin-in… | 23 | 1994 | stable |
| xingyizhou/CenterNet CenterNet is a PyTorch implementation of the 'Objects as Points' detector, which models objects as single center points detected via keypoi… | 32 | 7574 | maintenance |
| Netflix/void-model VOID (Video Object and Interaction Deletion) is a research model from Netflix that removes objects from videos along with the physical inte… | 51 | 1983 | active |
| eriklindernoren/PyTorch-YOLOv3 A minimal PyTorch implementation of YOLOv3 supporting training, inference, and evaluation, with compatibility for YOLOv4 and YOLOv7 weights… | 32 | 7439 | maintenance |
| sicxu/Deep3DFaceRecon_pytorch A PyTorch implementation of Deep3DFaceReconstruction, a weakly-supervised CNN method for reconstructing 3D face geometry from a single imag… | 32 | 1911 | stable |
| Chinese License Plate Detection & Recognition A PyTorch-based Chinese license plate detection and recognition system built on YOLOv5 for detection and CRNN for recognition. It supports … | 67 | 1883 | active |
| OpenImagingLab/FlashVSR FlashVSR is a one-step diffusion-based streaming video super-resolution framework that runs at ~17 FPS for 768x1408 video on a single A100 … | 59 | 1876 | active |
| vt-vl-lab/3d-photo-inpainting A Python research codebase from a CVPR 2020 paper that converts a single RGB-D image into a 3D photo using layered depth inpainting. It hal… | 32 | 7093 | maintenance |
| descriptinc/descript-audio-codec Descript Audio Codec (.dac) is a high-fidelity neural audio codec based on improved RVQGAN that compresses audio at roughly 90x compression… | 58 | 1873 | stable |
| Omni-Avatar/OmniAvatar OmniAvatar is an audio-driven full-body avatar video generation model built on Wan2.1 text-to-video diffusion models with LoRA-based audio … | 31 | 1862 | active |
| Tele-AI/Telechat TeleChat is a family of open-source bilingual (Chinese-English) large language models (1B, 7B, 12B) developed by China Telecom's AI team, r… | 64 | 1852 | active |
| Stability-AI/stable-fast-3d Stable Fast 3D (SF3D) is Stability AI's open-source model that reconstructs a textured, UV-unwrapped 3D mesh from a single input image in a… | 24 | 1834 | active |
| character-ai/Ovi Ovi is a video-plus-audio generation model from Character AI that simultaneously generates synchronized video and audio from text or text+i… | 38 | 1763 | active |
| AnswerDotAI/ModernBERT ModernBERT is the research repository for a modernized BERT-family bidirectional encoder trained on 2 trillion tokens with an 8192-token co… | 52 | 1758 | active |
| SHI-Labs/OneFormer OneFormer is a universal image segmentation framework (CVPR 2023) that unifies semantic, instance, and panoptic segmentation in a single tr… | 32 | 1740 | stable |
| MgArcher/Text_select_captcha A PyTorch-based deep learning system that recognizes click-based (text-select) CAPTCHAs by detecting and ordering Chinese character positio… | 65 | 1678 | active |
| Tencent/AngelSlim AngelSlim is a Python toolkit from Tencent for compressing large language models and related architectures (VLMs, diffusion, audio models) … | 70 | 1669 | active |
| Stability-AI/stable-virtual-camera Stable Virtual Camera (SEVA) is a generalist diffusion model for novel view synthesis that generates 3D-consistent views of a scene from an… | 51 | 1664 | active |
| kotaro-kinoshita/yomitoku YomiToku is an AI-powered document image analysis engine specialized for Japanese, providing full-text OCR, layout analysis, table structur… | 88 | 1649 | active |
| Higgsfield Higgsfield is an open-source GPU orchestration and machine learning framework for fault-tolerant, distributed training of very large models… | 67 | 6047 | maintenance |
| GHOST GHOST (Generative High-fidelity One Shot Transfer) is a one-shot face swap pipeline for images and videos, published as an IEEE paper and i… | 23 | 1593 | active |
| menyifang/MIMO MIMO is the official PyTorch implementation of a CVPR 2025 paper on controllable character video synthesis using spatially decomposed model… | 32 | 1578 | active |
| Layout Parser LayoutParser is a Python toolkit for deep learning based document image analysis, offering unified APIs for layout detection models, layout… | 23 | 5776 | maintenance |
| hkchengrex/Tracking-Anything-with-DEVA DEVA is a decoupled video segmentation framework that combines task-specific image-level segmentation models with a universal bi-directiona… | 24 | 1522 | stable |
| Om-Alve/smolGPT A minimal pure-PyTorch implementation for training small GPT-style LLMs from scratch, featuring flash attention, RMSNorm, SwiGLU, RoPE, and… | 21 | 1474 | active |
| microsoft/NeuralSpeech NeuralSpeech is a Microsoft Research Asia research repository containing implementations of neural speech processing models across ASR erro… | 10 | 1461 | active |
| Turing-Project/WriteGPT WriteGPT is a generative text-creation AI framework built on GPT-2 and other models (EAST, CRNN, BERT), fine-tuned to generate Chinese exam… | 23 | 5282 | maintenance |
| neuralchen/SimSwap SimSwap is a PyTorch-based face-swapping framework that performs arbitrary face swaps on images and videos using a single trained model. It… | 23 | 5192 | maintenance |
| sql-machine-learning/sqlflow SQLFlow is a compiler that extends SQL with AI-oriented syntax (training, prediction, evaluation, explanation, and mathematical programming… | 23 | 5190 | maintenance |