Open-source deep-learning software
2785 open-source libraries, tools and applications tagged deep-learning, ranked by how closely deep-learning is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
2785 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| helblazer811/ManimML ManimML is a Python library built on the Manim Community Library for creating animations and visualizations of machine learning concepts li… | 23 | 3517 | active |
| borisdayma/dalle-mini DALL·E Mini is a Python library and model that generates images from a text prompt, available via pip and hosted on Hugging Face Model Hub.… | 23 | 14724 | maintenance |
| deepseek-ai/DeepSeek-OCR-2 DeepSeek-OCR 2 is an open-source vision-language model and inference toolkit implementing 'Visual Causal Flow' for optical character recogn… | 42 | 3471 | active |
| Linly Digital Human System Linly-Talker is a Python-based digital avatar conversational system that combines LLMs (Linly, Qwen, Gemini), speech recognition (Whisper, … | 44 | 3468 | active |
| RKNN-Toolkit2 RKNN-Toolkit2 is Rockchip's SDK for converting trained neural network models into RKNN format and deploying them on Rockchip NPU chips like… | 33 | 3419 | active |
| IQA-PyTorch A pure Python/PyTorch toolbox for image quality assessment (IQA) providing GPU-accelerated reimplementations of many full-reference and no-… | 82 | 3408 | active |
| 2D Gaussian Splatting Official implementation of 2D Gaussian Splatting (2DGS), a SIGGRAPH 2024 method that represents scenes as 2D oriented Gaussian disks for ge… | 66 | 3312 | stable |
| deepdoctection deepdoctection is a Python library for Document AI that orchestrates document layout analysis, table recognition, OCR, and document/token c… | 96 | 3261 | active |
| Doubiiu/DynamiCrafter DynamiCrafter is an open-source research model that animates open-domain still images into short videos using pre-trained video diffusion p… | 27 | 3005 | active |
| sherlockchou86/VideoPipe VideoPipe is a C++ framework for video analysis and structuring that works like a pipeline of independent, composable nodes. It integrates … | 50 | 2960 | active |
| physical-superintelligence-lab/Psi0 Psi-Zero (Ψ₀) is an open vision-language-action (VLA) foundation model for dexterous humanoid loco-manipulation, combining a Qwen3-VL backb… | 59 | 2859 | active |
| UX-Decoder/Semantic-SAM Official PyTorch implementation of Semantic-SAM, a universal image segmentation model that segments and recognizes anything at any desired … | 30 | 2855 | active |
| OpenDCAI/DataFlex DataFlex is a data-centric training framework built on LLaMA-Factory that dynamically schedules LLM training data during optimization. It p… | 63 | 2824 | active |
| Autodistill Autodistill is a Python library that uses large foundation vision models (like Grounding DINO, Grounded SAM, and CLIP) to automatically lab… | 64 | 2784 | active |
| huggingface/swift-coreml-diffusers A native SwiftUI application demonstrating how to run Stable Diffusion text-to-image generation on-device using Apple's Core ML Stable Diff… | 10 | 2755 | active |
| CVCUDA/CV-CUDA CV-CUDA is an open-source GPU-accelerated library of computer vision and image processing operators built on CUDA, with C++ and Python APIs… | 92 | 2729 | active |
| KimMeen/Time-LLM Time-LLM is the official PyTorch implementation of an ICLR 2024 paper that reprograms frozen large language models (Llama, GPT-2, BERT) for… | 44 | 2707 | active |
| magic-research/magic-animate MagicAnimate is the official implementation of a CVPR 2024 diffusion-based human image animation framework that animates a reference image … | 41 | 10889 | maintenance |
| princeton-vl/DROID-SLAM DROID-SLAM is a deep learning-based visual SLAM system for monocular, stereo, and RGB-D cameras that estimates camera trajectory and dense … | 37 | 2699 | active |
| LAM LHM is a PyTorch-based large reconstruction model that reconstructs high-fidelity animatable 3D human avatars from a single image in second… | 49 | 2679 | active |
| HiDream-ai/HiDream-I1 HiDream-I1 is an open-source 17B-parameter text-to-image generative foundation model based on a Sparse Diffusion Transformer, with full and… | 31 | 2510 | active |
| wgsxm/PartCrafter PartCrafter is a structured 3D generative model that jointly generates multiple semantically meaningful 3D mesh parts and objects from a si… | 50 | 2485 | active |
| BeyondMimic Motion Tracking BeyondMimic's official motion tracking training code, a humanoid control framework built on Isaac Lab that trains sim-to-real-ready whole-b… | 10 | 2444 | active |
| NVlabs/ProtoMotions ProtoMotions is a GPU-accelerated simulation and reinforcement learning framework for training physically simulated digital humans and huma… | 66 | 2392 | active |
| langfengQ/verl-agent verl-agent is an extension of the veRL framework for training LLM and VLM agents via reinforcement learning, featuring step-independent mul… | 51 | 2388 | active |
| nv-tlabs/lyra Project Lyra is NVIDIA's open series of generative 3D world models, including Lyra 1.0 for feed-forward 3D/4D scene generation from a singl… | 56 | 2317 | active |
| NVlabs/nvdiffrec nvdiffrec is NVIDIA's official implementation of a CVPR 2022 oral paper that jointly optimizes triangular 3D meshes, PBR materials, and lig… | 72 | 2298 | stable |
| OpenChatKit OpenChatKit is an open-source toolkit from Together, LAION, and Ontocord.ai for building and fine-tuning chat language models, including in… | 31 | 8983 | maintenance |
| Liuziyu77/Visual-RFT Official research code for Visual-RFT and Visual-ARFT, applying GRPO-based reinforcement fine-tuning with rule-based verifiable rewards to … | 39 | 2280 | active |
| OlafenwaMoses/ImageAI ImageAI is a Python library that lets developers add computer vision capabilities like image classification, object detection, and video ob… | 23 | 8888 | maintenance |
| hls4ml hls4ml is a Python package that converts machine learning models from Keras, PyTorch, and ONNX into high-level synthesis (C++) code for FPG… | 80 | 2185 | active |
| jd-opensource/JoyAI-Image JoyAI-Image is a unified multimodal foundation model for image understanding, text-to-image generation, and instruction-guided image editin… | 54 | 2156 | active |
| PKU-YuanGroup/LLaVA-CoT LLaVA-CoT is an 11B vision language model with training, inference, and dataset-generation code for spontaneous step-by-step multimodal rea… | 44 | 2131 | active |
| facebookresearch/theseus Theseus is a PyTorch-based library for building custom differentiable nonlinear optimization layers, supporting problems in robotics and vi… | 23 | 2060 | active |
| serengil/retinaface RetinaFace is a Python library for deep learning based face detection, built on TensorFlow and derived from the insightface project's Retin… | 66 | 2042 | active |
| jd-opensource/JoyAI-VL-Interaction JoyAI-VL-Interaction is an open 8B-scale vision-language interaction model with a complete deployable real-time streaming system, including… | 59 | 1970 | active |
| diffgram/diffgram Diffgram is a self-hosted AI datastore for managing schemas, BLOBs, and predictions, with built-in human supervision (data labeling), data … | 59 | 1911 | active |
| sicxu/Deep3DFaceRecon_pytorch A PyTorch implementation of Deep3DFaceReconstruction, a weakly-supervised CNN method for reconstructing 3D face geometry from a single imag… | 32 | 1911 | stable |
| PRIME-RL/SimpleVLA-RL SimpleVLA-RL is an open-source reinforcement learning framework for training Vision-Language-Action (VLA) models for robotic manipulation, … | 43 | 1864 | active |
| Zheng-Chong/CatVTON CatVTON is a lightweight diffusion model for virtual try-on that swaps clothing onto a person image using a concatenation-based architectur… | 37 | 1860 | active |
| YangLing0818/RPG-DiffusionMaster Official implementation of RPG (Recaption, Plan, Generate), a training-free framework that uses multimodal LLMs as prompt recaptioners and … | 26 | 1842 | active |
| Robbyant/lingbot-vla LingBot-VLA is a Vision-Language-Action foundation model for robot manipulation, pretrained on 20,000 hours of real-world dual-arm robot da… | 51 | 1837 | active |
| Emu Series Emu3 is a suite of state-of-the-art multimodal models from BAAI trained solely with next-token prediction, tokenizing images, text, and vid… | 53 | 1777 | active |
| GAP-LAB-CUHK-SZ/gaustudio GauStudio is a modular PyTorch framework for 3D Gaussian Splatting (3DGS) research and development, supporting novel view synthesis, 3D rec… | 46 | 1763 | active |
| One-2-3-45/One-2-3-45 One-2-3-45 is the official PyTorch implementation of a NeurIPS 2023 paper that converts any single image into a full 360-degree 3D textured… | 29 | 1717 | stable |
| williamyang1991/DualStyleGAN Official PyTorch implementation of DualStyleGAN, a CVPR 2022 model for exemplar-based high-resolution (1024px) portrait style transfer. It … | 32 | 1682 | stable |
| Stability-AI/stable-virtual-camera Stable Virtual Camera (SEVA) is a generalist diffusion model for novel view synthesis that generates 3D-consistent views of a scene from an… | 51 | 1664 | active |
| ZJU4HealthCare/HealthGPT HealthGPT is a medical multimodal large language model family unifying medical image comprehension and generation via heterogeneous knowled… | 60 | 1662 | active |
| guochengqian/Magic123 Magic123 is the official PyTorch implementation of an ICLR 2024 paper that generates high-quality textured 3D meshes from a single unposed … | 84 | 1623 | stable |
| PKU-Alignment/safe-rlhf Beaver is a modular open-source framework from Peking University for training large language models with SFT, RLHF, and Safe RLHF (constrai… | 50 | 1617 | active |
| zju3dv/EasyVolcap EasyVolcap is a PyTorch-based library for accelerating neural volumetric video research, covering volumetric video capture, reconstruction,… | 69 | 1594 | active |
| photosynthesis-team/piq PyTorch Image Quality (PIQ) is a collection of measures and metrics for image quality assessment in image-to-image tasks, written in pure P… | 23 | 1576 | stable |
| RightNow-AI/autokernel AutoKernel is an open-source autoresearch pipeline that takes any PyTorch model, profiles it to find GPU kernel bottlenecks, extracts them … | 44 | 1571 | active |
| tianrun-chen/SAM-Adapter-PyTorch A PyTorch library that adapts Meta AI's Segment Anything Model (SAM, SAM2, SAM3) to underperforming downstream segmentation tasks using lig… | 64 | 1553 | active |
| luciddreamer-cvlab/LucidDreamer LucidDreamer is the official implementation of a research method that generates 3D Gaussian Splatting scenes from text prompts, published i… | 66 | 1528 | active |
| ATH-MaaS/Ovis Ovis is an open-source Multimodal Large Language Model (MLLM) architecture that structurally aligns visual and textual embeddings, with rel… | 62 | 1528 | active |
| hkchengrex/Tracking-Anything-with-DEVA DEVA is a decoupled video segmentation framework that combines task-specific image-level segmentation models with a universal bi-directiona… | 24 | 1522 | stable |
| Vincentqyw/cv-arxiv-daily An automated daily digest of computer vision and robotics arXiv papers (SLAM, SFM, visual localization, keypoint detection, image matching,… | 76 | 1500 | active |
| alibaba/Logics-Parsing Logics-Parsing is an end-to-end document parsing model from Alibaba that converts document images into structured output using a single mul… | 61 | 1460 | active |
| CSAILVision/semantic-segmentation-pytorch A PyTorch implementation of semantic segmentation (scene parsing) models for the MIT ADE20K dataset, including pretrained model zoo and tra… | 32 | 5081 | maintenance |
| lxtGH/OMG-Seg Official research codebase for OMG-Seg (CVPR 2024) and OMG-LLaVA (NeurIPS 2024), unified models for image-level, object-level, and pixel-le… | 68 | 1353 | active |
| BytedTsinghua-SIA/CUDA-Agent CUDA-Agent is a large-scale agentic reinforcement learning system from ByteDance Seed and Tsinghua that trains LLMs to generate high-perfor… | 53 | 1338 | active |
| CarperAI/trlx trlX is a distributed training framework for fine-tuning large language models with reinforcement learning from human feedback (RLHF), supp… | 23 | 4756 | maintenance |
| Henry-23/VideoChat A real-time voice-interactive digital human application that combines ASR, LLM, TTS, and talking-head generation (MuseTalk) into a low-late… | 45 | 1321 | active |
| deepseek-ai/DeepSeek-Prover-V2 DeepSeek-Prover-V2 is an open-source large language model for formal theorem proving in Lean 4, trained via reinforcement learning with sub… | 31 | 1311 | active |
| donydchen/mvsplat MVSplat is a PyTorch implementation of an ECCV 2024 Oral model that predicts 3D Gaussians from sparse multi-view images in a single feed-fo… | 58 | 1308 | active |
| zju3dv/MatchAnything MatchAnything is a deep learning model for universal cross-modality image matching, released as research code accompanying a TPAMI 2026 pap… | 64 | 1293 | active |
| nv-tlabs/Difix3D Difix3D+ is a research codebase from NVIDIA implementing a single-step diffusion model pipeline that removes artifacts from NeRF and 3D Gau… | 29 | 1285 | active |
| X-Square-Robot/wall-x Wall-X is the open-source training and inference stack for X Square Robot's WALL series of embodied foundation models (VLAs) for general-pu… | 61 | 1283 | active |
| DeepEyes DeepEyes is a research project that trains multimodal vision-language models to 'think with images' using end-to-end reinforcement learning… | 41 | 1278 | active |
| Linketic/CityGaussian Official implementation of the CityGaussian series (ECCV 2024, ICLR 2025) for high-quality large-scale 3D scene reconstruction with Gaussia… | 63 | 1275 | active |
| rlawjdghek/StableVITON StableVITON is the official PyTorch implementation of a CVPR 2024 paper that performs image-based virtual try-on using a pre-trained latent… | 44 | 1267 | stable |
| ziyc/drivestudio DriveStudio is a Python framework for 3D Gaussian Splatting (3DGS) based reconstruction and simulation of dynamic urban driving scenes. It … | 37 | 1267 | active |
| cvg/depthsplat DepthSplat is a PyTorch research library implementing a CVPR 2025 model that connects Gaussian splatting with single/multi-view depth estim… | 53 | 1262 | active |
| unum-cloud/UForm UForm is a compact multimodal AI library providing tiny image-text embedding models (64-768 dimensions, Matryoshka-style) and small generat… | 50 | 1254 | active |
| VainF/pytorch-msssim A PyTorch library providing fast, differentiable SSIM and MS-SSIM image quality metrics using separable Gaussian filtering for speed. It ca… | 23 | 1253 | stable |
| 3DTopia/OpenLRM OpenLRM is an open-source PyTorch implementation of Large Reconstruction Models (LRM) that reconstruct 3D objects (meshes and rendered vide… | 18 | 1250 | active |
| marian42/mesh_to_sdf A Python library that computes approximate signed distance fields (SDFs) for arbitrary triangle meshes, including non-watertight, self-inte… | 32 | 1246 | stable |
| ZHKKKe/MODNet MODNet is a deep learning model for real-time portrait matting (background removal) that requires only an RGB image as input, with no trima… | 32 | 4376 | maintenance |
| apchenstu/TensoRF TensoRF is a PyTorch implementation of the ECCV 2022 paper 'TensoRF: Tensorial Radiance Fields', which models and reconstructs radiance fie… | 41 | 1239 | stable |
| EvolvingLMMs-Lab/LLaVA-OneVision-2 A fully open framework for training multimodal large language models, releasing models, datasets, and training recipes for the LLaVA-OneVis… | 70 | 1220 | active |
| ubicomplab/rPPG-Toolbox rPPG-Toolbox is an open-source Python toolbox for camera-based physiological sensing (remote photoplethysmography), enabling heart rate and… | 48 | 1214 | active |
| Tencent-Hunyuan/HunyuanWorld-Mirror HunyuanWorld-Mirror is a feed-forward 3D reconstruction model from Tencent that predicts camera poses, intrinsics, depth maps, point clouds… | 52 | 1210 | active |
| deepseek-ai/DeepSeek-VL DeepSeek-VL is an open-source vision-language foundation model for real-world multimodal understanding, released with model weights and inf… | 26 | 4183 | maintenance |
| trianglesplatting/triangle-splatting Official implementation of 'Triangle Splatting for Real-Time Radiance Field Rendering' (3DV 2026), which uses 3D triangles as rendering pri… | 40 | 1197 | active |
| chensjtu/GaussianObject GaussianObject is a research framework for high-quality 3D object reconstruction from as few as four input images using Gaussian splatting,… | 26 | 1192 | active |
| YOPO YOPO is a learning-based one-stage planner for quadrotor autonomous navigation in obstacle-dense environments, integrating perception, mapp… | 76 | 1187 | active |
| DAMO-NLP-SG/VideoLLaMA3 VideoLLaMA 3 is a frontier multimodal foundation model for image and video understanding, released with checkpoints, inference code, and de… | 34 | 1186 | active |
| majianjia/nnom NNoM is a high-level neural network inference library written in C for microcontrollers. It converts Keras models into optimized on-device … | 23 | 1170 | stable |
| OpenGVLab/VisionLLM VisionLLM is a series of open-source multimodal large language models from OpenGVLab that unify vision-centric tasks under language instruc… | 30 | 1153 | active |
| princeton-vl/DPVO DPVO is a deep learning-based visual odometry and SLAM system that estimates camera trajectories from video or image sequences using patch-… | 75 | 1127 | active |
| szymanowiczs/splatter-image Official PyTorch implementation of 'Splatter Image: Ultra-Fast Single-View 3D Reconstruction' (CVPR 2024), which uses an image-to-image net… | 27 | 1111 | active |
| jina-ai/discoart DiscoArt is a Python library that wraps Disco Diffusion (CLIP-guided diffusion) so generative artists and developers can create AI artworks… | 23 | 3818 | maintenance |
| yzslab/gaussian-splatting-lightning A PyTorch Lightning implementation of 3D Gaussian Splatting with many derived algorithms (Mip-Splatting, LightGaussian, 2DGS, deformable Ga… | 56 | 1107 | active |
| lizhe00/AnimatableGaussians Official PyTorch implementation of the CVPR 2024 paper 'Animatable Gaussians', which learns pose-dependent Gaussian maps for high-fidelity … | 27 | 1099 | active |
| Toni-SM/skrl skrl is an open-source modular Reinforcement Learning library written in Python, implemented in PyTorch, JAX, and NVIDIA Warp. It supports … | 86 | 1098 | active |
| mlc-ai/web-stable-diffusion A project that compiles and runs Stable Diffusion text-to-image models entirely inside web browsers using WebGPU and WebAssembly, with no s… | 31 | 3724 | maintenance |
| LujiaJin/One-Pot_Multi-Frame_Denoising Official PyTorch implementation of the One-Pot Multi-frame Denoising (OPD) method published at BMVC 2022 and extended in IJCV. It provides … | 57 | 1084 | stable |
| HannesStark/boltzgen BoltzGen is an open-source all-atom generative diffusion model for designing protein and peptide binders against arbitrary biomolecular tar… | 75 | 1081 | active |
| Stability-AI/stable-point-aware-3d SPAR3D is Stability AI's open-source model for fast single-image 3D mesh reconstruction using a two-stage pipeline with point cloud conditi… | 27 | 1077 | active |