Open-source deep-learning software

2785 open-source libraries, tools and applications tagged deep-learning, ranked by how closely deep-learning is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.

2785 products, primary matches first, then adoption-weighted; health v2 shown.

Product	Health v2	Stars	Maturity
TensorFlow.js A collection of pre-trained machine learning models ported to TensorFlow.js, published as npm packages for use in JavaScript projects. Mode…	59	14812	active
RWKV RWKV is a novel language model architecture that combines RNN efficiency (linear time, constant memory, no KV-cache) with transformer-level…	66	14744	active
facebookresearch/vggt VGGT (Visual Geometry Grounded Transformer) is a feed-forward transformer model from Meta AI and Oxford VGG that infers 3D geometry—camera …	55	14499	active
dlib Dlib is a modern C++ toolkit containing machine learning algorithms, deep learning tools, computer vision, linear algebra, and general-purp…	84	14458	stable
PaddlePaddle/PaddleDetection PaddleDetection is an object detection toolkit built on the PaddlePaddle deep learning framework. It provides implementations of detection,…	67	14431	active
Flair Flair is a Python NLP framework built on PyTorch for state-of-the-art natural language processing tasks such as named entity recognition, p…	48	14392	active
dmlc/dgl DGL (Deep Graph Library) is a Python package for deep learning on graph-structured data, built on top of existing frameworks like PyTorch, …	34	14281	stable
Eclipse Deeplearning4j Eclipse Deeplearning4J is an open-source deep learning framework and ecosystem for the JVM, including the ND4J linear algebra library, the …	76	14269	active
unifyai/ivy Ivy is a Python library that transpiles machine learning code, models, and libraries between frameworks such as PyTorch, TensorFlow, JAX, a…	10	14172	active
mlfoundations/open_clip OpenCLIP is an open-source PyTorch implementation of CLIP and related multimodal contrastive models, with many pretrained image/text checkp…	80	14157	active
Physical-Intelligence/openpi Open-source repository from Physical Intelligence containing vision-language-action (VLA) models for robotics, including π₀, π₀-FAST, and π…	64	13991	active
apache/tvm Apache TVM is an open machine learning compiler framework that takes pre-trained models and compiles them into optimized, deployable module…	95	13840	active
Lightning-AI/litgpt LitGPT is a Python library providing from-scratch, hackable implementations of 20+ open-source large language models with recipes for pretr…	87	13718	active
NVIDIA/TensorRT NVIDIA TensorRT is an SDK for high-performance deep learning inference on NVIDIA GPUs, comprising an inference compiler that converts train…	93	13362	stable
modelscope/DiffSynth-Studio DiffSynth-Studio is an open-source diffusion model engine from the ModelScope community that integrates mainstream image, video, and audio …	77	13229	active
YaoFANGUK/video-subtitle-remover An AI-based desktop application that removes hard-coded subtitles and text-like watermarks from videos and images using deep learning inpai…	66	13131	active
deepseek-ai/FlashMLA FlashMLA is DeepSeek's library of optimized CUDA attention kernels implementing Multi-head Latent Attention (MLA), including dense and toke…	64	13063	active
zai-org/CogVideo CogVideo/CogVideoX is an open-source family of text-to-video and image-to-video generation models from Zhipu AI (THUDM), with inference and…	42	13055	active
jacobgil/pytorch-grad-cam A PyTorch library providing state-of-the-art pixel attribution (saliency) methods like GradCAM, ScoreCAM, and AblationCAM for explainable A…	72	13002	active
PaddlePaddle/PaddleFormers PaddleFormers is a Transformers-style library built on PaddlePaddle providing a model zoo of 100+ large language models and vision-language…	88	12983	active
PaddlePaddle/PaddleNLP PaddleNLP is an easy-to-use NLP and large language model development kit built on the PaddlePaddle deep learning framework, with a large pr…	59	12977	active
Vision Transformer Google Research's official JAX/Flax implementation of Vision Transformer (ViT) and MLP-Mixer architectures, with released pretrained checkp…	76	12744	stable
PaddleSpeech PaddleSpeech is an open-source speech and audio toolkit built on the PaddlePaddle deep learning platform, covering ASR with punctuation, st…	63	12689	active
HKUDS/ViMax ViMax is an agentic video generation framework that uses coordinated multi-agent collaboration (director, screenwriter, producer, video gen…	71	12666	active
sapientinc/HRM Official PyTorch implementation of the Hierarchical Reasoning Model (HRM), a 27M-parameter recurrent architecture with high-level and low-l…	49	12642	active
bmaltais/kohya_ss A Gradio-based GUI and CLI wrapper around Kohya's Stable Diffusion training scripts for fine-tuning diffusion image generation models. It s…	89	12616	active
axolotl-ai-cloud/axolotl Axolotl is a free, open-source, config-driven framework for fine-tuning large language models, supporting SFT, preference learning (DPO/KTO…	98	12591	active
Tencent-Hunyuan/HunyuanVideo HunyuanVideo is Tencent's open-source framework for large-scale video generation, providing PyTorch model definitions, pre-trained weights,…	59	12577	active
guoyww/AnimateDiff Official implementation of AnimateDiff, a plug-and-play motion modeling module that turns personalized text-to-image diffusion models (e.g.…	30	12274	active
PKU-YuanGroup/Open-Sora-Plan Open-Sora Plan is an open-source effort to reproduce OpenAI's Sora text-to-video model, providing training and inference code for video gen…	45	12209	active
xmu-xiaoma666/External-Attention-pytorch A PyTorch library (fightingcv-attention) providing clean, minimal implementations of numerous attention mechanisms, MLP variants, re-parame…	61	12186	active
ostris/ai-toolkit An all-in-one open-source training toolkit for finetuning diffusion models (image and video) on consumer-grade hardware. It supports many r…	72	12107	active
Tongyi-MAI/Z-Image Z-Image is a 6B-parameter text-to-image generation foundation model family built on a single-stream diffusion transformer, with a distilled…	43	12057	active
NVIDIA/cosmos NVIDIA Cosmos is an open platform of omnimodal world foundation models, datasets, and tools for building Physical AI systems such as robots…	69	11892	active
SpeechBrain SpeechBrain is an open-source PyTorch-based speech toolkit for building conversational AI systems. It provides training recipes, pretrained…	85	11845	active
ludwig-ai/ludwig Ludwig is a declarative, low-code deep learning framework for training, fine-tuning, and deploying AI models — from LLMs to tabular, image,…	96	11775	active
qubvel-org/segmentation_models.pytorch A PyTorch library providing neural networks for image semantic segmentation with a simple high-level API. It includes 12 encoder-decoder ar…	68	11745	stable
milesial/Pytorch-UNet A PyTorch implementation of the U-Net architecture for semantic segmentation of high-resolution images, originally built for Kaggle's Carva…	23	11668	active
CorentinJ/Real-Time-Voice-Cloning A Python implementation of the SV2TTS (Transfer Learning from Speaker Verification to Multispeaker TTS) framework that clones a voice from …	61	60174	maintenance
facebookresearch/dinov3 Reference PyTorch implementation and pretrained models for DINOv3, Meta's self-supervised vision transformer backbone family. It includes t…	56	11536	active
Kornia Kornia is a differentiable computer vision library built on PyTorch, offering GPU-accelerated image processing, augmentations, and geometri…	84	11436	active
THU-MIG/yolov10 YOLOv10 is a real-time end-to-end object detection model family that removes NMS post-processing via consistent dual assignments and optimi…	17	11331	active
Weights & Biases Weights & Biases (wandb) is a Python SDK and platform for tracking, visualizing, and managing machine learning experiments, including metri…	100	11303	active
microsoft/TRELLIS.2 TRELLIS.2 is a 4B-parameter state-of-the-art 3D generative model from Microsoft for high-fidelity image-to-3D asset generation. It uses a f…	54	11284	active
salesforce/LAVIS LAVIS is a Python library from Salesforce AI Research providing a unified toolkit for language-vision (multimodal) intelligence, including …	10	11264	active
LTX-Video Official repository for LTX-Video, a DiT-based open-weights video generation model from Lightricks that generates high-fidelity video (up t…	45	11138	active
LTX-Video Official Python package from Lightricks providing inference pipelines and LoRA training for LTX-2/LTX-2.5, an open-weights DiT-based founda…	45	11138	active
Triton Inference Server NVIDIA Triton Inference Server is an open-source inference serving software that deploys AI models from multiple frameworks (TensorRT, PyTo…	98	11075	stable
thu-ml/tianshou Tianshou is a modular, high-performance deep reinforcement learning library built on pure PyTorch and Gymnasium. It offers both low-level h…	66	11000	active
OpenVINO OpenVINO is an open-source toolkit from Intel for optimizing and deploying deep learning inference across CPU, GPU, and NPU hardware. It su…	95	10996	stable
multimodal-art-projection/YuE YuE is a family of open-source foundation models based on the LLaMA2 architecture that generate full songs (up to five minutes) with vocals…	87	10822	active
cumulo-autumn/StreamDiffusion StreamDiffusion is a Python pipeline for real-time interactive diffusion-based image generation, achieving 100+ fps on modern GPUs. It opti…	18	10817	active
SkyPilot SkyPilot is an open-source AI compute platform that unifies fragmented infrastructure (Kubernetes, Slurm, VMs, 20+ clouds) into a single po…	100	10724	active
lucidrains/denoising-diffusion-pytorch A PyTorch implementation of Denoising Diffusion Probabilistic Models (DDPM) for generative image modeling, published on PyPI as denoising_d…	86	10707	active
Megvii-BaseDetection/YOLOX YOLOX is a high-performance anchor-free YOLO object detection model family implemented in PyTorch, with pretrained weights and export suppo…	30	10628	stable
bigscience-workshop/petals Petals is a Python library that lets you run and fine-tune large language models (Llama 3.1, Mixtral, Falcon, BLOOM) on a BitTorrent-style …	23	10614	active
NVIDIA/cutlass CUTLASS is NVIDIA's collection of CUDA C++ template abstractions and Python DSLs for implementing high-performance GEMM and related linear …	98	10580	active
facebookresearch/xformers xFormers is a PyTorch-based library of hackable, optimized Transformer building blocks with custom CUDA kernels for fast, memory-efficient …	87	10565	active
vwxyzjn/cleanrl CleanRL is a deep reinforcement learning library providing high-quality, single-file implementations of algorithms like PPO, DQN, DDPG, TD3…	54	10481	active
open-mmlab/Amphion Amphion is an open-source Python toolkit for audio, music, and speech generation, supporting tasks like text-to-speech, voice conversion, s…	48	10304	active
deepseek-ai/DeepEP DeepEP is a high-performance GPU communication library for expert parallelism (EP) in MoE training and inference, providing high-throughput…	55	10263	active
xai-org/grok-1 xAI's open release of the Grok-1 open-weights model (314B-parameter Mixture-of-Experts LLM) with JAX example code for loading and running i…	26	52232	maintenance
TencentARC/PhotoMaker PhotoMaker is a personalized text-to-image generation method that encodes multiple reference face photos into a stacked ID embedding to gen…	27	10088	stable
lipku/LiveTalking LiveTalking is an open-source real-time interactive streaming digital human engine that drives a talking-head avatar from text or audio wit…	88	9997	active
ESPnet ESPnet is an end-to-end speech processing toolkit built on PyTorch covering speech recognition, text-to-speech, speech translation, enhance…	94	9989	active
facebookresearch/pytorch3d PyTorch3D is Facebook AI Research's library of efficient, reusable components for deep learning with 3D data, built on PyTorch. It provides…	70	9983	active
open-mmlab/mmsegmentation MMSegmentation is a PyTorch-based toolbox and benchmark for semantic segmentation, part of the OpenMMLab ecosystem. It provides implementat…	23	9956	stable
huggingface/accelerate Hugging Face Accelerate is a Python library that lets you run the same PyTorch training and inference code on any device or distributed con…	94	9916	stable
roboflow/rf-detr RF-DETR is a real-time transformer-based model architecture from Roboflow for object detection, instance segmentation, and keypoint detecti…	86	9678	active
arogozhnikov/einops einops is a Python library providing readable, framework-agnostic tensor operations via mini-language functions like rearrange, reduce, and…	71	9615	stable
WongKinYiu/yolov9 Official PyTorch implementation of the YOLOv9 object detection paper, featuring Programmable Gradient Information for improved accuracy. It…	17	9562	active
YaoFANGUK/video-subtitle-extractor A GUI application that extracts hard-coded (burned-in) subtitles from videos and generates SRT subtitle files using local deep-learning-bas…	64	9555	active
modelscope/facechain FaceChain is a deep-learning toolchain from ModelScope for generating identity-preserved personal portraits (digital twins) from a single p…	27	9508	active
Cog Cog is an open-source CLI tool that packages machine learning models into production-ready Docker containers using a simple cog.yaml config…	97	9484	active
OneFlow OneFlow is an open-source deep learning framework written in C++ with a PyTorch-like Python API, focused on scalable and efficient distribu…	44	9437	active
oumi-ai/oumi Oumi is an open-source Python framework and platform for the end-to-end lifecycle of open-weight LLMs: data synthesis, fine-tuning (SFT, Lo…	91	9407	active
keras-team/autokeras AutoKeras is an AutoML library for deep learning built on Keras, developed by DATA Lab at Texas A&M University. It automates model architec…	46	9336	active
bytedance/monolith Monolith is a deep learning framework built on TensorFlow for large-scale recommendation modeling. It provides collisionless embedding tabl…	10	9286	active
Deep Lake Deep Lake is an open-source database for AI that stores multimodal data (images, video, audio, text, embeddings, annotations) in a format o…	75	9249	active
coqui-ai/TTS Coqui TTS is a deep learning toolkit for text-to-speech synthesis, providing pretrained models in over 1100 languages plus tools for traini…	23	46107	maintenance
studio-dots-ai/dots.ocr dots.ocr is a 1.7B-parameter vision-language model for multilingual document layout parsing, converting documents into structured output wi…	48	9157	active
modelscope/modelscope ModelScope is a Python library and ecosystem built on the 'Model-as-a-Service' concept, providing unified APIs to download, run inference o…	96	9149	active
NVlabs/Sana SANA is an efficiency-oriented PyTorch codebase for high-resolution text-to-image and text-to-video generation built on Linear Diffusion Tr…	70	9129	active
pyro-ppl/pyro Pyro is a deep universal probabilistic programming library built on Python and PyTorch, supporting Bayesian modeling with variational infer…	65	9059	stable
FareedKhan-dev/kimi-k3-in-c A dependency-free C99 inference engine that runs the 2.78-trillion-parameter Kimi K3 model on a single CPU with as little as 8 GB of RAM by…	79	9033	active
jetson-inference A C++/Python DNN inference library and tutorial guide ('Hello AI World') for deploying deep learning vision models on NVIDIA Jetson devices…	40	9015	stable
NVIDIA/apex NVIDIA-maintained PyTorch extension providing utilities for easy mixed precision and distributed training. It offers up-to-date CUDA and C+…	75	9000	active
DepthAnything/Depth-Anything-V2 Depth Anything V2 is a foundation model for monocular depth estimation, trained on 595K synthetic labeled images and 62M+ real unlabeled im…	54	8940	stable
deepseek-ai/DeepGEMM DeepGEMM is a high-performance CUDA BLAS kernel library for NVIDIA tensor cores, providing FP8, FP4, and BF16 GEMMs plus fused MoE and othe…	82	8937	active
BentoML BentoML is a Python framework for building online serving systems for AI apps and model inference, turning model inference scripts into RES…	91	8909	stable
MIC-DKFZ/nnUNet nnU-Net is a self-configuring deep learning framework for semantic image segmentation that automatically adapts preprocessing, U-Net archit…	65	8901	stable
sebastianstarke/AI4Animation AI4Animation is a deep learning framework for data-driven character animation and control, built around Unity with a Python remake (AI4Anim…	63	8873	active
MONAI MONAI is a PyTorch-based open-source framework for deep learning in healthcare imaging, providing domain-specific transforms, 3D architectu…	91	8788	stable
FoundationVision/VAR Official PyTorch implementation of Visual Autoregressive Modeling (VAR), a NeurIPS 2024 Best Paper-winning method for scalable image genera…	45	8751	active
fudan-generative-vision/hallo Hallo is a Python research library implementing hierarchical audio-driven visual synthesis for animating portrait images into talking-head …	15	8667	active
google-deepmind/alphafold3 Google DeepMind's official implementation of the AlphaFold 3 inference pipeline for predicting biomolecular structures and interactions. It…	81	8643	active
lllyasviel/IC-Light IC-Light is a Python tool for manipulating the illumination of images using diffusion models, offering text-conditioned and background-cond…	25	8551	active
netease-youdao/EmotiVoice EmotiVoice is an open-source text-to-speech engine supporting English and Chinese with over 2000 voices and prompt-controlled emotional syn…	60	8529	active
bitsandbytes-foundation/bitsandbytes bitsandbytes is a Python library providing k-bit quantization primitives for PyTorch, enabling 8-bit (LLM.int8()) and 4-bit (QLoRA) quantiz…	94	8514	active
OptimalScale/LMFlow LMFlow is an extensible Python toolkit for finetuning and inference of large foundation models such as LLaMA, GPT-2, and Galactica. It prov…	61	8487	active