Ross ROSS = Recommend OSS · open-source software intelligence for agents

Open-source deep-learning software

2663 open-source libraries, tools and applications tagged deep-learning, ranked by how closely deep-learning is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.

2663 products, primary matches first, then adoption-weighted; health v2 shown.

ProductHealth v2StarsMaturity
jadore801120/attention-is-all-you-need-pytorch
A PyTorch implementation of the Transformer model from the paper 'Attention Is All You Need', including training and translation scripts fo…
329816maintenance
Alibaba-Quark/LiveAvatar
LiveAvatar is an open-source implementation of an ECCV 2026 paper for streaming, real-time, infinite-length audio-driven avatar video gener…
582456active
facebookresearch/pifuhd
PIFuHD is a PyTorch implementation of a CVPR 2020 research model that reconstructs high-resolution 3D human body meshes from a single 2D im…
109724maintenance
TorchIO-project/torchio
TorchIO is a Python library for loading, augmenting, and processing 3D medical images (MRI, CT) within PyTorch deep learning pipelines. It …
912446active
AI-Hypercomputer/maxtext
MaxText is a high-performance, scalable open-source LLM training library written in pure Python/JAX, targeting Google Cloud TPUs and GPUs. …
982444active
shenweichen/DeepMatch
DeepMatch is a Python library of deep matching models for recommendations and advertising, built on TensorFlow/Keras. It lets users train m…
662435active
resemble-ai/resemble-enhance
Resemble Enhance is an AI-powered Python tool that improves speech quality through denoising and enhancement, using a denoiser module and a…
182434active
wolny/pytorch-3dunet
A PyTorch implementation of 3D U-Net and its variants (residual, squeeze-and-excitation) for volumetric semantic segmentation, with 2D U-Ne…
572423active
HuCaoFighting/Swin-Unet
Official PyTorch implementation of Swin-Unet, a U-shaped pure Transformer model for medical image segmentation, published at ECCV 2022 Medi…
382420stable
tflearn/tflearn
TFLearn is a modular deep learning library providing a higher-level, Keras-like API on top of TensorFlow for building and training neural n…
239570maintenance
X-PLUG/mPLUG-DocOwl
mPLUG-DocOwl is a family of multimodal large language models from Alibaba for OCR-free document understanding, including DocOwl1.5 and DocO…
372413active
OpenGVLab/InternVideo
InternVideo is a series of open-source video foundation models for multimodal video understanding, spanning generative and discriminative l…
692393active
zai-org/GLM-V
GLM-V is the open-source repository for Zhipu AI's GLM-4.6V, GLM-4.5V, and GLM-4.1V-Thinking vision-language models, which perform versatil…
632393active
google/neural-tangents
Neural Tangents is a Python library built on JAX for defining, training, and evaluating neural networks of both finite and infinite width. …
102385stable
TencentARC/Pixal3D
Pixal3D is a research codebase for generating high-fidelity 3D assets from a single image using a pixel-aligned generation paradigm that ba…
562383active
facebookresearch/perception_models
Meta's Perception Models repository hosting state-of-the-art image, video, and audio encoders (Perception Encoder, PE) and a multimodal lan…
512382active
apple/axlearn
AXLearn is a Python deep learning library built on JAX and XLA for developing and training large-scale models, with an object-oriented conf…
692375active
EasyRec
EasyRec is a TensorFlow-based framework from Alibaba for building large-scale deep learning recommendation models covering matching, rankin…
592361active
tencent-ailab/V-Express
V-Express is a Python research project from Tencent AI Lab that generates talking head portrait videos from a reference image, audio, and V…
252357active
Neural Circuit Policies (ncps)
A Python package providing PyTorch and TensorFlow/Keras implementations of Neural Circuit Policies (NCPs), including liquid time-constant (…
232351active
google-deepmind/optax
Optax is a gradient processing and optimization library for JAX, offering composable building blocks like optimizers and loss functions. It…
802350stable
ASLP-lab/DiffRhythm
DiffRhythm is an open-source latent diffusion model for end-to-end full-length song generation, supporting lyrics-to-song, text style promp…
422344active
SkyworkAI/Matrix-Game
Matrix-Game is Skywork AI's open-source series of interactive world foundation models that generate real-time, streaming video in response …
502342active
YvanYin/Metric3D
Metric3D is the official PyTorch implementation of Metric3Dv1 and Metric3Dv2, monocular geometric foundation models that predict metric dep…
312326active
Picotron
Picotron is a minimalist, hackable distributed training framework for pre-training Llama-like large language models using 4D parallelism (d…
372325active
PKU-YuanGroup/MoE-LLaVA
MoE-LLaVA is an open-source Mixture-of-Experts based sparse large vision-language model, released with the MoE-Tuning training strategy fro…
282324active
Cadene/pretrained-models.pytorch
A Python library providing pretrained ConvNet models (ResNet, ResNeXt, InceptionV4, Xception, NASNet, SENet, DPN, etc.) for PyTorch behind …
329101maintenance
nv-tlabs/lyra
Project Lyra is NVIDIA's open series of generative 3D world models, including Lyra 1.0 for feed-forward 3D/4D scene generation from a singl…
562317active
facebookresearch/ImageBind
A PyTorch library from Meta AI implementing ImageBind, a model that learns a joint embedding space across six modalities: images, text, aud…
519076maintenance
OpenHelix-Team/VLA-Adapter
VLA-Adapter is the official implementation of a tiny-scale vision-language-action model that bridges vision-language representations to rob…
472313active
frgfm/torch-cam
TorchCAM is a Python library that extracts class activation maps (CAMs) from PyTorch CNN classifiers, supporting many CAM variants such as …
882307active
traveller59/spconv
SpConv is a spatially sparse convolution library for deep learning on 3D point clouds and sparse tensors, distributed as PyPI packages with…
322299active
NVlabs/nvdiffrec
nvdiffrec is NVIDIA's official implementation of a CVPR 2022 oral paper that jointly optimizes triangular 3D meshes, PBR materials, and lig…
722298stable
codeplea/genann
Genann is a minimal, well-tested C99 library for training and running feedforward artificial neural networks. It is contained in a single s…
912293stable
aigc-apps/VideoX-Fun
VideoX-Fun is a Python-based video generation pipeline built on Diffusion Transformer models (CogVideoX-Fun, Wan-Fun) that generates videos…
682292active
facebookresearch/fairchem
FAIR Chemistry's centralized Python library of machine learning models, datasets, and applications for materials science and quantum chemis…
982289active
hkchengrex/MMAudio
MMAudio is a PyTorch-based model for generating synchronized audio from video and/or text inputs, using multimodal joint training across au…
402287active
opendatalab/DocLayout-YOLO
DocLayout-YOLO is a real-time YOLO-v10-based model for detecting document layout elements (text blocks, tables, figures, etc.) in diverse d…
262277active
RosettaCommons/RoseTTAFold
RoseTTAFold is the official implementation of a deep learning system for predicting protein structures and interactions using a three-track…
232269stable
ashawkey/stable-dreamfusion
A PyTorch implementation of Dreamfusion that generates 3D models from text prompts or images using NeRF combined with Stable Diffusion guid…
238865maintenance
stepfun-ai/Step1X-Edit
Step1X-Edit is an open-source state-of-the-art instruction-based image editing model from StepFun, designed to rival closed-source editors …
522266active
aigc-apps/EasyAnimate
EasyAnimate is an end-to-end Python pipeline for high-resolution, long video and image generation based on transformer diffusion (DiT) mode…
172266active
666DZY666/micronet
micronet is a Python library for deep neural network model compression and deployment built on PyTorch. It provides quantization (QAT, PTQ,…
382265active
galilai-group/stable-worldmodel
A Python library providing a unified platform for reproducible world model research, covering data collection, training, and evaluation via…
782260active
fishaudio/Bert-VITS2
Bert-VITS2 is a text-to-speech model implementation combining the VITS2 architecture with multilingual BERT embeddings, written in Python. …
648805maintenance
facebookresearch/fvcore
fvcore is a lightweight Python core library providing common functionality shared across FAIR's computer vision frameworks such as Detectro…
732254stable
CoinCheung/pytorch-loss
A PyTorch library providing a collection of loss functions (focal loss, triplet loss, AMSoftmax, label-smooth CE, dice loss, lovasz-softmax…
322251active
Alpha-VLLM/Lumina-T2X
Lumina-T2X is a unified framework for text-to-any-modality generation built on flow-based large diffusion transformers. It supports generat…
252250active
ByteDance-Seed/VeOmni
VeOmni is a PyTorch-native framework for single- and multi-modal model pre-training and post-training, with a modular, trainer-free design …
872246active
Raster Vision
Raster Vision is an open source Python library and low-code framework for building computer vision models on satellite, aerial, and other l…
572241active
NVlabs/MambaVision
MambaVision is NVIDIA's official PyTorch implementation of a hybrid Mamba-Transformer vision backbone, published at CVPR 2025. It provides …
462235active
ellisdg/3DUnetCNN
A PyTorch library for building, training, and applying 3D U-Net convolutional neural networks for medical image segmentation. It provides c…
422235active
microsoft/LLaVA-Med
LLaVA-Med is a large language-and-vision assistant fine-tuned for the biomedicine domain, built on the LLaVA multimodal architecture. It su…
382232active
PyGAD
PyGAD is an open-source Python 3 library for implementing the genetic algorithm to optimize single- and multi-objective problems. It can al…
912230active
NVIDIA/vid2vid
A PyTorch implementation of NVIDIA's video-to-video synthesis method for generating high-resolution (e.g., 2048x1024) photorealistic videos…
328692maintenance
facebookresearch/DiT
Official PyTorch implementation of Diffusion Transformers (DiT) from the paper 'Scalable Diffusion Models with Transformers', including mod…
108676maintenance
thuml/iTransformer
Official PyTorch implementation of iTransformer, an ICLR 2024 Spotlight paper that inverts the Transformer architecture for multivariate ti…
392225stable
apple/ml-ferret
Apple's Ferret, an end-to-end multimodal large language model (MLLM) that accepts any-form referring and grounds anything in its responses,…
708655maintenance
lifeiteng/vall-e
An unofficial PyTorch implementation of VALL-E, a zero-shot text-to-speech model that treats TTS as a conditional language modeling task ov…
372221active
google-deepmind/tapnet
Google DeepMind's official repository for Tracking Any Point (TAP), containing the TAP-Vid and TAPVid-3D benchmarks, the TAPIR and TAPNext …
752217active
RubixML/ML
Rubix ML is a high-level open-source machine learning and deep learning library for PHP, offering 40+ supervised and unsupervised algorithm…
982208active
NX-AI/xlstm
Official PyTorch implementation of xLSTM, an extended Long Short-Term Memory recurrent architecture with exponential gating and matrix memo…
762205active
lucidrains/lion-pytorch
A PyTorch implementation of the Lion optimizer (Evolved Sign Momentum), discovered by Google Brain via genetic algorithms and claimed to ou…
592205active
yyfz/Pi3
Pi3 (π³) is a feed-forward neural network for visual geometry reconstruction that eliminates the need for a fixed reference view, using a p…
562188active
Harry24k/adversarial-attacks-pytorch
Torchattacks is a PyTorch library providing implementations of adversarial attacks to generate adversarial examples against deep learning m…
232185active
ViTAE-Transformer/ViTPose
Official PyTorch implementation of ViTPose and ViTPose++, Vision Transformer models for human and generic body pose estimation from NeurIPS…
552173stable
SpikingJelly
SpikingJelly is an open-source deep learning framework for Spiking Neural Networks (SNNs) built on PyTorch. It provides a beginner-friendly…
772159active
PKU-YuanGroup/Helios
Helios is a 14B autoregressive diffusion model for real-time, minute-scale video generation supporting text-to-video, image-to-video, and v…
562158active
facebookresearch/mae
A PyTorch/GPU re-implementation of the Masked Autoencoders (MAE) paper for self-supervised vision learning. It includes pre-training code, …
108362maintenance
jd-opensource/JoyAI-Image
JoyAI-Image is a unified multimodal foundation model for image understanding, text-to-image generation, and instruction-guided image editin…
552156active
google/trax
Trax is an end-to-end deep learning library built on JAX and TensorFlow that focuses on clear code and speed, developed and maintained by t…
108306maintenance
PKU-YuanGroup/LLaVA-CoT
LLaVA-CoT is an 11B vision language model with training, inference, and dataset-generation code for spontaneous step-by-step multimodal rea…
442131active
utkuozbulak/pytorch-cnn-visualizations
A PyTorch library implementing a wide range of convolutional neural network visualization and interpretability techniques, including Grad-C…
328236maintenance
lukemelas/EfficientNet-PyTorch
A PyTorch implementation of the EfficientNet convolutional neural network family with pretrained ImageNet weights. It provides a simple pip…
238219maintenance
autonomousvision/sdfstudio
SDFStudio is a unified and modular framework for neural implicit surface reconstruction built on top of nerfstudio. It provides unified imp…
322124active
3DTopia/LGM
LGM is the official PyTorch implementation of an ECCV 2024 Oral paper that generates high-resolution 3D models from text prompts or single-…
262118active
eloialonso/diamond
DIAMOND is a Python implementation of a reinforcement learning agent trained entirely inside a diffusion-based world model, presented as a …
252118active
GAIR-NLP/daVinci-MagiHuman
daVinci-MagiHuman is an open-source 15B-parameter single-stream transformer foundation model that jointly generates synchronized audio and …
462114active
facebookresearch/ai4animationpy
AI4AnimationPy is a Python framework for AI-driven character animation using neural networks, providing motion capture processing, training…
562111active
Avalanche
Avalanche is an end-to-end continual learning library built on PyTorch, developed by ContinualAI. It provides modules for benchmarks, train…
242104active
kohya-ss/musubi-tuner
Musubi Tuner is a set of Python scripts for training LoRA (Low-Rank Adaptation) adapters for video and image generation model architectures…
882103active
River-Zhang/ICEdit
ICEdit (In-Context Edit) is a research framework for instruction-based image editing built on large-scale Diffusion Transformers, using a L…
422102active
SUDO-AI-3D/zero123plus
Zero123++ is a diffusion base model that generates consistent multi-view images from a single input image, intended as a stepping stone for…
282099active
HRM-Text
HRM-Text is a 1B-parameter text generation model based on the hierarchical recurrent HRM architecture, released with a complete pretraining…
582093active
alex-damian/pulse
PULSE is a Python research implementation of a CVPR 2020 paper that upscales low-resolution face photos by searching the latent space of a …
328026maintenance
jeshraghian/snntorch
snnTorch is a Python library for gradient-based deep learning with spiking neural networks, built as an extension of PyTorch. It provides s…
682075active
WenjieDu/PyPOTS
PyPOTS is a Python toolbox for machine learning and data mining on partially-observed time series with missing values. It integrates 50+ st…
892072active
bytedance/Protenix
Protenix is an open-source PyTorch reproduction of AlphaFold 3 for high-accuracy biomolecular structure prediction, covering proteins, nucl…
782070active
facebookresearch/ConvNeXt-V2
Official PyTorch implementation of ConvNeXt V2, a family of pure convolutional neural network models co-designed with a fully convolutional…
102065stable
brightmart/text_classification
A collection of deep learning baseline models for text classification in NLP, implemented in TensorFlow. It covers classic architectures li…
327938maintenance
Plachtaa/VALL-E-X
An open-source Python implementation of Microsoft's VALL-E X zero-shot text-to-speech model, with a community-trained pretrained checkpoint…
107926maintenance
facebookresearch/theseus
Theseus is a PyTorch-based library for building custom differentiable nonlinear optimization layers, supporting problems in robotics and vi…
232060active
zju3dv/GVHMR
GVHMR is a research codebase implementing the SIGGRAPH Asia 2024 paper 'World-Grounded Human Motion Recovery via Gravity-View Coordinates'.…
662059active
shanglianlm0525/PyTorch-Networks
A collection of PyTorch implementations of classic and modern CNN architectures, covering classification, detection, segmentation, face, an…
492056active
DeePMD-kit
DeePMD-kit is a deep learning package for building many-body potential energy representations and running molecular dynamics simulations. I…
922055stable
jaywalnut310/vits
VITS is the official PyTorch implementation of an end-to-end text-to-speech model based on a conditional variational autoencoder with adver…
327894maintenance
pykeen/pykeen
PyKEEN is a Python library for training and evaluating multimodal knowledge graph embedding models built on PyTorch. It provides a high-lev…
692039active
SakanaAI/continuous-thought-machines
The Continuous Thought Machine (CTM) is a neural network architecture from Sakana AI that uses neuron-level temporal dynamics and neural sy…
432036active
tensorflow/recommenders
TensorFlow Recommenders is a Python library for building recommender system models on top of TensorFlow and Keras. It covers the full workf…
852034active
deep-floyd/IF
DeepFloyd IF is an open-source text-to-image model library implementing a cascaded pixel diffusion architecture with a frozen T5 text encod…
227793maintenance

← prev page 6 / 27 next →