Ross ROSS = Recommend OSS · open-source software intelligence for agents

Open-source deep-learning software

2663 open-source libraries, tools and applications tagged deep-learning, ranked by how closely deep-learning is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.

2663 products, primary matches first, then adoption-weighted; health v2 shown.

ProductHealth v2StarsMaturity
FlagOpen/RoboBrain2.5
RoboBrain 2.5 is an open-source embodied AI foundation model from BAAI that combines multimodal large language model capabilities with 3D s…
471150active
Being-H
Being-H is a family of human-centric embodied foundation models, including VLA models (Being-H0.5, Being-H0) and latent world-action models…
621148active
amazon-science/mm-cot
Official PyTorch implementation of the paper 'Multimodal Chain-of-Thought Reasoning in Language Models', which adds vision features to a tw…
313978maintenance
xzf-thu/Mega-ASR
Mega-ASR is a foundation automatic speech recognition model trained on 2.6M samples spanning 7 atomic acoustic conditions and 54 compound r…
561146active
HengyiWang/spann3r
Spann3R is a transformer-based model for dense 3D reconstruction from ordered or unordered image collections, built on the DUSt3R paradigm.…
231145active
ScorpioLea/AiCE
AiCE is a Python tool that predicts high-fitness protein mutations by sampling sequences from protein inverse folding models such as Protei…
371144active
noahcao/OC_SORT
OC-SORT is a pure motion-model-based multi-object tracker for video, improving on SORT by fixing Kalman filter limitations to handle occlus…
641143stable
rohitgandikota/sliders
Official implementation of Concept Sliders, LoRA adaptors that enable precise, plug-and-play control of attributes in diffusion models like…
491143active
THUMNLab/AutoGL
AutoGL is an autoML framework and toolkit for machine learning on graphs, built on PyTorch with PyTorch Geometric and DGL backends. It prov…
431142active
LLM-Pruner
LLM-Pruner is a PyTorch library implementing structural pruning of large language models based on gradient information, as published at Neu…
301142active
clovaai/deep-text-recognition-benchmark
Official PyTorch implementation of a four-stage scene text recognition (OCR) framework from an ICCV 2019 paper, with training and evaluatio…
323941maintenance
andabi/deep-voice-conversion
A TensorFlow implementation of deep neural networks for voice conversion (voice style transfer) that converts a source speaker's voice into…
323941maintenance
Kiteretsu77/APISR
APISR is a deep-learning based super-resolution tool that restores and enhances low-quality, low-resolution anime images and videos using t…
341138active
rhymes-ai/Allegro
Allegro is an open-source text-to-video generation model that produces high-quality 720p videos up to 6 seconds at 15 FPS from text prompts…
231138active
alibaba-damo-academy/RynnVLA-002
RynnVLA-002 is a unified autoregressive Vision-Language-Action and world model that generates robot actions from text and image observation…
401136active
OpenDriveLab/UniVLA
UniVLA is an open-source framework for training cross-embodiment vision-language-action (VLA) robot policies using task-centric latent acti…
401134active
facebookresearch/watermark-anything
Official PyTorch implementation and pretrained models for the paper 'Watermark Anything with Localized Messages', which embeds multiple loc…
101134active
Janspiry/Image-Super-Resolution-via-Iterative-Refinement
An unofficial PyTorch implementation of SR3 (Image Super-Resolution via Iterative Refinement), a diffusion-based model for image super-reso…
323922maintenance
sooftware/conformer
An unofficial PyTorch implementation of the Conformer architecture (convolution-augmented Transformer) from the INTERSPEECH 2020 paper, tar…
651132active
OpenGVLab/VideoMamba
VideoMamba is a state space model (Mamba-based) architecture for efficient video understanding, released with code and pretrained models fr…
261130active
ikostrikov/pytorch-a2c-ppo-acktr-gail
A PyTorch implementation of several deep reinforcement learning algorithms: A2C, PPO, ACKTR, and GAIL (imitation learning). It works with O…
323907maintenance
Dobiasd/frugally-deep
frugally-deep is a lightweight header-only C++ library for running inference (forward passes) on Keras/TensorFlow models without linking ag…
791128active
princeton-vl/DPVO
DPVO is a deep learning-based visual odometry and SLAM system that estimates camera trajectories from video or image sequences using patch-…
751127active
nnsight
nnsight is a Python library for interpreting and intervening on the internals of deep learning models, built on PyTorch. It lets researcher…
961125active
THU-MIG/RepViT
Official PyTorch implementation of RepViT, a family of lightweight CNNs designed by integrating efficient ViT architectural designs into Mo…
201123stable
THUDM/SwissArmyTransformer
SwissArmyTransformer (sat) is a PyTorch library for developing custom Transformer model variants where models like BERT, GPT, T5, GLM, and …
231122active
MST (Spectral Compressive Imaging Toolbox)
A Python toolbox for spectral compressive imaging reconstruction that implements over 15 algorithms including MST, CST, DAUHST, BiSCI, HDNe…
491121active
FlagAI-Open/FlagAI
FlagAI is a Python toolkit for training, fine-tuning, and deploying large-scale AI models across NLP, CV, and vision-language tasks. It int…
613870maintenance
PaddlePaddle/PaddleHelix
PaddleHelix is a bio-computing platform built on PaddlePaddle featuring large-scale representation learning and multi-task deep learning fo…
521120active
yangxue0827/RotationDetection
AlphaRotate is a TensorFlow-based benchmark and toolbox for rotated (oriented) object detection, implementing detectors such as R2CNN, Reti…
231120active
yandex-research/tabm
TabM is a PyTorch-based deep learning model for tabular data that efficiently imitates an ensemble of MLPs through parameter-efficient ense…
321119active
HITsz-TMG/Uni-MoE
Uni-MoE is a family of open-source Mixture-of-Experts (MoE) based omnimodal large language models that understand and generate across text,…
651118active
Lasagne
Lasagne is a lightweight Python library for building and training neural networks on top of Theano. It supports feed-forward, convolutional…
233858maintenance
OpenMOSS/MOVA
MOVA is an open-source foundation model and toolkit for joint video-audio generation, synthesizing synchronized video and audio in a single…
591117active
MatchZoo
MatchZoo is a Python toolkit for designing, comparing, and sharing deep text matching models. It provides a unified data pipeline, pre-buil…
233849maintenance
openai/improved-diffusion
The official codebase for OpenAI's Improved Denoising Diffusion Probabilistic Models paper, providing a Python package for training and sam…
323848maintenance
yahoo/TensorFlowOnSpark
TensorFlowOnSpark is a Python library that lets existing TensorFlow programs run distributed training and inference on Apache Spark and Had…
233847maintenance
open-mmlab/PowerPaint
PowerPaint is a versatile image inpainting model (ECCV 2024) built on diffusion models that handles text-guided object insertion, object re…
671113active
LAMDA-CL/PyCIL
PyCIL is a PyTorch-based Python toolbox for class-incremental learning, implementing the largest collection of CIL methods for reproducible…
481112active
szymanowiczs/splatter-image
Official PyTorch implementation of 'Splatter Image: Ultra-Fast Single-View 3D Reconstruction' (CVPR 2024), which uses an image-to-image net…
271111active
baofff/U-ViT
U-ViT is the official PyTorch implementation of a ViT-based backbone architecture for diffusion models from the CVPR 2023 paper 'All are Wo…
321109stable
WangLibo1995/GeoSeg
GeoSeg is an open-source PyTorch-based semantic segmentation toolbox focused on Vision Transformers for remote sensing imagery, featuring t…
321109active
yzslab/gaussian-splatting-lightning
A PyTorch Lightning implementation of 3D Gaussian Splatting with many derived algorithms (Mip-Splatting, LightGaussian, 2DGS, deformable Ga…
561107active
PyABSA
PyABSA is a PyTorch-based library providing state-of-the-art models for aspect-based sentiment analysis, including aspect term extraction, …
661105active
google-research/multinerf
Google Research's official code release for three NeRF papers: Mip-NeRF 360, Ref-NeRF, and RawNeRF, written in JAX. It trains neural radian…
103805maintenance
PharMolix/OpenBioMed
OpenBioMed is an open-source toolkit and agent platform for biomedicine and life science, offering multimodal models like BioMedGPT-Mol, 45…
691104active
TencentARC/T2I-Adapter
Official implementation of T2I-Adapter, lightweight adapter models that add controllable conditioning (sketch, canny, lineart, depth, pose)…
313799maintenance
naturomics/CapsNet-Tensorflow
A TensorFlow implementation of CapsNet (Capsule Networks) based on Geoffrey Hinton's paper 'Dynamic Routing Between Capsules'. It supports …
323786maintenance
lucidrains/tab-transformer-pytorch
A PyTorch implementation of the TabTransformer architecture, an attention-based neural network for tabular data, also including the FT Tran…
641099stable
NVIDIA/DreamDojo
NVIDIA's official PyTorch codebase for DreamDojo, a generalist robot world model pretrained on 44k hours of human egocentric video and post…
451099active
lizhe00/AnimatableGaussians
Official PyTorch implementation of the CVPR 2024 paper 'Animatable Gaussians', which learns pose-dependent Gaussian maps for high-fidelity …
271099active
zai-org/CogView4
CogView4, CogView3-Plus and CogView3 are open-source text-to-image generation models from Zhipu AI, with CogView4 being a 6B-parameter DiT-…
251099active
lucidrains/stylegan2-pytorch
A simple PyTorch implementation of StyleGAN2, a state-of-the-art generative adversarial network, trainable entirely from the command line w…
233779maintenance
Toni-SM/skrl
skrl is an open-source modular Reinforcement Learning library written in Python, implemented in PyTorch, JAX, and NVIDIA Warp. It supports …
861098active
microsoft/TimeCraft
TimeCraft is a diffusion model-based framework for generating high-quality synthetic time series data across domains. It uses learned seman…
661096active
Eyeline-Labs/Go-with-the-Flow
Official implementation of the CVPR 2025 Oral paper 'Go-with-the-Flow', which controls motion in video diffusion models by replacing i.i.d.…
391096active
Soul-AILab/SoulX-FlashHead
SoulX-FlashHead is a 1.3B-parameter framework for high-fidelity, infinite-length, real-time streaming talking-head portrait video generatio…
501093active
NVlabs/Fast-dLLM
NVIDIA's official implementation of Fast-dLLM, a family of training-free and fine-tuning-based acceleration techniques for diffusion-based …
541090active
zju3dv/InfiniDepth
InfiniDepth is a CVPR 2026 research library for monocular depth estimation that represents depth as neural implicit fields, allowing depth …
591089active
mymusise/ChatGLM-Tuning
A Python toolkit for fine-tuning the ChatGLM-6B large language model using LoRA (Low-Rank Adaptation) with the Alpaca dataset. It provides …
103738maintenance
rhymes-ai/Aria
Aria is an open multimodal native Mixture-of-Experts (MoE) model with 25.3B total parameters (3.9B activated per token) and a 64K multimoda…
231088active
agi-brain/xuance
XuanCe is an open-source Python library of deep reinforcement learning (DRL) and multi-agent reinforcement learning (MARL) algorithm implem…
911087active
k2-fsa/ZipVoice
ZipVoice is a series of fast, high-quality zero-shot text-to-speech models based on flow matching, with a compact 123M-parameter Zipformer-…
401087active
yerfor/Real3DPortrait
Official PyTorch implementation of Real3D-Portrait, an ICLR 2024 Spotlight paper for one-shot realistic 3D talking portrait synthesis. It g…
261087active
PointNeXt
PointNeXt is the official PyTorch implementation of the NeurIPS'22 paper that improves PointNet++ via better training and model scaling str…
871086stable
DSE-MSU/DeepRobust
DeepRobust is a PyTorch library for adversarial robustness research, providing implementations of attack and defense methods for both image…
411086active
GraphSAGE
Reference implementation of the GraphSAGE algorithm for inductive representation learning on large graphs using stochastic graph convolutio…
323728maintenance
mlc-ai/web-stable-diffusion
A project that compiles and runs Stable Diffusion text-to-image models entirely inside web browsers using WebGPU and WebAssembly, with no s…
313724maintenance
Alpha-VLLM/Lumina-mGPT-2.0
Lumina-mGPT 2.0 is a stand-alone decoder-only autoregressive model trained from scratch that unifies a broad range of image generation task…
391084active
kimiyoung/transformer-xl
Official implementation of Transformer-XL, an attention-based language model architecture that extends context beyond a fixed length via se…
323717maintenance
bytedance/byteps
BytePS is a high-performance parameter server framework for distributed deep neural network training, supporting TensorFlow, Keras, PyTorch…
103717maintenance
charlesq34/pointnet2
Official TensorFlow implementation of PointNet++, a deep neural network that learns hierarchical features on 3D point clouds using metric-s…
323712maintenance
HannesStark/boltzgen
BoltzGen is an open-source all-atom generative diffusion model for designing protein and peptide binders against arbitrary biomolecular tar…
751081active
facebookresearch/hiera
Hiera is the official PyTorch implementation of a hierarchical vision transformer from Meta AI (ICML 2023 Oral). It achieves state-of-the-a…
201077active
arcee-ai/DistillKit
DistillKit is an open-source Python toolkit for knowledge distillation of large language models, supporting both online and offline distill…
571076active
EchoMimic
EchoMimic is a series of open-source models (V1-V3) from Ant Group for audio-driven human animation, generating lifelike talking-head, port…
471075active
AILab-CVC/UniRepLKNet
UniRepLKNet is a large-kernel ConvNet architecture (CVPR 2024, TPAMI 2025) that provides universal perception across image, audio, video, p…
401074stable
cleardusk/3DDFA
A PyTorch implementation of the TPAMI 2017 paper 'Face Alignment in Full Pose Range: A 3D Total Solution' (3DDFA). It fits a 3D Morphable M…
233678maintenance
openai/glide-text2im
Official codebase for GLIDE, a diffusion-based text-conditional image synthesis model from OpenAI. It provides pretrained models and notebo…
103678maintenance
NVIDIA-Merlin/HugeCTR
HugeCTR is a GPU-accelerated deep learning framework from NVIDIA designed for training and inference of large recommender models, especiall…
711073active
open-gigaai/giga-train
GigaTrain is an efficient and scalable Python training framework for large AI models, supporting distributed multi-GPU/multi-node execution…
591072active
RL-VIG/LibFewShot
LibFewShot is a comprehensive PyTorch library for few-shot learning, implementing many fine-tuning, meta-learning, and metric-learning meth…
511072active
memoavatar/memo
MEMO is an open-weight diffusion model for generating expressive, identity-consistent talking videos from a single reference image and an a…
371071active
LAM
LAM is a PyTorch implementation of a Large Avatar Model that reconstructs an animatable 3D Gaussian head from a single image in one forward…
551070active
ZhengYinan-AIR/Diffusion-Planner
Official PyTorch implementation of Diffusion Planner, an ICLR 2025 Oral paper using a DiT-based diffusion model for closed-loop autonomous …
501069active
gangweix/pixel-perfect-depth
Pixel-Perfect Depth is a monocular depth estimation model based on pixel-space diffusion transformers that produces flying-pixel-free depth…
461069active
juntang-zhuang/Adabelief-Optimizer
AdaBelief is a deep learning optimizer that adapts step sizes based on the 'belief' in observed gradients, combining Adam's fast convergenc…
321069stable
yeates/PromptFix
PromptFix is a PyTorch implementation of a diffusion-model-based image restoration model that follows natural language instructions to fix …
251069active
lucidrains/mlp-mixer-pytorch
A PyTorch implementation of Google AI's MLP-Mixer, an all-MLP architecture for image classification that uses neither convolutions nor atte…
441068active
nv-tlabs/PiD
PiD is a plug-and-play pixel diffusion decoder from NVIDIA that replaces VAE/RAE decoders, decoding latent representations directly into hi…
531067active
princeton-nlp/SimCSE
SimCSE is a Python library and research codebase implementing simple contrastive learning for sentence embeddings, with pre-trained unsuper…
233652maintenance
hujie-frank/SENet
Official Caffe/CUDA implementation of Squeeze-and-Excitation Networks (SENet), channel-attention building blocks for convolutional neural n…
323651maintenance
X-LANCE/SLAM-LLM
SLAM-LLM is a deep learning toolkit for training custom multimodal large language models focused on speech, language, audio, and music proc…
521066active
drprojects/superpoint_transformer
Official PyTorch implementation of Superpoint Transformer (ICCV'23), SuperCluster (3DV'24), and EZ-SP (ICRA'26) for efficient semantic and …
741063active
vijishmadhavan/ArtLine
ArtLine is a deep learning project that converts portrait photos into line art portraits, with a ControlNet-based variant that adjusts styl…
323634maintenance
Tencent-Hunyuan/HunyuanVideo-Foley
HunyuanVideo-Foley is a multimodal diffusion model from Tencent Hunyuan that generates high-fidelity Foley sound effects synchronized with …
341061active
abertsch72/unlimiformer
Unlimiformer is a method and official implementation for augmenting pretrained encoder-decoder transformers with retrieval-based attention,…
301061stable
open-gigaai/giga-models
GigaModels is an open-source Python framework providing pipelines for training, inference, deployment, and compression of multi-modal, gene…
591060active
StarGAN v2
The official PyTorch implementation of StarGAN v2, a CVPR 2020 paper on diverse image-to-image translation across multiple domains using a …
323618maintenance
mgsalem/Tensorflow-Project-Template
A Python project template that provides a recommended folder structure and object-oriented skeleton (base model, base trainer, data loader,…
323616maintenance

← prev page 12 / 27 next →