Ross ROSS = Recommend OSS · open-source software intelligence for agents

Open-source deep-learning software

2663 open-source libraries, tools and applications tagged deep-learning, ranked by how closely deep-learning is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.

2663 products, primary matches first, then adoption-weighted; health v2 shown.

ProductHealth v2StarsMaturity
bytetriper/RAE
Official PyTorch implementation of 'Diffusion Transformers with Representation Autoencoders' (RAE), a two-stage image generation pipeline u…
452032active
tdrussell/diffusion-pipe
A Python training script for fine-tuning diffusion models (image and video generation) using DeepSpeed pipeline parallelism across multiple…
672028active
NUS-HPC-AI-Lab/VideoSys
VideoSys is an open-source Python library providing easy and efficient infrastructure for video generation, supporting training, inference,…
312025active
NVlabs/SPADE
Official PyTorch implementation of SPADE (GauGAN), a CVPR 2019 method for synthesizing photorealistic images from semantic segmentation map…
327717maintenance
philipperemy/keras-tcn
A Keras/TensorFlow implementation of Temporal Convolutional Networks (TCN) with dilated causal convolutions, usable as a drop-in layer alte…
582011active
cambrian-mllm/cambrian
Cambrian-1 is a fully open family of vision-centric multimodal large language models (MLLMs) from NYU's VISIONx group, with training and ev…
432011active
lyhue1991/torchkeras
torchkeras is a lightweight PyTorch model training template library that brings Keras-style compile/fit/evaluate APIs to PyTorch. Its core …
522010active
AntixK/PyTorch-VAE
A collection of Variational Autoencoder (VAE) model implementations in PyTorch, including Beta-VAE, VQ-VAE, IWAE, WAE, and others, with a f…
347678maintenance
meta-recsys/generative-recommenders
Meta's research library implementing HSTU and M-FALCON from the ICML'24 paper 'Actions Speak Louder than Words: Trillion-Parameter Sequenti…
702004active
chaidiscovery/chai-lab
Chai-1 is a state-of-the-art multi-modal foundation model for biomolecular structure prediction, handling proteins, small molecules, DNA, R…
622001active
mil-tokyo/webdnn
WebDNN is a framework for running deep neural network inference directly in the web browser, accepting ONNX models without Python preproces…
652000active
clementchadebec/benchmark_VAE
Pythae is a PyTorch library that unifies implementations of many Variational Autoencoder (VAE) variants under a common interface, enabling …
232000active
lucidrains/titans-pytorch
An unofficial PyTorch implementation of the Titans architecture, a neural long-term memory module for transformers that learns to memorize …
641996active
facebookresearch/dino
PyTorch implementation of DINO, a self-supervised learning method for training Vision Transformers, with pretrained model weights. It is th…
107609maintenance
kwuking/TimeMixer
Official PyTorch implementation of TimeMixer, an ICLR 2024 model for time series forecasting using decomposable multiscale mixing. It has s…
421991active
davda54/sam
An unofficial PyTorch implementation of Sharpness-Aware Minimization (SAM) and its adaptive variant ASAM, provided as an optimizer wrapper …
321986stable
cloneofsimo/lora
A Python library for applying Low-Rank Adaptation (LoRA) to quickly fine-tune text-to-image diffusion models like Stable Diffusion. It prod…
237557maintenance
WassimTenachi/PhySO
PhySO is a Python library for physical symbolic optimization that uses deep reinforcement learning to discover analytical physical laws fro…
491978active
showlab/Show-o
Show-o is a research repository implementing a unified transformer model that combines autoregressive and discrete diffusion modeling for m…
481978active
adobe-research/custom-diffusion
Custom Diffusion is a research codebase for efficiently fine-tuning text-to-image diffusion models like Stable Diffusion on a few example i…
661977stable
2U1/Qwen-VL-Series-Finetune
An open-source Python repository providing training scripts for fine-tuning Alibaba's Qwen-VL series of vision-language models (Qwen2-VL, Q…
661977active
OpenMotionLab/MotionGPT
MotionGPT is a unified motion-language model that treats 3D human motion as a foreign language by converting motion into discrete motion to…
301974active
JIA-Lab-research/DreamOmni2
DreamOmni2 is the official PyTorch implementation of a CVPR 2026 Highlight model for multimodal instruction-based image editing and generat…
481968active
NVlabs/RADIO
Official PyTorch implementation of AM-RADIO and its successors (RADIOv2.5, C-RADIOv4), agglomerative vision foundation models distilled fro…
611961active
open-mmlab/mmagic
MMagic is OpenMMLab's toolbox for generative and multimodal AI image/video creation, built on PyTorch. It provides a large model zoo coveri…
237469maintenance
meta-pytorch/opacus
Opacus is a PyTorch library for training neural networks with differential privacy via DP-SGD, requiring minimal code changes through its P…
731960active
SizheAn/PanoHead
PanoHead is the official PyTorch implementation of a CVPR 2023 paper presenting a 3D-aware GAN that synthesizes geometry-aware, view-consis…
301960active
Yuliang-Liu/Monkey
Monkey is a large multi-modal model (LMM) research project from CVPR 2024 that improves image understanding via higher input resolution and…
711956active
jd-opensource/JoyAI-Video-Edit
JoyAI-Video-Edit is a real-time, instruction-guided video editing system that applies natural-language edits to live or uploaded video stre…
581956active
OminiControl
OminiControl is a universal control framework for Diffusion Transformer models like FLUX, supporting subject-driven and spatial control (ed…
661955active
alibaba/EasyCV
EasyCV is an all-in-one PyTorch-based computer vision toolkit from Alibaba covering self-supervised learning, vision transformers, and majo…
281955active
LTH14/mar
Official PyTorch implementation of MAR (Masked Autoregressive) image generation with DiffLoss, from the NeurIPS 2024 paper 'Autoregressive …
511954stable
Fafa-DL/Awesome-Backbones
A PyTorch-based framework that integrates many deep learning backbone models (CNNs and vision transformers like ResNet, EfficientNet, Swin …
321953active
openai/guided-diffusion
OpenAI's codebase for guided diffusion models from the paper 'Diffusion Models Beat GANs on Image Synthesis', including classifier conditio…
327427maintenance
Vchitect/Latte
Official PyTorch implementation of Latte, a latent diffusion transformer for video generation. It includes model definitions, pre-trained c…
681948active
kyegomez/BitNet
A PyTorch implementation of the BitNet architecture from the paper 'BitNet: Scaling 1-bit Transformers for Large Language Models', providin…
731947active
Graph Convolutional Networks
A TensorFlow implementation of Graph Convolutional Networks (GCN) for semi-supervised node classification on graphs, accompanying the ICLR …
327406maintenance
microsoft/Magma
Magma is Microsoft Research's foundation model for multimodal AI agents, released as an 8B vision-language model that understands images an…
501942active
tensorlayer/TensorLayer
TensorLayer is a TensorFlow-based deep learning and reinforcement learning library offering customizable neural layers for researchers and …
237383maintenance
tum-pbs/PhiFlow
PhiFlow is an open-source Python simulation toolkit for solving partial differential equations with support for optimization and machine le…
631939active
PixArt-alpha/PixArt-sigma
PixArt-Σ is a PyTorch implementation of a diffusion transformer model for high-resolution (up to 4K) text-to-image generation, trained with…
261939active
Audio-AGI/AudioSep
AudioSep is the official implementation of the 'Separate Anything You Describe' foundation model for open-domain, language-queried audio so…
291938active
OpenTalker/video-retalking
VideoReTalking is a Python research system from SIGGRAPH Asia 2022 that edits real-world talking-head videos to match a given audio track, …
237292maintenance
Robbyant/lingbot-va
LingBot-VA is an autoregressive diffusion framework that unifies video world modeling and robot policy learning in a single interleaved vid…
531918active
FACEGOOD/FACEGOOD-Audio2Face
FACEGOOD Audio2Face is an open-source deep learning framework that converts audio into facial blendshape weights for driving digital humans…
611912active
showlab/ShowUI
ShowUI is an open-source, lightweight 2B vision-language-action model for GUI agents and computer use, accepted at CVPR 2025. The repositor…
541906active
flexflow/flexflow-train
FlexFlow Train is a deep learning framework that accelerates distributed DNN training by automatically searching for efficient parallelizat…
671903active
lucidrains/byol-pytorch
A PyTorch library implementing the Bootstrap Your Own Latent (BYOL) self-supervised learning method from DeepMind. It wraps any image-based…
551900active
google-deepmind/penzai
Penzai is a JAX research toolkit for building, editing, and visualizing neural networks as legible, functional pytree data structures. It i…
101899active
KlingAIResearch/ReCamMaster
ReCamMaster is a reference implementation of a camera-controlled generative video rendering model that re-renders a single source video alo…
411887active
NVIDIA-AI-IOT/Lidar_AI_Solution
NVIDIA's collection of GPU-accelerated Lidar AI inference solutions for autonomous driving, including optimized implementations of PointPil…
691885active
nitrain/nitrain
Nitrain is a framework-agnostic Python library for sampling, augmenting, and training AI models on medical imaging datasets, with support f…
231882active
qqwweee/keras-yolo3
A Keras (TensorFlow backend) implementation of YOLOv3 for object detection, including Darknet weight conversion, image/video detection scri…
327113maintenance
dauparas/ProteinMPNN
ProteinMPNN is a PyTorch-based tool that designs amino acid sequences for given protein backbone structures using a message-passing neural …
231872stable
Zheng-Chong/CatVTON
CatVTON is a lightweight diffusion model for virtual try-on that swaps clothing onto a person image using a concatenation-based architectur…
371860active
OpenNMT
OpenNMT is an open-source ecosystem for neural machine translation and sequence learning, with PyTorch (OpenNMT-py) and TensorFlow (OpenNMT…
407018maintenance
LuChengTHU/dpm-solver
Official PyTorch implementation of DPM-Solver and DPM-Solver++, fast high-order ODE solvers for diffusion probabilistic model sampling that…
321859stable
TorchSharp
TorchSharp is a .NET library providing bindings to LibTorch, the library that powers PyTorch, with a focus on tensors and a PyTorch-like AP…
691858active
facebookresearch/MetaCLIP
Meta's research code and models for Meta CLIP, a reimplementation and scaling recipe for CLIP-style contrastive vision-language models, inc…
761854active
SerpentAI Framework
Serpent.AI is a Python framework for building game agents—AIs and bots that learn to play any video game you own—turning games into machine…
106989maintenance
probcomp/Gen.jl
Gen.jl is a general-purpose probabilistic programming system embedded in Julia that lets users write generative models as probabilistic pro…
581851active
Tencent-Hunyuan/HunyuanVideo-I2V
HunyuanVideo-I2V is Tencent's open-source image-to-video generation framework built on the HunyuanVideo diffusion model, providing PyTorch …
511845active
NVlabs/stylegan3
Official PyTorch implementation of StyleGAN3 (Alias-Free GANs), a state-of-the-art generative adversarial network for high-fidelity image s…
326945maintenance
boundless-large-model/boundless-world-model
Boundless-World-Model (BWM) is a physically consistent, action-conditioned video world model built on Wan2.2-TI2V-5B that acts as a low-cos…
581840active
clovaai/donut
Donut is an OCR-free end-to-end Transformer model for visual document understanding tasks such as document classification and information e…
236928maintenance
NVIDIA/pix2pixHD
PyTorch implementation of pix2pixHD, a conditional GAN method for synthesizing and manipulating high-resolution (2048x1024) photorealistic …
326925maintenance
Robbyant/lingbot-vla
LingBot-VLA is a Vision-Language-Action foundation model for robot manipulation, pretrained on 20,000 hours of real-world dual-arm robot da…
521837active
ytongbai/LVM
LVM is a large vision model trained with sequential next-token prediction over 'visual sentences', using no linguistic data. It builds on O…
311836active
cazala/synaptic
Synaptic is an architecture-free neural network library for JavaScript that runs in both Node.js and the browser. It supports building and …
626912maintenance
openai/point-e
Point-E is OpenAI's official release of models and code for generating 3D point clouds from text prompts or images using diffusion models. …
326892maintenance
microsoft/mattergen
MatterGen is Microsoft's official implementation of a generative diffusion model for designing inorganic crystalline materials across the p…
651830active
timothybrooks/instruct-pix2pix
PyTorch implementation of InstructPix2Pix, a diffusion-based model that edits images according to natural language instructions (e.g., 'tur…
326885maintenance
GestaltCogTeam/BasicTS
BasicTS is a Python benchmark library and toolkit for fair and scalable time series analysis, built on PyTorch. It supports forecasting, cl…
611826active
VAST-AI-Research/TripoSG
TripoSG is an open-source image-to-3D generation foundation model that produces high-fidelity 3D meshes from single images using large-scal…
241815active
apple/ml-4m
4M is a framework from Apple and EPFL for training any-to-any multimodal foundation models using masked modeling over discrete tokens acros…
681814active
RAVE
RAVE is the official PyTorch implementation of a realtime audio variational autoencoder for fast, high-quality neural audio synthesis. It s…
511811active
yerfor/GeneFacePlusPlus
GeneFace++ is the official PyTorch implementation of a NeRF-based system for generalized and stable real-time 3D talking face generation. I…
261808active
thu-ml/RoboticsDiffusionTransformer
RDT-1B is a 1B-parameter diffusion foundation model for robot bimanual manipulation, pre-trained on 1M+ multi-robot episodes to predict rob…
481806active
HuangJunJie2017/BEVDet
BEVDet is a Python research codebase implementing the BEVDet series of bird's-eye-view (BEV) 3D object detection models for autonomous driv…
231805active
zai-org/CogVLM
CogVLM is an open-source visual language model (17B) combining a vision encoder with a pretrained language model for image understanding an…
286745maintenance
QwenLM/Qwen-VL
Official repository for Qwen-VL, Alibaba Cloud's large vision-language model family, including the pretrained Qwen-VL and instruction-tuned…
296725maintenance
microsoft/MarS
MarS is a financial market simulation engine powered by a generative foundation model, developed by Microsoft. It provides tools for simula…
641790active
lehaifeng/T-GCN
A collection of research source code implementing Temporal Graph Convolutional Networks (T-GCN) and related variants for urban traffic flow…
461787active
octo-models/octo
Octo is an open-source generalist robot policy: a transformer-based diffusion policy pretrained on 800k robot trajectories from the Open X-…
181787active
VAST-AI-Research/UniRig
UniRig is the official implementation of a SIGGRAPH 2025 framework that automatically rigs 3D models by predicting skeletons and skinning w…
551783active
Totoro97/NeuS
Official PyTorch implementation of NeuS, a neural implicit surface reconstruction method that learns SDF-based surfaces via volume renderin…
321775stable
levihsu/OOTDiffusion
Official implementation of OOTDiffusion, a latent diffusion model for controllable virtual try-on that generates images of a person wearing…
266607maintenance
tsurumeso/vocal-remover
A Python command-line tool that uses deep neural networks to separate vocals from instrumental tracks in songs. It includes pretrained mode…
651761stable
xinntao/ESRGAN
ESRGAN (Enhanced SRGAN) is a PyTorch-based image super-resolution model that won the PIRM 2018 Challenge on Perceptual Super-Resolution. Th…
326571maintenance
Maximal Update Parametrization (μP)
The `mup` Python package implements Maximal Update Parametrization (μP) for PyTorch models, enabling optimal hyperparameters to remain stab…
231757stable
SamsungSAILMontreal/TinyRecursiveModels
Official codebase for the Tiny Recursive Model (TRM) paper, a recursive reasoning approach where a tiny 7M-parameter neural network iterati…
106561maintenance
mahmoodlab/CLAM
CLAM is an open-source Python toolkit for data-efficient, weakly supervised classification of whole-slide images (WSIs) in computational pa…
361755active
MaliosDark/wifi-3d-fusion
WiFi-3D-Fusion is an open-source research project that estimates 3D human pose from WiFi CSI (Channel State Information) signals using deep…
221755active
decisionintelligence/TFB
TFB is a comprehensive and fair benchmarking framework for time series forecasting methods, covering deep learning, machine learning, and s…
701753active
facebookresearch/metaseq
Metaseq is a PyTorch codebase from Meta AI for training and working with large-scale Open Pre-trained Transformers (OPT), forked from fairs…
106544maintenance
CompVis/taming-transformers
The official implementation of 'Taming Transformers for High-Resolution Image Synthesis' (CVPR 2021), combining a convolutional VQGAN codeb…
326530maintenance
codertimo/BERT-pytorch
A PyTorch implementation of Google AI's 2018 BERT model with simple, readable code. It provides CLI tools for building vocabulary and pre-t…
236529maintenance
Informer
The official PyTorch implementation of Informer, an efficient Transformer architecture for long sequence time-series forecasting that won t…
416528maintenance
kyleskom/NBA-Machine-Learning-Sports-Betting
A Python application that predicts NBA game winners and totals (over/under) using XGBoost and neural network models trained on historical t…
781747active
TencentARC/BrushNet
BrushNet is the official PyTorch implementation of an ECCV 2024 plug-and-play image inpainting model that embeds pixel-level masked image f…
261744active

← prev page 7 / 27 next →