Open-source reinforcement-learning software
278 open-source libraries, tools and applications tagged reinforcement-learning, ranked by how closely reinforcement-learning is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
278 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| verl-project/verl Verl is a flexible, efficient, and production‑ready reinforcement learning library for large language models. It provides a modular API to … | 84 | 23828 | active |
| ML-Agents The Unity Machine Learning Agents Toolkit (ML-Agents) lets Unity games and simulations serve as environments for training intelligent agent… | 66 | 19717 | active |
| microsoft/AirSim AirSim is an open‑source high‑fidelity simulator for drones, cars and other vehicles built as a plugin for Unreal Engine and Unity. It prov… | 66 | 18501 | active |
| microsoft/agent-lightning Agent Lightning is a lightweight (~3,500-line) agentic reinforcement learning framework from Microsoft for training LLM-powered agents with… | 82 | 18410 | active |
| FinRL FinRL is the first open-source deep reinforcement learning framework for financial markets, providing end-to-end pipelines to build, train,… | 77 | 16558 | active |
| RL Baselines3 Zoo Stable Baselines3 is a Python library providing reliable, well-tested PyTorch implementations of reinforcement learning algorithms with a u… | 86 | 13883 | stable |
| Farama-Foundation/Gymnasium Gymnasium is a Python library providing a standard API for single-agent reinforcement learning environments, maintained by the Farama Found… | 95 | 12663 | stable |
| thu-ml/tianshou Tianshou is a modular, high-performance deep reinforcement learning library built on pure PyTorch and Gymnasium. It offers both low-level h… | 66 | 11000 | active |
| google/dopamine Dopamine is a research framework from Google for fast prototyping of reinforcement learning algorithms, built around a small, easily readab… | 52 | 10925 | active |
| OpenPipe/ART ART (Agent Reinforcement Trainer) is an open-source Python framework for training multi-step LLM agents using reinforcement learning techni… | 85 | 10813 | active |
| vwxyzjn/cleanrl CleanRL is a deep reinforcement learning library providing high-quality, single-file implementations of algorithms like PPO, DQN, DDPG, TD3… | 54 | 10481 | active |
| OpenRLHF/OpenRLHF OpenRLHF is a high-performance, production-ready open-source RLHF framework built on Ray + vLLM + DeepSpeed for scalable reinforcement lear… | 89 | 10040 | active |
| Pwnagotchi Pwnagotchi is an A2C deep reinforcement learning agent built on bettercap that learns from its surrounding WiFi environment to maximize cap… | 63 | 9223 | active |
| VowpalWabbit/vowpal_wabbit Vowpal Wabbit is a fast, open-source machine learning system focused on online, active, and interactive learning, including contextual band… | 98 | 8727 | active |
| DeepDive slime is an open-source LLM post-training framework for reinforcement learning scaling, connecting Megatron-based training with SGLang-base… | 79 | 8606 | active |
| isaac-sim/IsaacLab Isaac Lab is a GPU-accelerated open-source framework for robot learning built on NVIDIA Isaac Sim, unifying workflows like reinforcement le… | 96 | 8397 | active |
| openai/gym Gym is a Python toolkit for developing and comparing reinforcement learning algorithms via a standard API between learning algorithms and e… | 10 | 37236 | maintenance |
| tensortrade-org/tensortrade TensorTrade is an open-source Python framework for building, training, and evaluating reinforcement learning agents for algorithmic trading… | 58 | 7194 | active |
| eriklindernoren/ML-From-Scratch A Python library providing bare-bones NumPy implementations of fundamental machine learning models and algorithms, from linear regression t… | 32 | 32980 | maintenance |
| PufferLib PufferLib is a fast, open-source reinforcement learning library that trains tiny, super-human models in seconds, achieving 1M+ environment … | 87 | 6476 | active |
| om-ai-lab/VLM-R1 VLM-R1 is a framework for training R1-style large vision-language models using reinforcement learning (GRPO) on top of Qwen2.5-VL. It provi… | 60 | 6029 | active |
| rllm-org/rllm rLLM is an open-source Python framework for training language agents with reinforcement learning, supporting any agent harness (Claude Code… | 75 | 5862 | active |
| areal-project/AReaL AReaL is a large-scale asynchronous reinforcement learning system that bridges foundation model training with agent-based applications, sup… | 86 | 5842 | active |
| google-deepmind/open_spiel OpenSpiel is a collection of game environments and reinforcement learning/search/planning algorithms for research in general RL and multiag… | 93 | 5537 | active |
| RLinf/RLinf RLinf is an open-source, flexible and scalable reinforcement learning training infrastructure for embodied AI (vision-language-action model… | 72 | 5453 | active |
| PeterGriffinJin/Search-R1 Search-R1 is an open-source reinforcement learning framework for training LLMs that interleave reasoning with search engine calls, built on… | 40 | 5446 | active |
| hiyouga/EasyR1 EasyR1 is an efficient, scalable reinforcement learning training framework for large language models and vision-language models, built as a… | 62 | 5192 | active |
| google-deepmind/dm_control Google DeepMind's Python stack for physics-based simulation and reinforcement learning environments built on the MuJoCo physics engine. It … | 99 | 4710 | stable |
| AI4Finance-Foundation/ElegantRL ElegantRL is a lightweight, modular deep reinforcement learning library built on PyTorch that implements core model-free RL algorithms (PPO… | 50 | 4368 | active |
| Open Duck Mini Open Duck Mini is an open-source project to build a miniature (~42cm) bipedal robot inspired by Disney's BDX droid, with a bill of material… | 51 | 4208 | active |
| OpenManus/OpenManus-RL OpenManus-RL is an open-source project for reinforcement-learning-based tuning of LLM agents, built on the verl training framework. It prov… | 44 | 4159 | active |
| google-deepmind/acme Acme is a Python library of reinforcement learning building blocks and agent implementations from DeepMind. It provides readable reference … | 67 | 4080 | active |
| StarsfieldAI/R1-V R1-V is an open-source research codebase for training vision-language models with reinforcement learning (RLVR/GRPO), demonstrating strong … | 18 | 4063 | active |
| openai/baselines OpenAI Baselines is a collection of high-quality reference implementations of reinforcement learning algorithms such as DQN, PPO, and ACKTR… | 32 | 16764 | maintenance |
| hkust-nlp/simpleRL-reason A research codebase from HKUST-NLP implementing a simple reinforcement learning recipe (rule-based rewards on GSM8K/Math data) to train LLM… | 44 | 3877 | active |
| danijar/dreamerv3 A Python/JAX reimplementation of DreamerV3, a model-based reinforcement learning algorithm that learns a world model and trains an actor-cr… | 76 | 3859 | active |
| NVlabs/GR00T-WholeBodyControl NVIDIA's unified platform for developing, training, and deploying whole-body controllers for humanoid robots, including the decoupled WBC m… | 60 | 3654 | active |
| DI-engine DI-engine is an open-source reinforcement learning framework from OpenDILab that provides comprehensive implementations of deep RL algorith… | 44 | 3647 | active |
| pytorch/rl TorchRL is a PyTorch-native library of composable primitives for building reinforcement learning systems, including environments, policies,… | 100 | 3603 | active |
| unitreerobotics/unitree_rl_gym A reinforcement learning gym environment for training locomotion policies on Unitree robots (Go2, H1, H1_2, G1) using Isaac Gym and Mujoco.… | 39 | 3583 | active |
| Farama-Foundation/PettingZoo PettingZoo is a Python library providing a standard API for multi-agent reinforcement learning environments, analogous to Gymnasium but for… | 88 | 3532 | active |
| PaddlePaddle/PARL PARL is a flexible, high-performance reinforcement learning framework built on PaddlePaddle, providing Model/Algorithm/Agent abstractions a… | 38 | 3457 | active |
| XinJingHao/DRL-Pytorch A unified PyTorch implementation collection of popular deep reinforcement learning algorithms including DQN variants, PPO, DDPG, TD3, SAC, … | 40 | 3447 | active |
| mani-skill/ManiSkill ManiSkill is an open-source GPU-parallelized robotics simulation framework and benchmark built on SAPIEN, focused on manipulation skills. I… | 85 | 3442 | active |
| alibaba/ROLL ROLL is an open-source reinforcement learning library from Alibaba for training large language models at scale, supporting algorithms like … | 82 | 3429 | active |
| Farama-Foundation/HighwayEnv HighwayEnv is a collection of Gymnasium environments for autonomous driving and tactical decision-making tasks, covering scenarios like hig… | 92 | 3325 | active |
| LeelaChessZero/lc0 Lc0 is an open-source, UCI-compliant chess engine that plays chess using neural networks trained via AlphaZero-style self-play reinforcemen… | 74 | 3248 | active |
| imbue-bit/AlphaGPT AlphaGPT is an open-source automated factor factory based on deep reinforcement learning for quantitative finance. It mines and generates a… | 52 | 3187 | active |
| Miles Miles is an open-source, enterprise-grade reinforcement learning framework for large-scale LLM and VLM post-training, forked from and co-ev… | 84 | 3169 | active |
| mjlab mjlab is a Python framework that combines Isaac Lab's manager-based API with MuJoCo Warp, a GPU-accelerated version of MuJoCo, for reinforc… | 82 | 3163 | active |
| TradeMaster-NTU/TradeMaster TradeMaster is an open-source Python platform for quantitative trading powered by reinforcement learning, covering the full pipeline of alg… | 30 | 3087 | active |
| leggedrobotics/rsl_rl RSL-RL is a GPU-accelerated, lightweight reinforcement learning library for robotics research, featuring algorithms like PPO and Student-Te… | 97 | 3075 | active |
| facebookresearch/Pearl Pearl is a production-ready reinforcement learning agent library developed by Meta's Applied Reinforcement Learning team. It provides modul… | 71 | 3033 | active |
| tensorflow/agents TF-Agents is a TensorFlow-based Python library for building, training, and deploying reinforcement learning and contextual bandit algorithm… | 57 | 3028 | active |
| RL Baselines3 Zoo RL Baselines3 Zoo is a training framework for reinforcement learning agents built on Stable Baselines3. It provides CLI scripts for trainin… | 88 | 2892 | active |
| werner-duvaud/muzero-general A commented and documented PyTorch implementation of DeepMind's MuZero reinforcement learning algorithm, designed to be easily adapted to a… | 32 | 2870 | active |
| huawei-noah/HEBO A research monorepo from Huawei Noah's Ark Lab containing official implementations of Bayesian optimization, reinforcement learning, and ge… | 67 | 2812 | active |
| mll-lab-nu/RAGEN RAGEN is a Python framework for training reasoning LLM agents with multi-turn reinforcement learning using the StarPO algorithm. It also pr… | 62 | 2803 | active |
| huggingface/OpenEnv OpenEnv is a Hugging Face framework for creating, deploying, and consuming isolated execution environments used in agentic reinforcement le… | 85 | 2728 | active |
| google-deepmind/mctx Mctx is a JAX-native Python library implementing Monte Carlo tree search algorithms such as AlphaZero, MuZero, and Gumbel MuZero. It suppor… | 81 | 2678 | active |
| robosuite robosuite is a modular simulation framework powered by the MuJoCo physics engine for robot learning, offering standardized benchmark enviro… | 66 | 2643 | active |
| yifan123/flow_grpo Flow-GRPO is the official PyTorch implementation of a NeurIPS 2025 paper that trains flow matching models (e.g., SD3.5, FLUX.1, Qwen-Image,… | 52 | 2543 | active |
| Roboto Origin A fully open-source DIY humanoid robot project (ROBOTO_ORIGIN) that can walk and run, including all hardware designs, electronics, training… | 59 | 2537 | active |
| Farama-Foundation/Minigrid Minigrid is a Python library of lightweight, easily configurable discrete grid-world environments for reinforcement learning research, foll… | 80 | 2523 | active |
| google/tunix Tunix is a lightweight JAX-based library for post-training large language models, supporting supervised fine-tuning, preference optimizatio… | 81 | 2490 | active |
| Farama-Foundation/Arcade-Learning-Environment The Arcade Learning Environment (ALE) is a framework built on the Stella Atari 2600 emulator that lets researchers and hobbyists develop an… | 92 | 2458 | stable |
| Unakar/Logic-RL Logic-RL is a research framework that reproduces R1-Zero-style LLM reasoning via rule-based reinforcement learning (GRPO) on logic puzzles,… | 23 | 2452 | active |
| BeyondMimic Motion Tracking BeyondMimic's official motion tracking training code, a humanoid control framework built on Isaac Lab that trains sim-to-real-ready whole-b… | 10 | 2444 | active |
| NVlabs/ProtoMotions ProtoMotions is a GPU-accelerated simulation and reinforcement learning framework for training physically simulated digital humans and huma… | 66 | 2392 | active |
| langfengQ/verl-agent verl-agent is an extension of the veRL framework for training LLM and VLM agents via reinforcement learning, featuring step-independent mul… | 51 | 2388 | active |
| AminHP/gym-anytrading gym-anytrading is a collection of OpenAI Gym environments for developing and testing reinforcement learning-based trading algorithms in FOR… | 23 | 2386 | stable |
| xbpeng/MimicKit MimicKit is a lightweight Python framework providing a suite of motion imitation methods (DeepMimic, AMP, ASE, AWR, and others) for trainin… | 51 | 2360 | active |
| google-deepmind/mujoco_playground MuJoCo Playground is an open-source Python library of GPU-accelerated robot learning environments built on MuJoCo MJX and MuJoCo Warp. It s… | 74 | 2250 | active |
| learnsyslab/gym-pybullet-drones A Python library providing PyBullet-based Gymnasium environments for simulating quadcopter control in single- and multi-agent reinforcement… | 68 | 2173 | active |
| PrimeIntellect-ai/prime-rl prime-rl is a Python framework for large-scale, fully asynchronous reinforcement learning training of language models, built on FSDP2 for t… | 88 | 2164 | active |
| google-deepmind/pysc2 PySC2 is DeepMind's Python component of the StarCraft II Learning Environment, exposing Blizzard's StarCraft II Machine Learning API as a P… | 23 | 8329 | maintenance |
| LeCAR-Lab/ASAP ASAP is a two-stage framework for training agile humanoid whole-body skills by aligning simulation and real-world physics. It pre-trains mo… | 45 | 2130 | active |
| eloialonso/diamond DIAMOND is a Python implementation of a reinforcement learning agent trained entirely inside a diffusion-based world model, presented as a … | 25 | 2118 | active |
| marlbenchmark/on-policy The official PyTorch implementation of Multi-Agent PPO (MAPPO), an on-policy reinforcement learning algorithm for cooperative multi-agent s… | 32 | 2104 | active |
| Open-Reasoner-Zero/Open-Reasoner-Zero Open-Reasoner-Zero is an open-source implementation of large-scale reinforcement learning training for reasoning-oriented language models, … | 28 | 2098 | active |
| roboterax/humanoid-gym Humanoid-Gym is a reinforcement learning framework built on Nvidia Isaac Gym for training locomotion skills in humanoid robots, with emphas… | 26 | 2093 | active |
| NVIDIA-NeMo/RL NeMo RL is NVIDIA's open-source post-training library for scaling reinforcement learning methods (GRPO, PPO, DPO, SFT, distillation) on LLM… | 80 | 2073 | active |
| HybridRobotics/berkeley-humanoid-lite Berkeley Humanoid Lite is the open-source codebase for a sub-$5,000 3D-printed humanoid robot platform from UC Berkeley. It includes Isaac … | 51 | 1980 | active |
| WassimTenachi/PhySO PhySO is a Python library for physical symbolic optimization that uses deep reinforcement learning to discover analytical physical laws fro… | 49 | 1978 | active |
| BytedTsinghua-SIA/DAPO DAPO is an open-source reinforcement learning system for large-scale LLM training, released by ByteDance Seed and Tsinghua AIR. It implemen… | 26 | 1946 | active |
| google-deepmind/lab DeepMind Lab is a customisable 3D learning environment built on Quake III Arena (ioquake3) that provides navigation and puzzle-solving task… | 23 | 7387 | maintenance |
| tensorlayer/TensorLayer TensorLayer is a TensorFlow-based deep learning and reinforcement learning library offering customizable neural layers for researchers and … | 23 | 7383 | maintenance |
| fan-ziqi/robot_lab robot_lab is a reinforcement learning extension library for robots built on top of NVIDIA IsaacLab, providing preconfigured locomotion envi… | 78 | 1937 | active |
| LeapLabTHU/Absolute-Zero-Reasoner Official implementation of Absolute Zero Reasoner (AZR), a system that trains LLM reasoning via reinforced self-play with zero external dat… | 33 | 1916 | active |
| policy-gradient/GRPO-Zero A minimal from-scratch Python implementation of DeepSeek's GRPO (Group Relative Policy Optimization) algorithm for reinforcement learning t… | 24 | 1899 | active |
| PRIME-RL/PRIME PRIME (Process Reinforcement through Implicit Rewards) is an open-source Python framework for online reinforcement learning with process re… | 23 | 1872 | active |
| AkaliKong/MiniOneRec MiniOneRec is an open-source framework for generative recommendation built on large language models, covering the full pipeline of semantic… | 59 | 1868 | active |
| PRIME-RL/SimpleVLA-RL SimpleVLA-RL is an open-source reinforcement learning framework for training Vision-Language-Action (VLA) models for robotic manipulation, … | 43 | 1864 | active |
| RoboVerseOrg/RoboVerse RoboVerse is a unified platform, dataset, and benchmark for scalable and generalizable robot learning, providing tasks, robots, scenes, ass… | 65 | 1863 | active |
| openreasoner/openr OpenR is an open-source Python framework that integrates search, reinforcement learning, and process supervision to improve chain-of-though… | 23 | 1859 | active |
| Overcooked AI A Python library providing clean PyTorch implementations of imitation and reward learning algorithms such as Behavioral Cloning, DAgger, GA… | 23 | 1810 | active |
| chynl/snake A Python application that plays the game of Snake using two AI approaches: a graph-search algorithm based on Hamiltonian paths and shortest… | 64 | 1796 | active |
| microsoft/CyberBattleSim CyberBattleSim is a Python-based experimentation and research platform from Microsoft that simulates abstract enterprise network environmen… | 75 | 1794 | active |
| Farama-Foundation/Minari Minari is a Python library providing a standard format for offline reinforcement learning datasets, with popular reference datasets and uti… | 86 | 1772 | active |
| google-research/circuit_training AlphaChip (circuit_training) is Google's open-source framework for generating chip floorplans using distributed deep reinforcement learning… | 59 | 1730 | active |
page 1 / 3 next →