Open-source llm-training software
812 open-source libraries, tools and applications tagged llm-training, ranked by how closely llm-training is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
812 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| Plachtaa/VITS-fast-fine-tuning A Python pipeline for fast fine-tuning of VITS text-to-speech models, enabling speaker adaptation in under an hour from short audio, long a… | 10 | 5009 | active |
| facebookresearch/lingua Meta Lingua is a minimal, fast LLM training and inference library built on easy-to-modify PyTorch components for research purposes. It supp… | 33 | 4771 | active |
| Flux Flux.jl is a machine learning library written entirely in Julia, providing lightweight abstractions over Julia's native GPU support and aut… | 98 | 4754 | stable |
| deepseek-ai/Engram Official implementation of Engram, a conditional memory module from DeepSeek that modernizes N-gram embeddings for O(1) lookup as a new spa… | 41 | 4735 | active |
| PrimeIntellect-ai/verifiers verifiers is a Python library for creating environments to train and evaluate large language models with reinforcement learning. It integra… | 89 | 4712 | active |
| mindspore-ai/mindspore MindSpore is an open-source deep learning framework for training and inference across mobile, edge, and cloud scenarios. It provides automa… | 32 | 4707 | active |
| PKU-Alignment/align-anything Align-Anything is a modular Python framework for aligning any-to-any (all-modality) large models with human intentions and values using fee… | 45 | 4671 | active |
| TencentCloudADP/youtu-agent Youtu-Agent is a Python framework for building, running, and evaluating autonomous LLM agents, supporting ReAct-style single agents and pla… | 52 | 4622 | active |
| thirdlayerinc/autoagent AutoAgent is a Python-based meta-agent harness that autonomously builds and iterates on AI agent harnesses. It edits an agent's system prom… | 45 | 4575 | active |
| mosaicml/llm-foundry LLM Foundry is a PyTorch-based codebase for training, finetuning, evaluating, and deploying large language models from 125M to 70B+ paramet… | 62 | 4449 | active |
| microsoft/FLAML FLAML is a lightweight Python library for automated machine learning (AutoML) and hyperparameter tuning. It efficiently finds quality model… | 94 | 4409 | active |
| ymcui/Chinese-LLaMA-Alpaca A project releasing Chinese-adapted LLaMA and instruction-tuned Alpaca large language models with extended Chinese vocabulary, plus pre-tra… | 53 | 18936 | maintenance |
| tloen/alpaca-lora A repository of scripts for reproducing Stanford Alpaca-style instruction tuning of LLaMA models using low-rank adaptation (LoRA) on consum… | 31 | 18899 | maintenance |
| thinking-machines-lab/tinker-cookbook Tinker Cookbook is a Python library of realistic examples and abstractions for post-training (fine-tuning) language models via the Tinker A… | 84 | 4199 | active |
| OpenManus/OpenManus-RL OpenManus-RL is an open-source project for reinforcement-learning-based tuning of LLM agents, built on the verl training framework. It prov… | 44 | 4159 | active |
| marcelroed/gigatoken Gigatoken is a Rust-based tokenizer library for language modeling that tokenizes text at GB/s throughput, claiming ~1000x speedups over Hug… | 58 | 4134 | active |
| IDEA-CCNL/Fengshenbang-LM Fengshenbang-LM is an open-source suite of Chinese large language models and a PyTorch training framework from IDEA Research's CCNL lab, ai… | 67 | 4123 | active |
| FedML FedML (TensorOpera) is a unified Python library for large-scale distributed training, model serving, and federated learning across GPU clou… | 41 | 4070 | active |
| StarsfieldAI/R1-V R1-V is an open-source research codebase for training vision-language models with reinforcement learning (RLVR/GRPO), demonstrating strong … | 18 | 4063 | active |
| tensorflow/tensor2tensor Tensor2Tensor (T2T) is a Python library of deep learning models and datasets built on TensorFlow, developed by the Google Brain team to mak… | 10 | 17473 | maintenance |
| Marin Marin is an open-source Python framework and research program for training foundation models, covering the full pipeline from data curation… | 79 | 3988 | active |
| huggingface/smollm Hugging Face's repository for the SmolLM and SmolVLM families of compact, fully open language and vision-language models, including trainin… | 67 | 3926 | active |
| vllm-project/llm-compressor LLM Compressor is a Python library for applying quantization and pruning algorithms to large language models, producing compressed-tensors … | 92 | 3886 | active |
| hkust-nlp/simpleRL-reason A research codebase from HKUST-NLP implementing a simple reinforcement learning recipe (rule-based rewards on GSM8K/Math data) to train LLM… | 44 | 3877 | active |
| Stability-AI/StableLM StableLM is Stability AI's repository of open-weight decoder-only transformer language models, including the 3B-parameter StableLM-3B-4E1T … | 30 | 15671 | maintenance |
| NExT-GPT/NExT-GPT NExT-GPT is an end-to-end any-to-any multimodal large language model that accepts and generates arbitrary combinations of text, image, vide… | 34 | 3638 | active |
| NVlabs/Eagle Eagle is NVIDIA's family of frontier vision-language models (Eagle, Eagle 2, Eagle 2.5) built with data-centric training strategies, plus L… | 61 | 3599 | active |
| NVIDIA/TransformerEngine Transformer Engine is an NVIDIA library for accelerating Transformer model training and inference on NVIDIA GPUs using low-precision format… | 99 | 3576 | active |
| pathwaycom/bdh BDH (Dragon Hatchling) is a biologically inspired large language model architecture that bridges deep learning and neuroscience, implemente… | 51 | 3571 | active |
| Vision Transformer Google Research's official Jax/Flax codebase for training large-scale vision models such as Vision Transformer, SigLIP, MLP-Mixer, and LiT … | 39 | 3551 | active |
| EverMind-AI/MSA MSA (Memory Sparse Attention) is a Python framework for end-to-end trainable sparse latent-memory attention that scales LLM context to 100M… | 50 | 3520 | active |
| huggingface/optimum Optimum is a Hugging Face library that extends Transformers, Diffusers, timm, and Sentence Transformers with hardware-specific optimization… | 91 | 3503 | active |
| sentient-agi/OML-1.0-Fingerprinting A Python library for embedding secret cryptographic fingerprints into LLMs via fine-tuning, so model owners can prove ownership and detect … | 13 | 3493 | active |
| aiming-lab/MetaClaw MetaClaw is a continual meta-learning framework that lets an LLM agent evolve from real conversations, combining skill synthesis from failu… | 63 | 3460 | active |
| PaddlePaddle/PARL PARL is a flexible, high-performance reinforcement learning framework built on PaddlePaddle, providing Model/Algorithm/Agent abstractions a… | 38 | 3457 | active |
| aqlaboratory/openfold OpenFold is a faithful, trainable PyTorch reproduction of DeepMind's AlphaFold 2 for protein structure prediction. It is memory-efficient a… | 45 | 3435 | active |
| alibaba/ROLL ROLL is an open-source reinforcement learning library from Alibaba for training large language models at scale, supporting algorithms like … | 82 | 3429 | active |
| NovaSky-AI/SkyThought SkyThought is the open-source repository behind Sky-T1, a family of reasoning language models trained for under $450, including training sc… | 22 | 3401 | active |
| PhysicsNeMo NVIDIA PhysicsNeMo is an open-source Python deep-learning framework for building, training, fine-tuning, and inferring physics AI models us… | 93 | 3373 | active |
| microsoft/LoRA loralib is the official PyTorch implementation of LoRA (Low-Rank Adaptation), which fine-tunes large language models by injecting trainable… | 23 | 13805 | maintenance |
| cocktailpeanut/fluxgym FluxGym is a simple web UI for training FLUX LoRA models with low VRAM support (12GB/16GB/20GB). It combines the AI-Toolkit Gradio frontend… | 62 | 3257 | active |
| determined-ai/determined Determined is an open-source deep learning platform that combines distributed training, hyperparameter tuning, experiment tracking, and GPU… | 36 | 3245 | active |
| Nerogar/OneTrainer OneTrainer is a GUI and CLI application for fine-tuning diffusion image models, supporting full fine-tuning, LoRA, and embeddings across ma… | 75 | 3243 | active |
| tekaratzas/RustGPT A transformer-based large language model implemented entirely in pure Rust with no external ML frameworks, using only ndarray for matrix op… | 35 | 3175 | active |
| Miles Miles is an open-source, enterprise-grade reinforcement learning framework for large-scale LLM and VLM post-training, forked from and co-ev… | 84 | 3169 | active |
| dexmal/dexbotic Dexbotic is an open-source PyTorch-based toolbox for developing Vision-Language-Action (VLA) models for embodied intelligence. It unifies p… | 70 | 3144 | active |
| ridgerchu/matmulfreellm A Python implementation of MatMul-Free LM, a language model architecture that eliminates matrix multiplication operations using ternary wei… | 76 | 3093 | active |
| deepseek-ai/DualPipe DualPipe is a Python library implementing a bidirectional pipeline parallelism algorithm that overlaps forward and backward computation wit… | 45 | 3017 | active |
| pytorch/ao TorchAO is a PyTorch-native library for model optimization through quantization and sparsity. It supports quantizing weights, gradients, op… | 87 | 3001 | active |
| OpenMOSS/MOSS MOSS is an open-source tool-augmented conversational large language model from Fudan University, released with base models, SFT models, plu… | 72 | 12253 | maintenance |
| patrick-kidger/equinox Equinox is a Python library providing neural networks and scientific computing utilities for JAX, using PyTorch-like class-based syntax whe… | 88 | 2976 | stable |
| karpathy/char-rnn char-rnn is a Torch/Lua implementation of multi-layer recurrent neural networks (RNN, LSTM, GRU) for character-level language modeling. It … | 32 | 12120 | maintenance |
| bghira/SimpleTuner SimpleTuner is a Python fine-tuning toolkit for image, video, and audio diffusion models built on Hugging Face Diffusers. It provides a web… | 93 | 2940 | active |
| zjunlp/EasyEdit EasyEdit is an easy-to-use knowledge editing framework for large language models, supporting methods that modify model parameters or steer … | 74 | 2929 | active |
| eric-mitchell/direct-preference-optimization A reference implementation of Direct Preference Optimization (DPO) for training language models from human preference data, built on Huggin… | 29 | 2916 | stable |
| learnables/learn2learn learn2learn is a PyTorch library for meta-learning research, providing utilities for few-shot task creation, high-level wrappers for algori… | 45 | 2894 | active |
| KellerJordan/Muon Muon is a PyTorch optimizer for the hidden layers of neural networks, based on orthogonalized momentum updates via Newton-Schulz iteration.… | 56 | 2887 | active |
| physical-superintelligence-lab/Psi0 Psi-Zero (Ψ₀) is an open vision-language-action (VLA) foundation model for dexterous humanoid loco-manipulation, combining a Qwen3-VL backb… | 59 | 2859 | active |
| huggingface/nanotron Nanotron is a minimalistic Python library from Hugging Face for pretraining large language models with 3D parallelism (data, tensor, and pi… | 63 | 2843 | active |
| huggingface/setfit SetFit is a Python library for efficient, prompt-free few-shot fine-tuning of Sentence Transformers for text classification. It achieves hi… | 88 | 2842 | active |
| AdapterHub Adapters is a Python add-on library for HuggingFace Transformers that integrates 10+ parameter-efficient fine-tuning methods (bottleneck ad… | 74 | 2831 | active |
| OpenDCAI/DataFlex DataFlex is a data-centric training framework built on LLaMA-Factory that dynamically schedules LLM training data during optimization. It p… | 63 | 2824 | active |
| mll-lab-nu/RAGEN RAGEN is a Python framework for training reasoning LLM agents with multi-turn reinforcement learning using the StarPO algorithm. It also pr… | 62 | 2803 | active |
| artidoro/qlora QLoRA is the official implementation of the QLoRA paper, an efficient finetuning approach that backpropagates through a frozen 4-bit quanti… | 30 | 11035 | maintenance |
| qualcomm/aimet AIMET (AI Model Efficiency Toolkit) is a Python library from Qualcomm providing advanced quantization and compression techniques for traine… | 99 | 2723 | active |
| ZHZisZZ/dllm dLLM is a Python library that unifies training, inference, and evaluation of diffusion language models such as LLaDA and Dream. It builds o… | 56 | 2699 | active |
| roboflow/maestro maestro is a Python library from Roboflow that streamlines fine-tuning of multimodal vision-language models such as Florence-2, PaliGemma 2… | 61 | 2696 | active |
| stochasticai/xTuring xTuring is a Python library for fine-tuning, evaluating, and running open-source large language models such as LLaMA, GPT-J, GPT-2, Qwen, a… | 65 | 2675 | active |
| AMAP-ML/SkillClaw SkillClaw is a Python-based framework that lets AI agent skills evolve collectively from real interactions across sessions, agents, devices… | 55 | 2669 | active |
| plexe-ai/plexe Plexe is a Python library and CLI that builds machine learning models from natural language descriptions using a multi-agent AI workflow. Y… | 56 | 2645 | active |
| facebookresearch/ParlAI ParlAI is a Python framework from Facebook AI Research for sharing, training, and evaluating dialogue models across many openly available d… | 10 | 10618 | maintenance |
| NVlabs/LongLive LongLive is an NVIDIA research framework providing parallel training and inference infrastructure for real-time long video generation, usin… | 60 | 2639 | active |
| ymcui/Chinese-BERT-wwm A collection of Chinese pre-trained language models (BERT-wwm, BERT-wwm-ext, RoBERTa-wwm-ext, RBT3, etc.) built with Whole Word Masking, re… | 64 | 10231 | maintenance |
| yifan123/flow_grpo Flow-GRPO is the official PyTorch implementation of a NeurIPS 2025 paper that trains flow matching models (e.g., SD3.5, FLUX.1, Qwen-Image,… | 52 | 2543 | active |
| learning-at-home/hivemind Hivemind is a PyTorch library for decentralized deep learning across the Internet, enabling training of large models on hundreds of volunte… | 53 | 2541 | active |
| Lamini The official Python client and SDK for Lamini's hosted API for building generative AI applications. It lets developers call Lamini's LLM in… | 34 | 2533 | active |
| LyCORIS LyCORIS is a Python library implementing parameter-efficient fine-tuning algorithms (LoRA/LoCon, LoHa, LoKr, IA3, DyLoRA, and more) for Sta… | 99 | 2530 | active |
| google/tunix Tunix is a lightweight JAX-based library for post-training large language models, supporting supervised fine-tuning, preference optimizatio… | 81 | 2490 | active |
| google-parfait/tensorflow-federated TensorFlow Federated (TFF) is an open-source Python framework for machine learning and other computations on decentralized data. It provide… | 67 | 2454 | active |
| Unakar/Logic-RL Logic-RL is a research framework that reproduces R1-Zero-style LLM reasoning via rule-based reinforcement learning (GRPO) on logic puzzles,… | 23 | 2452 | active |
| AI-Hypercomputer/maxtext MaxText is a high-performance, scalable open-source LLM training library written in pure Python/JAX, targeting Google Cloud TPUs and GPUs. … | 98 | 2444 | active |
| NovaSky-AI/SkyRL SkyRL is a modular full-stack reinforcement learning library for post-training large language models, combining a training framework (skyrl… | 83 | 2436 | active |
| tflearn/tflearn TFLearn is a modular deep learning library providing a higher-level, Keras-like API on top of TensorFlow for building and training neural n… | 23 | 9570 | maintenance |
| Olive Olive is Microsoft's AI model optimization toolkit for the ONNX Runtime, automating finetuning, conversion, quantization, and compression o… | 89 | 2399 | active |
| langfengQ/verl-agent verl-agent is an extension of the veRL framework for training LLM and VLM agents via reinforcement learning, featuring step-independent mul… | 51 | 2388 | active |
| apple/axlearn AXLearn is a Python deep learning library built on JAX and XLA for developing and training large-scale models, with an object-oriented conf… | 69 | 2375 | active |
| XiaomiMiMo/MiMo Xiaomi's MiMo is a 7B-parameter reasoning language model trained from pretraining through posttraining with reinforcement learning, release… | 28 | 2373 | active |
| EasyRec EasyRec is a TensorFlow-based framework from Alibaba for building large-scale deep learning recommendation models covering matching, rankin… | 59 | 2361 | active |
| google-deepmind/optax Optax is a gradient processing and optimization library for JAX, offering composable building blocks like optimizers and loss functions. It… | 80 | 2350 | stable |
| facebookresearch/schedule_free A PyTorch library implementing schedule-free optimizers (SGD, AdamW, RAdam variants) that remove the need for learning rate schedules or sp… | 64 | 2329 | active |
| Picotron Picotron is a minimalist, hackable distributed training framework for pre-training Llama-like large language models using 4D parallelism (d… | 37 | 2325 | active |
| OpenChatKit OpenChatKit is an open-source toolkit from Together, LAION, and Ontocord.ai for building and fine-tuning chat language models, including in… | 31 | 8983 | maintenance |
| Liuziyu77/Visual-RFT Official research code for Visual-RFT and Visual-ARFT, applying GRPO-based reinforcement fine-tuning with rule-based verifiable rewards to … | 39 | 2280 | active |
| aixcoder-plugin/aiXcoder-7B Official repository for aiXcoder-7B, an open-weights 7B-parameter code large language model trained on 1.2T tokens for code completion, gen… | 26 | 2271 | active |
| Amazon SageMaker Containers & SDK The SageMaker Python SDK is an open-source Python library for training and deploying machine learning models on Amazon SageMaker. It suppor… | 94 | 2268 | active |
| 666DZY666/micronet micronet is a Python library for deep neural network model compression and deployment built on PyTorch. It provides quantization (QAT, PTQ,… | 38 | 2265 | active |
| kubeflow/trainer Kubeflow Trainer is a Kubernetes-native platform for distributed AI model training and LLM fine-tuning across frameworks like PyTorch, JAX,… | 93 | 2249 | active |
| ByteDance-Seed/VeOmni VeOmni is a PyTorch-native framework for single- and multi-modal model pre-training and post-training, with a modular, trainer-free design … | 87 | 2246 | active |
| MoonshotAI/MoBA MoBA (Mixture of Block Attention) is a PyTorch implementation of a trainable block-sparse attention mechanism for long-context large langua… | 24 | 2191 | active |
| intel/intel-extension-for-transformers Intel's toolkit for accelerating transformer-based GenAI/LLM workloads on Intel platforms, offering state-of-the-art compression (e.g., INT… | 10 | 2169 | active |