function: llm-training
818 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| tensorflow/tensorflow TensorFlow is an end-to-end open source platform for machine learning with stable Python and C++ APIs and a broad ecosystem of tools. It su… | 86 | 197638 | stable |
| deepseek-ai/DeepSeek-V3 Official repository for DeepSeek-V3, a 671B-parameter Mixture-of-Experts language model (37B activated per token) with open weights, infere… | 29 | 104416 | active |
| pytorch/pytorch PyTorch is a Python library providing NumPy-like tensor computation with strong GPU acceleration and a tape-based automatic differentiation… | 93 | 102605 | stable |
| karpathy/autoresearch A framework by Andrej Karpathy where AI agents autonomously run LLM research experiments on a single-GPU nanochat training setup. The agent… | 48 | 94753 | active |
| tensorflow/models The TensorFlow Model Garden is a repository of official and community implementations of state-of-the-art machine learning models built wit… | 85 | 77652 | active |
| Unsloth Unsloth is a desktop application for running and fine-tuning LLMs, diffusion, embedding, and audio models locally, with support for NVIDIA,… | 94 | 74883 | active |
| hiyouga/LlamaFactory LlamaFactory is a unified, efficient fine-tuning framework for 100+ large language models and vision-language models, supporting LoRA, QLoR… | 83 | 74382 | active |
| Keras Keras 3 is a multi-backend deep learning framework that runs on JAX, TensorFlow, PyTorch, and OpenVINO, providing a high-level API for buil… | 98 | 64253 | stable |
| karpathy/nanochat nanochat is a minimal, hackable full-stack LLM training harness that covers tokenization, pretraining, finetuning, evaluation, and inferenc… | 60 | 57548 | active |
| DeepSpeed DeepSpeed is a deep learning optimization library from Microsoft that makes distributed training and inference of large models fast, memory… | 98 | 43003 | stable |
| hpcaitech/ColossalAI Colossal-AI is an integrated large-scale deep learning training system built on PyTorch that provides efficient parallelization techniques … | 74 | 41441 | active |
| shiyu-coder/Kronos Kronos is an open-source foundation model family for financial K-line (OHLCV) data, using a tokenizer plus autoregressive Transformer pre-t… | 53 | 37962 | active |
| Lightning-AI/pytorch-lightning PyTorch Lightning is a deep learning framework that organizes PyTorch code to eliminate boilerplate for training, finetuning, and scaling A… | 90 | 31310 | stable |
| karpathy/llm.c llm.c is a pure C/CUDA implementation for training large language models like GPT-2 and GPT-3, with no dependency on PyTorch or Python. It … | 37 | 30879 | active |
| modular/modular Modular Platform hosting the MAX AI serving framework and the Mojo systems programming language. It provides an OpenAI-compatible inference… | 92 | 29225 | active |
| google-research/timesfm TimesFM is a pretrained decoder-only foundation model from Google Research for time-series forecasting, offering zero-shot forecasts with u… | 81 | 28273 | active |
| huggingface/open-r1 Open R1 is Hugging Face's fully open reproduction of the DeepSeek-R1 training pipeline, providing scripts for supervised fine-tuning, GRPO … | 54 | 26447 | active |
| JustVugg/colibri Colibrì is a pure-C, zero-dependency inference engine that runs frontier Mixture-of-Experts models (744B to 2.8T parameters) on consumer ha… | 80 | 26251 | active |
| haotian-liu/LLaVA LLaVA (Large Language and Vision Assistant) is an open-source multimodal large language model framework implementing visual instruction tun… | 20 | 25000 | active |
| deepseek-ai/DeepSeek-Coder DeepSeek Coder is a series of open code language models (1B to 33B) trained from scratch on 2T tokens of code and natural language, with a … | 50 | 24217 | active |
| PaddlePaddle/Paddle PaddlePaddle is an industrial-grade deep learning framework written in C++ with Python APIs, supporting high-performance single-machine and… | 84 | 24062 | active |
| verl-project/verl verl (Volcano Engine Reinforcement Learning) is a flexible, production-ready RL post-training library for large language models, open-sourc… | 84 | 23145 | active |
| huggingface/peft PEFT is a Python library from Hugging Face providing state-of-the-art parameter-efficient fine-tuning methods (LoRA, adapters, soft prompts… | 93 | 21598 | stable |
| AI4Finance-Foundation/FinGPT FinGPT is an open-source financial large language model project from the AI4Finance Foundation, providing domain-tuned models, fine-tuning … | 77 | 21154 | active |
| kvcache-ai/ktransformers KTransformers is a Python/C++ framework for CPU-GPU heterogeneous inference and fine-tuning of large language models, with a kt-kernel back… | 90 | 19303 | active |
| huggingface/trl TRL is a Hugging Face library for post-training transformer language models with techniques like Supervised Fine-Tuning (SFT), GRPO, DPO, K… | 99 | 19155 | active |
| state-spaces/mamba Mamba is a PyTorch library implementing the selective state space model (SSM) architecture for linear-time sequence modeling, with hardware… | 85 | 18783 | active |
| xming521/WeClone WeClone is an end-to-end Python framework for creating a personal AI digital twin by fine-tuning large language models on your exported cha… | 80 | 18171 | active |
| microsoft/agent-lightning Agent Lightning is a lightweight (~3,500-line) agentic reinforcement learning framework from Microsoft for training LLM-powered agents with… | 85 | 17863 | active |
| NVIDIA/Megatron-LM NVIDIA's GPU-optimized library for training large transformer models at scale, comprising Megatron-LM (reference training scripts) and Mega… | 99 | 17615 | active |
| microsoft/SkillOpt SkillOpt is a Python library from Microsoft that trains reusable natural-language skills for frozen LLM agents using trajectory-driven edit… | 78 | 16387 | active |
| kubeflow/kubeflow Kubeflow is a CNCF-graduated, Kubernetes-native toolkit for building AI/ML platforms, comprising subprojects like Pipelines, Notebooks, Tra… | 84 | 15832 | stable |
| tracel-ai/burn Burn is a Rust-based tensor library and deep learning framework supporting training and inference through a unified API. It JIT-compiles te… | 89 | 15816 | active |
| mindverse/Second-Me Second Me is an open-source platform for training a personal AI self from your own memories using hierarchical memory modeling and alignmen… | 41 | 15668 | active |
| modelscope/ms-swift ms-swift is a ModelScope community framework for fine-tuning, inference, evaluation, quantization, and deployment of 600+ text LLMs and 400… | 91 | 15371 | active |
| Lightning-AI/litgpt LitGPT is a Python library providing from-scratch, hackable implementations of 20+ open-source large language models with recipes for pretr… | 93 | 13629 | active |
| ShishirPatil/gorilla Gorilla is a UC Berkeley research project for training and evaluating LLMs to make function/tool calls, including the OpenFunctions fine-tu… | 54 | 13006 | active |
| PaddlePaddle/PaddleFormers PaddleFormers is a Transformers-style library built on PaddlePaddle providing a model zoo of 100+ large language models and vision-language… | 92 | 12986 | active |
| PaddlePaddle/PaddleNLP PaddleNLP is an easy-to-use NLP and large language model development kit built on the PaddlePaddle deep learning framework, with a large pr… | 63 | 12967 | active |
| sapientinc/HRM Official PyTorch implementation of the Hierarchical Reasoning Model (HRM), a 27M-parameter recurrent architecture with high-level and low-l… | 52 | 12619 | active |
| bmaltais/kohya_ss A Gradio-based GUI and CLI wrapper around Kohya's Stable Diffusion training scripts for fine-tuning diffusion image generation models. It s… | 95 | 12548 | active |
| axolotl-ai-cloud/axolotl Axolotl is a free, open-source, config-driven framework for fine-tuning large language models, supporting SFT, preference learning (DPO/KTO… | 95 | 12408 | active |
| Orchestra-Research/AI-Research-SKILLs An open-source library of ~98 packaged 'skills' (knowledge modules) that turn AI coding agents like Claude Code, Codex, or Gemini into auto… | 74 | 12073 | active |
| ostris/ai-toolkit An all-in-one open-source training toolkit for finetuning diffusion models (image and video) on consumer-grade hardware. It supports many r… | 73 | 11838 | active |
| ludwig-ai/ludwig Ludwig is a declarative, low-code deep learning framework for training, fine-tuning, and deploying AI models — from LLMs to tabular, image,… | 99 | 11745 | active |
| OpenPipe/ART ART (Agent Reinforcement Trainer) is an open-source Python framework for training multi-step LLM agents using reinforcement learning techni… | 86 | 10665 | active |
| facebookresearch/xformers xFormers is a PyTorch-based library of hackable, optimized Transformer building blocks with custom CUDA kernels for fast, memory-efficient … | 88 | 10542 | active |
| skypilot-org/skypilot SkyPilot is an open-source AI compute platform that unifies fragmented infrastructure (Kubernetes, Slurm, VMs, 20+ clouds) into a single po… | 97 | 10529 | active |
| bigscience-workshop/petals Petals is a Python library that lets you run and fine-tune large language models (Llama 3.1, Mixtral, Falcon, BLOOM) on a BitTorrent-style … | 23 | 10521 | active |
| OpenBMB/MiniCPM MiniCPM is a family of small, state-of-the-art on-device language models from OpenBMB, with MiniCPM5-1B being a dense 1B Transformer for lo… | 75 | 10250 | active |
| deepseek-ai/DeepEP DeepEP is a high-performance GPU communication library for expert parallelism (EP) in MoE training and inference, providing high-throughput… | 57 | 10066 | active |
| OpenRLHF/OpenRLHF OpenRLHF is a high-performance, production-ready open-source RLHF framework built on Ray + vLLM + DeepSpeed for scalable reinforcement lear… | 89 | 9956 | active |
| huggingface/accelerate Hugging Face Accelerate is a Python library that lets you run the same PyTorch training and inference code on any device or distributed con… | 95 | 9838 | stable |
| oumi-ai/oumi Oumi is an open-source Python framework and platform for the end-to-end lifecycle of open-weight LLMs: data synthesis, fine-tuning (SFT, Lo… | 86 | 9373 | active |
| keras-team/autokeras AutoKeras is an AutoML library for deep learning built on Keras, developed by DATA Lab at Texas A&M University. It automates model architec… | 52 | 9326 | active |
| bytedance/monolith Monolith is a deep learning framework built on TensorFlow for large-scale recommendation modeling. It provides collisionless embedding tabl… | 10 | 9298 | active |
| modelscope/modelscope ModelScope is a Python library and ecosystem built on the 'Model-as-a-Service' concept, providing unified APIs to download, run inference o… | 98 | 9111 | active |
| NVIDIA/apex NVIDIA-maintained PyTorch extension providing utilities for easy mixed precision and distributed training. It offers up-to-date CUDA and C+… | 77 | 8993 | active |
| OptimalScale/LMFlow LMFlow is an extensible Python toolkit for finetuning and inference of large foundation models such as LLaMA, GPT-2, and Galactica. It prov… | 64 | 8484 | active |
| bitsandbytes-foundation/bitsandbytes bitsandbytes is a Python library providing k-bit quantization primitives for PyTorch, enabling 8-bit (LLM.int8()) and 4-bit (QLoRA) quantiz… | 99 | 8439 | active |
| THUDM/slime slime is an open-source LLM post-training framework for reinforcement learning scaling, connecting Megatron-based training with SGLang-base… | 80 | 8261 | active |
| lm-sys/FastChat FastChat is an open platform for training, serving, and evaluating large language model based chatbots, originally releasing the Vicuna mod… | 57 | 39525 | maintenance |
| elder-plinius/OBLITERATUS OBLITERATUS is a Python toolkit for abliteration — identifying and removing refusal behaviors from large language models by locating and in… | 71 | 8056 | active |
| TheLastBen/fast-stable-diffusion A collection of Google Colab notebooks for quickly running Stable Diffusion UIs (AUTOMATIC1111, ComfyUI) and training DreamBooth models for… | 57 | 7910 | active |
| PaddlePaddle/ERNIE Official repository for Baidu's ERNIE 4.5 family of large multimodal models and ERNIEKit, an industrial-grade training toolkit built on Pad… | 65 | 7738 | active |
| EleutherAI/gpt-neox GPT-NeoX is EleutherAI's library for training large-scale autoregressive transformer language models on GPUs, built on NVIDIA's Megatron an… | 62 | 7459 | active |
| LargeWorldModel/LWM Large World Model (LWM) is a family of open-source 7B-parameter multimodal autoregressive transformer models trained on long videos and boo… | 25 | 7425 | active |
| arcee-ai/mergekit mergekit is a Python toolkit for merging pre-trained large language models directly in weight space, supporting many merge methods (SLERP, … | 63 | 7310 | active |
| google/flax Flax is a neural network library and ecosystem for JAX designed for flexibility, featuring the newer NNX API with first-class Python refere… | 99 | 7303 | active |
| InternLM/InternLM Official repository for the InternLM series of open-source large language models (InternLM, InternLM2, InternLM2.5, InternLM3), including p… | 41 | 7269 | active |
| kohya-ss/sd-scripts A collection of Python training, generation, and utility scripts for Stable Diffusion and other image generation models, most widely used f… | 89 | 7210 | active |
| ymcui/Chinese-LLaMA-Alpaca-2 A project releasing Chinese-adapted LLaMA-2 base models and Alpaca-2 instruction-tuned chat models with an extended Chinese vocabulary, inc… | 54 | 7120 | stable |
| flwrlabs/flower Flower (flwr) is an open-source Python framework for building federated and collaborative AI systems, supporting any ML framework such as P… | 99 | 7085 | active |
| zai-org/GLM-4 Official repository for the GLM-4 series of open-weight, multilingual (primarily Chinese/English) multimodal chat language models from Z.ai… | 67 | 7070 | active |
| deepseek-ai/DeepSpec DeepSpec is a full-stack Python codebase from DeepSeek for training and evaluating draft models used in speculative decoding of large langu… | 54 | 7041 | active |
| apple/corenet CoreNet is Apple's deep neural network training toolkit for training standard and novel small and large-scale models, including foundation … | 45 | 7007 | active |
| ml-explore/mlx-lm A Python package for running and fine-tuning large language models on Apple silicon using the MLX framework. It integrates with the Hugging… | 80 | 6801 | active |
| facebookresearch/fairseq Fairseq is a PyTorch-based sequence modeling toolkit from Facebook AI Research for training custom models for translation, summarization, l… | 10 | 32231 | maintenance |
| simplescaling/s1 s1 is an open-source research project implementing simple test-time scaling for large language models, including the s1K dataset of 1,000 c… | 33 | 6668 | active |
| yangjianxin1/Firefly Firefly is an open-source one-stop training tool for large language models, supporting pretraining, instruction fine-tuning (SFT), and DPO … | 21 | 6653 | active |
| linkedin/Liger-Kernel Liger Kernel is a collection of Triton kernels designed to make LLM training faster and more memory-efficient, offering drop-in replacement… | 90 | 6588 | active |
| gepa-ai/gepa GEPA is a Python framework that optimizes textual system parameters such as prompts, code, and agent configurations using LLM-based reflect… | 83 | 6254 | active |
| Akegarasu/lora-scripts SD-Trainer is a GUI application and set of scripts for training LoRA and Dreambooth fine-tunes of Stable Diffusion diffusion models, wrappi… | 66 | 6110 | active |
| FederatedAI/FATE FATE (Federated AI Technology Enabler) is an industrial-grade open-source federated learning framework hosted by the Linux Foundation. It e… | 23 | 6089 | active |
| om-ai-lab/VLM-R1 VLM-R1 is a framework for training R1-style large vision-language models using reinforcement learning (GRPO) on top of Qwen2.5-VL. It provi… | 63 | 6015 | active |
| lucidrains/x-transformers A concise PyTorch library implementing full-attention transformer architectures (encoder, decoder, encoder-decoder, and vision transformers… | 85 | 5942 | active |
| rllm-org/rllm rLLM is an open-source Python framework for training language agents with reinforcement learning, supporting any agent harness (Claude Code… | 77 | 5803 | active |
| shibing624/MedicalGPT MedicalGPT is a Python training framework for building medical-domain large language models using the full ChatGPT-style training pipeline:… | 83 | 5748 | active |
| areal-project/AReaL AReaL is a large-scale asynchronous reinforcement learning system that bridges foundation model training with agent-based applications, sup… | 87 | 5696 | active |
| google-deepmind/gemma The official JAX-based Python library from Google DeepMind for running, sampling from, and fine-tuning the Gemma family of open-weight larg… | 87 | 5695 | active |
| huggingface/alignment-handbook A collection of robust training recipes and scripts from Hugging Face for aligning large language models with human and AI preferences, cov… | 66 | 5671 | active |
| pytorch/torchtitan torchtitan is a PyTorch-native platform for large-scale training of generative AI models, offering a clean-room implementation of PyTorch's… | 79 | 5667 | active |
| Gen-Verse/OpenClaw-RL OpenClaw-RL is a framework for training personalized AI agents through reinforcement learning using natural conversation as feedback. It us… | 52 | 5655 | active |
| fla-org/flash-linear-attention A PyTorch library providing hardware-efficient implementations of emerging sequence model architectures, including linear attention, sparse… | 88 | 5627 | active |
| huggingface/parler-tts Parler-TTS is a lightweight text-to-speech library from Hugging Face that generates high-quality, natural-sounding speech controllable via … | 25 | 5586 | active |
| mosaicml/composer Composer is an open-source PyTorch-based deep learning training library by MosaicML (now Databricks) for training neural networks faster an… | 65 | 5495 | active |
| LaurentMazare/tch-rs tch-rs is a Rust crate providing thin bindings to the C++ API of PyTorch (libtorch), staying close to the original API. It enables tensor o… | 67 | 5479 | active |
| karpathy/minGPT A minimal, clean PyTorch re-implementation of OpenAI's GPT covering both training and inference in roughly 300 lines of code. It is designe… | 32 | 24840 | maintenance |
| PeterGriffinJin/Search-R1 Search-R1 is an open-source reinforcement learning framework for training LLMs that interleave reasoning with search engine calls, built on… | 43 | 5328 | active |
| InternLM/xtuner XTuner is an open-source LLM training engine from InternLM designed for fine-tuning ultra-large-scale Mixture-of-Experts (MoE) models, with… | 67 | 5183 | active |
page 1 / 9 next →