resource: llm-training
250 resources, primary matches first, then adoption-weighted; health v2 shown.
| Resource | Health v2 | Stars | Maturity |
|---|---|---|---|
| karpathy/randomfun A collection of Jupyter notebooks and random scripts by Andrej Karpathy used for experimentation and learning. It serves as a playground of… | 32 | 1179 | maintenance |
| yaodongC/awesome-instruction-dataset A curated awesome-list of open-source instruction tuning datasets for training text and multimodal instruction-following LLMs like ChatGPT,… | 30 | 1154 | maintenance |
| liucongg/GPT2-NewsTitle A heavily commented Chinese-language GPT2 project that trains, tests, and deploys a news headline generation model using HuggingFace transf… | 32 | 1111 | maintenance |
| unit-mesh/unit-minions A Chinese-language tutorial project and research collection for training LoRA adapters on LLaMA (Alpaca LoRA) and ChatGLM models to boost s… | 21 | 1101 | maintenance |
| Kodezi/Chronos Kodezi Chronos is a proprietary debugging-first language model for repository-scale code understanding and autonomous bug fixing, presented… | 41 | 4922 | experimental |
| SCIR-HI/Med-ChatGLM An open-source project providing a Chinese medical instruction-tuned version of ChatGLM-6B, built from a medical knowledge graph and GPT-3.… | 30 | 1037 | maintenance |
| PiotrNawrot/nanoT5 nanoT5 is a PyTorch codebase for pre-training and fine-tuning T5-style encoder-decoder language models on a limited budget, e.g. a single A… | 21 | 1021 | maintenance |
| beyondguo/LLM-Tuning A collection of tutorials, scripts, and research code for fine-tuning large language models (LLaMA2, Qwen, ChatGLM, Baichuan, InternLM) wit… | 29 | 1014 | maintenance |
| ZhuiyiTechnology/pretrained-models A model zoo of open-source Chinese pre-trained language models (RoBERTa, SimBERT, WoBERT, T5 PEGASUS) released by Zhuiyi Technology, with s… | 32 | 1003 | maintenance |
| mshumer/gpt-llm-trainer A set of Jupyter/Colab notebooks that automate the LLM fine-tuning pipeline: given a task description, they generate a synthetic dataset wi… | 37 | 4177 | experimental |
| MoonshotAI/Kimi-k1.5 The official repository for Kimi k1.5, Moonshot AI's o1-level multimodal LLM trained with scaled reinforcement learning, primarily containi… | 25 | 3471 | experimental |
| AetherCortex/Llama-X Llama-X is an open academic research project aiming to progressively improve Meta's LLaMA into a state-of-the-art open LLM through communit… | 30 | 1602 | experimental |
| karpathy/nanoGPT A minimal, readable repository for training and finetuning medium-sized GPT models, containing a ~300-line training loop and a ~300-line GP… | 54 | 62511 | abandoned |
| openai/gpt-3 The official OpenAI repository accompanying the GPT-3 paper 'Language Models are Few-Shot Learners', containing sample generations, synthet… | 10 | 15718 | abandoned |
| MorvanZhou/Tensorflow-Tutorial A collection of TensorFlow tutorial code from MorvanZhou (莫烦Python) covering neural network basics through advanced architectures like CNN,… | 32 | 4335 | abandoned |
| CodedotAl/gpt-code-clippy GPT-Code-Clippy is an open-source effort to replicate GitHub Copilot by fine-tuning GPT-Neo language models on publicly available GitHub co… | 32 | 3264 | abandoned |
| lakshayg/tensorflow-build-archived An archived repository of prebuilt TensorFlow binary wheels compiled with SIMD instruction sets (AVX, FMA, SSE) for CPUs lacking official w… | 10 | 1891 | abandoned |
| jackaduma/awesome_LLMs_interview_notes A curated collection of interview questions and reference answers for LLM (large language model) algorithm engineer roles, covering NLP and… | 27 | 1316 | abandoned |
| fighting41love/funNLP A large curated collection of Chinese and multilingual NLP resources, including corpora, lexicons, pretrained models, tools, and code for t… | 32 | 82695 | active |
| rohitg00/ai-engineering-from-scratch A free, MIT-licensed open-source curriculum of 511 lessons across 20 phases (~329 hours) that teaches AI engineering by building every core… | 81 | 49577 | active |
| bojieli/ai-agent-book An open-source Chinese-language book, 'AI Agents in Depth: Design Principles and Engineering Practice', covering AI agent design across 10 … | 71 | 42509 | active |
| muratcankoylan/Agent-Skills-for-Context-Engineering A curated collection of Agent Skills (documentation/playbooks) for context engineering and multi-agent architecture, written in Python and … | 73 | 17838 | active |
| Infrasys-AI/AISystem An open-source Chinese-language course (with Jupyter notebooks, slides, and videos) covering the full AI systems stack: AI chips and archit… | 50 | 17667 | active |
| adongwanai/AgentGuide AgentGuide is an open-source, job-oriented learning guide for AI Agent development, covering LangGraph, advanced RAG, fine-tuning, and rein… | 61 | 8836 | active |
| MITDeepLearning/introtodeeplearning The official lab materials and Jupyter notebooks for MIT 6.S191 Introduction to Deep Learning, runnable in Google Colab. It covers neural n… | 61 | 8761 | active |
| charliedream1/ai_quant_trade A one-stop AI quantitative trading platform covering learning, simulation, and live trading of stocks, funds, and crypto. It bundles exampl… | 67 | 6375 | active |
| tensorchord/Awesome-LLMOps A curated awesome-list cataloging the best LLMOps tools for developers, covering models, serving, security, training, data management, depl… | 70 | 5921 | active |
| ashleve/lightning-hydra-template A GitHub project template combining PyTorch Lightning and Hydra for structuring deep learning research code. It provides preconfigured proj… | 62 | 5338 | active |
| togethercomputer/RedPajama-Data RedPajama-Data provides code and pipelines for building RedPajama-V2, an open dataset with over 30 trillion tokens of web text for training… | 68 | 4980 | active |
| LLMBook-zh/LLMBook-zh.github.io The official website and resource hub for the Chinese textbook《大语言模型》(Large Language Models) by Zhao Xin et al. from Renmin University, pro… | 43 | 4551 | active |
| NVIDIA/GenerativeAIExamples A collection of NVIDIA reference workflows, notebooks, and example projects for building generative AI systems on accelerated infrastructur… | 62 | 4160 | active |
| MaximeVandegar/Papers-in-100-Lines-of-Code A curated collection of 63+ machine learning research papers implemented from scratch in roughly 100 lines of Python/PyTorch each. It serve… | 77 | 2865 | active |
| ForceInjection/AI-fundamentals A comprehensive Chinese-language learning resource collection covering the full AI infrastructure stack, from GPU/TPU hardware architecture… | 69 | 2376 | active |
| aws-samples/amazon-bedrock-workshop A hands-on workshop of Jupyter Notebook labs for Amazon Bedrock, AWS's managed foundation model service. It covers text generation, RAG wit… | 73 | 2193 | active |
| merveenoyan/smol-vision A collection of Jupyter Notebook recipes for shrinking, optimizing, and fine-tuning cutting-edge vision and multimodal AI models. It covers… | 69 | 1973 | active |
| InternLM/Tutorial A hands-on tutorial repository for the InternLM large language model ecosystem, structured as a multi-level challenge camp with tasks, docs… | 62 | 1972 | active |
| cfregly/ai-performance-engineering Code, labs, and resources accompanying the O'Reilly book 'AI Systems Performance Engineering', covering GPU optimization, distributed train… | 63 | 1863 | active |
| SocialAI-tianji/Tianji Tianji is an open-source Chinese-language LLM application and tutorial project focused on social nuance ('renqing shigu') scenarios, coveri… | 35 | 1822 | active |
| caomaolufei/AIInfraGuide An open-source Chinese-language knowledge base and learning guide covering the full AI infrastructure stack, from GPU hardware and CUDA pro… | 58 | 1806 | active |
| datascale-ai/data_engineering_book An open-source book (with GitHub Pages site and runnable Python code) on data engineering for large language models, covering pretraining d… | 65 | 1300 | active |
| deepseek-ai/profile-data A public release of PyTorch Profiler traces from DeepSeek's V3/R1 training and inference infrastructure, showing computation-communication … | 25 | 1182 | active |
| SkalskiP/vlms-zero-to-hero A tutorial series of Jupyter notebooks teaching the path from NLP and computer vision fundamentals to Vision-Language Models. Each notebook… | 22 | 1179 | active |
| AlibabaCloudDocs/aliyun_acp_learning Alibaba Cloud's ACP (Advanced Cloud Professional) certification course for large language model engineering, delivered as Jupyter Notebook … | 66 | 1131 | active |
| skygazer42/DL-Hub DL-Hub is a comprehensive PyTorch deep learning learning repository with 339 lessons across 8 tracks (vision, NLP, GNN, point cloud, genera… | 77 | 1114 | active |
| 0xSojalSec/LLMs-local A curated awesome-list of platforms, tools, models, and resources for running large language models locally. It covers inference engines, U… | 55 | 1087 | active |
| kubeflow/community-distribution The official Kubeflow Community Distribution providing manifests to install the full Kubeflow Platform (Pipelines, KServe, Central Dashboar… | 92 | 1036 | active |
| data-science-on-aws/data-science-on-aws Companion Jupyter Notebook repository for the O'Reilly book 'Data Science on AWS', containing end-to-end AI/ML pipeline examples using Amaz… | 32 | 3433 | maintenance |
| EleutherAI/the-pile The Pile is a large, diverse, open-source language modeling dataset composed of many smaller text sources combined together. This repositor… | 32 | 1673 | maintenance |
| curiousily/Get-Things-Done-with-Prompt-Engineering-and-LangChain A collection of Jupyter notebook tutorials on prompt engineering and LangChain for building LLM applications with ChatGPT/GPT-4 and open mo… | 30 | 1250 | maintenance |
| openai/summarize-from-feedback Research code and human feedback dataset from OpenAI's paper 'Learning to Summarize from human feedback', including a supervised baseline, … | 10 | 1062 | abandoned |
← prev page 3 / 3