resource: llm-inference

368 resources, primary matches first, then adoption-weighted; health v2 shown.

Resource	Health v2	Stars	Maturity
Shubhamsaboo/awesome-llm-apps A curated collection of 100+ open-source AI agents, agent skills, and RAG applications built in Python, released under Apache-2.0. It serve…	69	134607	active
microsoft/generative-ai-for-beginners A free 21-lesson curriculum from Microsoft teaching how to build applications with generative AI and large language models. It includes Jup…	73	118609	active
mlabonne/llm-course A free, structured course for learning about Large Language Models, organized into three parts: LLM Fundamentals, LLM Scientist, and LLM En…	59	82008	active
shareAI-lab/learn-claude-code An educational repository that teaches how to build a minimal Claude Code-like AI agent harness from scratch in Python. It explains that ag…	63	75378	active
microsoft/ai-agents-for-beginners An 18-lesson open course from Microsoft teaching how to build AI agents, delivered as Jupyter Notebooks with code samples using frameworks …	66	73281	active
asgeirtj/system_prompts_leaks A curated, regularly updated collection of verbatim leaked system prompts from major AI products including ChatGPT, Claude, Gemini, Grok, C…	64	63624	active
Lordog/dive-into-llms A free series of hands-on programming tutorials (in Chinese) for getting started with large language models, derived from Shanghai Jiao Ton…	36	50262	active
deepseek-ai/awesome-deepseek-integration A curated awesome-list cataloging software that integrates the DeepSeek API, spanning applications, agent/RAG frameworks, editor extensions…	57	38971	active
patchy631/ai-engineering-hub A curated collection of 90+ production-ready tutorial projects on LLMs, RAG, AI agents, and MCP, organized by difficulty from beginner to a…	66	37186	active
datawhalechina/self-llm A Chinese-language open-source tutorial guide (Datawhale) for deploying, using, and fine-tuning open-source large language models and multi…	71	31927	active
huggingface/agents-course A free, open-source course by Hugging Face that teaches how to build AI agents, from fundamentals to a benchmark-based final assignment. It…	61	31400	active
HandsOnLLM/Hands-On-Large-Language-Models The official companion code repository for the O'Reilly book 'Hands-On Large Language Models' by Jay Alammar and Maarten Grootendorst, cont…	59	28623	active
QwenLM/Qwen3 Qwen3 is a family of open-weight large language models from Alibaba's Qwen team, with instruct and thinking variants in multiple sizes. The…	53	27560	active
liguodongiot/llm-action A curated Chinese-language knowledge base covering large language model engineering, including training, fine-tuning, inference, compressio…	71	24958	active
AiHubCN/Awesome-Chinese-LLM A curated awesome-list cataloging open-source Chinese large language models, focusing on smaller, privately deployable, low-cost models. It…	66	22752	active
anthropics/courses Anthropic's official educational courses covering the Claude API, prompt engineering, prompt evaluations, and tool use. Content is delivere…	47	22699	active
NirDiamant/agents-towards-production A collection of code-first Jupyter notebook tutorials for building production-grade generative AI agents, covering topics like stateful wor…	62	21334	active
stas00/ml-engineering An open-source 'open book' of methodologies, scripts, and step-by-step instructions for training, fine-tuning, and running inference on lar…	77	18739	active
meta-llama/llama-cookbook Meta's official collection of Jupyter notebook recipes and guides for building with the Llama model family, covering inference, fine-tuning…	63	18558	active
google-gemini/cookbook The Gemini API Cookbook is a collection of Jupyter Notebook quickstarts, tutorials, and examples for using Google's Gemini API and its mode…	70	17703	active
GoogleCloudPlatform/generative-ai A collection of Jupyter notebooks, code samples, and sample apps demonstrating how to use generative AI on Google Cloud, including Gemini m…	74	17630	active
QwenLM/Qwen3-Coder Qwen3-Coder is a family of open-weight large language models specialized for coding and agentic coding tasks, including the 480B-A35B, 30B-…	58	16810	active
hardikpandya/stop-slop A skill file (SKILL.md plus reference documents) that teaches Claude or any LLM to detect and remove AI writing patterns from prose. It inc…	48	16437	active
naklecha/llama3-from-scratch A Jupyter Notebook that implements the Llama 3 language model from scratch, building each tensor and matrix multiplication step by step whi…	24	15222	stable
jujumilk3/leaked-system-prompts A curated collection of leaked system prompts from widely used LLM-based services, with community contributions verified via pull requests …	69	14912	active
LlamaChinese/Llama-Chinese A Chinese-language open-source community hub for the Llama large language model ecosystem, aggregating learning resources, pretrained and f…	35	14738	active
walkinglabs/learn-harness-engineering A project-based open course (14 lectures, 8 projects) teaching harness engineering for AI coding agents, covering environment setup, state …	59	14231	active
eugeneyan/open-llms A curated list of open-source large language models that are licensed for commercial use, such as Apache 2.0, MIT, and OpenRAIL-M. It catal…	32	12857	active
MoonshotAI/Kimi-K2 Kimi K2 is Moonshot AI's open-weight mixture-of-experts large language model series with 1 trillion total parameters (32B activated), optim…	47	11105	active
datawhalechina/all-in-rag An open-source Chinese-language tutorial (Datawhale) providing a full-stack guide to Retrieval-Augmented Generation (RAG) for LLM applicati…	61	10622	active
kyrolabs/awesome-langchain A curated awesome list of tools, projects, ports, and learning resources built around the LangChain LLM framework. It tracks the growing La…	74	9508	active
alirezadir/AIMLInterviews A curated study guide for AI and machine learning technical interviews at big tech companies, covering DSA coding, ML coding, ML/LLM fundam…	76	9474	active
langchain-ai/rag-from-scratch A set of Jupyter notebooks and an accompanying YouTube video playlist from LangChain that teach retrieval-augmented generation (RAG) from f…	38	9196	active
liaokongVFX/LangChain-Chinese-Getting-Started-Guide A Chinese-language getting-started tutorial for LangChain, explaining core concepts like loaders, document splitting, vector stores, and ch…	65	9104	active
MoonshotAI/Kimi-K3 Kimi K3 is an open-weight, 2.8T-parameter native multimodal agentic model from Moonshot AI, built on Kimi Delta Attention and Attention Res…	56	8632	active
jamwithai/production-agentic-rag-course A learner-focused course repository that walks through building a production-grade RAG system (an arXiv paper curator) week by week, coveri…	65	8499	active
deepseek-ai/open-infra-index An index repository from DeepSeek AI cataloging their production-tested open-source AI infrastructure tools, including FlashMLA, DeepEP, De…	30	8059	active
Infrasys-AI/AIInfra AIInfra is an open-source Chinese-language course (text, slides, and videos) on AI infrastructure for large models, covering AI clusters, n…	49	8029	active
NirDiamant/Prompt_Engineering A collection of 22 hands-on Jupyter Notebook tutorials covering prompt engineering techniques for large language models, from basic prompt …	66	7818	active
PKU-YuanGroup/ChatLaw ChatLaw is a family of large language models and a multi-agent legal assistant tailored for Chinese legal language processing, built on a M…	29	7588	active
luhengshiwo/LLMForEverybody A curated collection of LLM learning materials including interview question banks, systematic paper walkthroughs (Transformer, GPT, BERT, e…	67	7213	active
ed-donner/llm_engineering A companion repository of Jupyter Notebook exercises and projects for Ed Donner's 'Mastering LLM Engineering' course, an 8-week program cov…	67	7157	active
DataTalksClub/llm-zoomcamp LLM Zoomcamp is a free, open-source 10-week online course by DataTalks.Club on building real-life LLM applications, including RAG, vector s…	69	7125	active
datawhalechina/Agent-Learning-Hub A curated AI Agent learning roadmap and resource collection maintained by Datawhale, organized as an actionable todo list with stages from …	56	7105	active
mnfst/awesome-free-llm-apis A curated awesome-list of LLM API providers offering permanent free tiers for text inference, with rate limits, model specs, and API key li…	59	7061	active
linexjlin/GPTs A curated collection of leaked system prompts from OpenAI GPTs, gathered from social media, community pull requests, and prompt extraction.…	27	32034	maintenance
reorx/awesome-chatgpt-api A curated awesome-list of apps and tools that use the ChatGPT/OpenAI API while letting users supply their own API keys. It covers browser e…	63	6404	active
jeinlee1991/chinese-llm-benchmark ReLE (formerly CLiB) is a continuously updated Chinese-language LLM capability benchmark and leaderboard covering ~400 commercial and open-…	89	6401	active
sindresorhus/awesome-chatgpt A curated awesome list of resources for ChatGPT, the AI chatbot developed by OpenAI. It catalogs official links, apps, browser extensions, …	60	6388	active
promptslab/Awesome-Prompt-Engineering A hand-curated awesome-list of prompt engineering and context engineering resources for large language models like GPT, ChatGPT, and PaLM. …	75	6292	active
wassupjay/n8n-free-templates A curated collection of 200+ ready-to-import n8n workflow JSON templates combining classic automation with AI components like vector databa…	34	6165	active
ed-donner/agents A 6-week course repository teaching how to build and deploy autonomous AI agents using OpenAI Agents SDK, CrewAI, LangGraph, Google ADK, Py…	64	6043	active
drona23/claude-token-efficient A single drop-in CLAUDE.md configuration file that makes Claude Code responses terse and reduces output token usage on heavy workflows. It …	54	5982	active
ashishps1/learn-ai-engineering A curated collection of free resources for learning AI engineering from scratch, covering math foundations, Python, machine learning, deep …	49	5961	active
tensorchord/Awesome-LLMOps A curated awesome-list cataloging the best LLMOps tools for developers, covering models, serving, security, training, data management, depl…	70	5921	active
ghuntley/how-to-build-a-coding-agent A step-by-step workshop teaching developers to build their own AI coding agent in Go, similar to tools like Cursor or Cline. It progresses …	62	5814	active
microsoft/promptbase A Microsoft-maintained collection of prompt engineering resources, best practices, and example Python scripts for eliciting top performance…	26	5771	active
coleam00/ottomator-agents A collection of open source AI agent source code and workflow JSONs hosted on the oTTomator Live Agent Studio platform. It serves as both a…	44	5744	active
lonePatient/awesome-pretrained-chinese-nlp-models A curated awesome-list cataloging high-quality Chinese pretrained NLP models, multimodal models, and large language models, organized by ca…	76	5583	active
xlite-dev/Awesome-LLM-Inference A curated list of research papers with code on LLM and VLM inference optimization, covering topics like FlashAttention, PagedAttention, qua…	73	5478	active
SylphAI-Inc/LLM-engineer-handbook A curated list of Large Language Model resources covering the full LLM lifecycle: pretraining, fine-tuning, serving, prompt management, and…	38	5023	active
alchaincyf/hermes-agent-orange-book A bilingual (Chinese/English) open-source guidebook ('Orange Book') for Hermes Agent 2.0, the open-source AI agent framework by Nous Resear…	59	4882	active
dusty-nv/jetson-containers A modular Docker container build system providing prebuilt AI/ML packages (PyTorch, TensorFlow, vLLM, ollama, ROS, etc.) for NVIDIA Jetson …	76	4835	active
pguso/ai-agents-from-scratch An educational repository teaching how to build AI agents from first principles using local LLMs and node-llama-cpp in JavaScript. It provi…	59	4552	active
skyzh/tiny-llm A hands-on course for systems engineers to build an LLM inference and serving system from scratch on Apple Silicon using MLX, implementing …	64	4523	active
Hoper-J/AI-Guide-and-Demos-zh_CN A Chinese-language step-by-step guide and demo code collection for getting started with AI and LLMs, covering API usage, local model deploy…	66	4465	active
daveebbelaar/ai-cookbook A collection of examples and tutorials with copy/paste code snippets for building AI systems with LLMs. It covers agents, OpenAI, Anthropic…	61	4392	active
xai-org/grok-prompts An official xAI repository publishing the system prompts used for the Grok chat assistant, the @grok bot on X, and xAI API safety prefixes.…	42	4391	active
ahkarami/Deep-Learning-in-Production A curated collection of notes, tutorials, and reference links about deploying deep learning models in production, covering PyTorch, TensorF…	32	4376	active
oracle-devrel/oracle-ai-developer-hub A curated collection of technical resources, reference applications, and tutorials for building AI applications, agents, and systems on Ora…	61	4350	active
panaversity/learn-agentic-ai An open-source curriculum teaching Agentic AI development using the Dapr Agentic Cloud Ascent (DACA) design pattern, covering OpenAI Agents…	45	4347	active
HuaizhengZhang/AI-Infra-from-Zero-to-Hero A curated awesome-list of research papers, industry practices, and video tutorials on systems for machine learning, LLMs, and generative AI…	47	4309	active
ogx-ai/llama-stack-apps A collection of example applications and demo scripts built on top of Llama Stack, showing how to build agentic applications with Llama mod…	10	4302	active
zzsting88/relayAPI A curated Chinese-language guide and evaluation of AI API relay/proxy stations (中转站) that resell access to GPT, Claude, Gemini, DeepSeek an…	59	4179	active
slvDev/esp32-ai A project demonstrating a 28.9M parameter language model running entirely on an ESP32-S3 microcontroller at ~9.88 tokens per second, using …	56	4175	active
NVIDIA/GenerativeAIExamples A collection of NVIDIA reference workflows, notebooks, and example projects for building generative AI systems on accelerated infrastructur…	62	4160	active
bragai/bRAG-langchain A collection of Jupyter notebooks teaching how to build Retrieval-Augmented Generation (RAG) applications, from basic pipelines to advanced…	64	4149	active
ysymyth/ReAct Reference prompting code for the ICLR 2023 ReAct paper, which synergizes reasoning and acting in language models. It provides Jupyter noteb…	32	4122	stable
google-gemma/cookbook A collection of guides, tutorials, and example notebooks for Google's Gemma family of open models, including variants like CodeGemma, MedGe…	68	3984	active
skindhu/Build-A-Large-Language-Model-CN A Chinese translation of the book 'Build a Large Language Model (From Scratch)', hosted as an open-source online ebook covering GPT archite…	66	3980	active
QwenLM/Qwen3.8 Official repository for the Qwen3.8 open large language model series from Alibaba's Qwen team, providing release information, documentation…	61	3976	active
GiovanniPasq/agentic-rag-for-dummies A tutorial-style repository and modular reference implementation for building Agentic RAG systems with LangGraph. It combines learning mate…	78	3969	active
microsoft/PhiCookBook A cookbook of hands-on Jupyter notebook examples and guides for Microsoft's Phi family of small language models (SLMs), covering Phi-3 and …	69	3795	active
coleam00/local-ai-packaged A Docker Compose template that bootstraps a complete self-hosted local AI stack, bundling Ollama, n8n, Supabase, Open WebUI, Flowise, Neo4j…	58	3763	active
eosphoros-ai/Awesome-Text2SQL A curated awesome-list of tutorials, papers, datasets, and resources for Text2SQL and related natural-language-to-structured-output tasks (…	57	3743	active
THUDM/AgentBench AgentBench is a comprehensive benchmark for evaluating large language models as agents across multi-turn interactive tasks like database qu…	58	3695	active
CalvinXKY/InfraTech A collection of Jupyter notebook tutorials and exercises covering AI infrastructure topics including PyTorch, vLLM/SGLang inference framewo…	59	3683	active
atfortes/Awesome-LLM-Reasoning A curated awesome-list of papers and resources on unlocking reasoning abilities in large language models and multimodal LLMs, from Chain-of…	67	3675	active
hemansnation/AI-Engineer-Headquarters An open-source, action-oriented curriculum and learning roadmap for becoming an AI engineer, covering ML, MLOps, LLMs, RAG systems, fine-tu…	55	3673	active
sanjeed5/awesome-cursor-rules-mdc A curated awesome list of Cursor .mdc rule files, paired with a Python generator that creates MDC rule files from a JSON library catalog. I…	58	3569	active
filipecalegario/awesome-generative-ai A curated awesome-list of Generative AI tools, models, papers, courses, and references covering text, image, code, and audio generation. It…	58	3527	active
wyf3/llm_related A collection of Python implementations reproducing large language model algorithms, along with the author's learning notes. It serves as an…	64	3505	active
zjhellofss/KuiperInfer KuiperInfer is an open-source course that guides learners through building a high-performance deep learning inference engine from scratch i…	46	3496	active
coleam00/ai-agents-masterclass A companion code repository for a YouTube AI Agents Masterclass series, containing example Python code for building AI agents. Each numbere…	24	3446	active
arman-bd/guppylm GuppyLM is a ~9M parameter language model trained from scratch to talk like a small fish, built as an educational project demonstrating the…	49	3435	active
Goochbeater/Spiritual-Spell-Red-Teaming A curated collection of jailbreak prompts and red-teaming techniques targeting large language models, primarily Claude. It serves as an adv…	59	3313	active
CLUEbenchmark/SuperCLUE SuperCLUE is a comprehensive benchmark for evaluating Chinese-language large language models across language understanding and generation, …	59	3299	active
shareAI-lab/claw0 claw0 is a 10-section progressive tutorial that teaches you to build a production-grade AI agent gateway from scratch in Python, with each …	55	3299	active
BBuf/how-to-optim-algorithm-in-cuda A curated collection of notes and hands-on code for optimizing algorithms on CUDA GPUs, covering handwritten kernels, CUTLASS/CuTe, Triton,…	98	3223	active
SkyworkAI/Skywork-R1V Skywork-R1V is a series of open-source multimodal reasoning models (up to 38B parameters) that extend R1-style LLMs to visual inputs via a …	63	3167	active