resource: llm-inference
368 resources, primary matches first, then adoption-weighted; health v2 shown.
| Resource | Health v2 | Stars | Maturity |
|---|---|---|---|
| Clouditera/SecGPT SecGPT is an open-source large language model purpose-built for cybersecurity, fine-tuned from Qwen2.5 and DeepSeek-R1 bases on a large cur… | 39 | 3101 | active |
| datawhalechina/hugging-llm HuggingLLM is an open-source Chinese tutorial (the 'Butterfly Book') from Datawhale teaching the principles, usage, and application develop… | 69 | 3063 | active |
| microsoft/Generative-AI-for-beginners-dotnet A Microsoft-maintained hands-on course teaching .NET developers how to build Generative AI applications in C# across five practical lessons… | 88 | 3025 | active |
| 0xk1h0/ChatGPT_DAN A curated collection of ChatGPT jailbreak prompts, most famously the DAN (Do Anything Now) prompts, which attempt to bypass OpenAI's conten… | 53 | 12336 | maintenance |
| cporter202/automate-faceless-content A free guide and self-paced course teaching how to automate faceless short-form and long-form video content for YouTube, TikTok, Facebook, … | 54 | 2971 | active |
| DLLXW/baby-llama2-chinese An educational Python repository for pretraining and SFT fine-tuning a small (92M-218M parameter) Chinese Llama2 model from scratch, runnab… | 72 | 2923 | active |
| ombharatiya/ai-system-design-guide An open-source, continuously updated guide to AI system design covering RAG architectures, LLM engineering, agentic AI, MCP/A2A protocols, … | 60 | 2885 | active |
| langchain-ai/langchain-academy LangChain Academy's official set of Jupyter Notebook modules teaching foundational concepts of the LangChain ecosystem, with a focus on bui… | 62 | 2832 | active |
| rafska/awesome-local-llm A curated awesome-list of platforms, tools, models, tutorials, and resources for running large language models locally on your own hardware… | 62 | 2787 | active |
| kyrolabs/awesome-agents A curated awesome list of open-source tools, frameworks, and products for building AI agents. It organizes resources into categories such a… | 73 | 2786 | active |
| cyfyifanchen/one-person-company A curated, continuously updated Chinese-language guide to AI tools for running a one-person company, covering LLMs, TTS, coding, design, pr… | 29 | 2726 | active |
| huggingface/cookbook A community-driven collection of Jupyter notebooks from Hugging Face demonstrating practical AI application building with open-source tools… | 71 | 2711 | active |
| BannyLon/DifyAIA An open-source collection of ready-to-import Dify workflow DSL examples (YAML files) with accompanying Flask helper services, created by a … | 63 | 2642 | active |
| genieincodebottle/generative-ai A curated collection of Generative AI learning resources including a detailed roadmap, hands-on Jupyter Notebook projects, use cases, and i… | 71 | 2608 | active |
| Windy3f3f3f3f/claude-code-from-scratch A step-by-step tutorial project that rebuilds the core architecture of Claude Code in about 5000 lines of TypeScript and Python across 13 c… | 59 | 2607 | active |
| MiniMax-AI/MiniMax-M2 MiniMax-M2 is an open-source Mixture-of-Experts large language model with 230 billion total parameters and 10 billion active parameters, re… | 40 | 2605 | active |
| athina-ai/rag-cookbooks A collection of Jupyter notebook cookbooks demonstrating advanced and agentic Retrieval-Augmented Generation (RAG) techniques, progressing … | 25 | 2568 | active |
| datawhalechina/handy-ollama An open-source Chinese-language tutorial (Datawhale) teaching how to deploy and run large language models locally with Ollama using only a … | 51 | 2510 | active |
| AI-Efficiency/Awesome-Model-Quantization A curated awesome-list collecting papers, benchmarks, books, and code repositories about neural network and LLM model quantization. It serv… | 73 | 2431 | active |
| brexhq/prompt-engineering Brex's prompt engineering guide, a documentation-style resource covering strategies, guidelines, and safety recommendations for building sy… | 30 | 9585 | maintenance |
| Liquid4All/cookbook A collection of examples, end-to-end tutorials, and demo applications built with Liquid AI's open-weight Liquid Foundation Models (LFM) and… | 60 | 2418 | active |
| open-free-llm-api/awesome-freellm-apis A machine-readable, daily-updated directory of 450+ free LLM API models from 30+ providers (Google Gemini, Groq, NVIDIA NIM, OpenRouter, et… | 58 | 2410 | active |
| LichAmnesia/GPT-Prompt-Hub A community-driven open-source repository collecting 222 structured, battle-tested prompts for modern LLMs like Claude, GPT, and Gemini. Ea… | 61 | 2393 | active |
| adithya-s-k/AI-Engineering.academy AI Engineering Academy is an open-source educational resource offering structured learning paths for applied AI, covering prompt engineerin… | 58 | 2377 | active |
| DestinyLinker/MingLi-Bench A Python benchmark dataset and CLI for evaluating large language models on Chinese traditional fortune telling, covering Bazi (八字) and Ziwe… | 50 | 2338 | active |
| buchidonggua/dg-ai-notes An open-source bilingual (TypeScript/Python) tutorial book that dissects the Pi-Agent SDK's source code across 10 chapters and provides a 7… | 66 | 2333 | active |
| mistralai/cookbook A collection of Jupyter notebook examples and guides for using Mistral AI models via the Mistral API, contributed by Mistral and the commun… | 71 | 2317 | active |
| MoonshotAI/Kimi-K2.5 Kimi K2.5 is Moonshot AI's open-weight, 1T-parameter Mixture-of-Experts multimodal agentic model (32B activated), continually pretrained on… | 58 | 2303 | active |
| victorchen96/deepseek_v4_rolepaly_instruct A documentation and prompt-engineering guide for controlling DeepSeek-V4's chain-of-thought style during roleplay, providing copy-paste con… | 52 | 2303 | active |
| itMrBoy/resumePolice A collection of LLM prompts and Dify workflow files for reviewing and improving resumes, plus generating interview questions from an interv… | 39 | 2252 | active |
| EgoAlpha/prompt-in-context-learning A curated awesome-list of papers, tutorials, and prompt examples for in-context learning and prompt engineering with LLMs like ChatGPT, GPT… | 68 | 2249 | active |
| eugr/spark-vllm-docker A Docker configuration and set of shell scripts for running vLLM inference on NVIDIA DGX Spark hardware, from single nodes to multi-node cl… | 83 | 2189 | active |
| imaurer/awesome-llm-json A curated awesome list of resources for generating JSON and other structured outputs with Large Language Models, covering techniques like f… | 33 | 2172 | active |
| zebbern/no-cost-ai A curated, community-maintained index of 80+ free AI services covering chat, image, video, voice, and developer APIs, organized by whether … | 62 | 2161 | active |
| langchain-ai/agents-from-scratch A tutorial repository and companion course from LangChain Academy that teaches how to build AI agents from scratch using LangGraph, culmina… | 63 | 2156 | active |
| humanloop/awesome-chatgpt A curated list of tools, demos, documentation, and community resources for ChatGPT and GPT-3. It aggregates unofficial API clients, browser… | 53 | 8204 | maintenance |
| OpenCoder-llm/OpenCoder-llm OpenCoder is a fully open and reproducible family of code large language models (1.5B and 8B base and chat variants) trained on 2.5 trillio… | 22 | 2111 | active |
| noonghunna/club-3090 A community-maintained collection of recipes, configs, and scripts for serving large language models locally on consumer NVIDIA GPUs (RTX 3… | 79 | 2101 | active |
| huggingface/transformers.js-examples A collection of demos and example applications showcasing Hugging Face Transformers.js, which runs transformer models directly in the brows… | 53 | 2087 | active |
| wafer-ai/gpu-perf-engineering-resources A curated list of resources for learning AI/GPU performance engineering, ordered from GPU fundamentals through kernel optimization, inferen… | 60 | 2080 | active |
| teddylee777/langchain-kr A Korean-language tutorial collection for LangChain based on official docs, cookbooks, and practical examples, provided as Jupyter notebook… | 42 | 2042 | active |
| horseee/Awesome-Efficient-LLM A curated awesome-list of research papers and resources on efficient large language models, covering pruning, quantization, knowledge disti… | 41 | 2036 | active |
| janhq/awesome-local-ai A curated awesome-list of open-source and local AI tools, focused on local LLM inference engines, UIs, and related solutions. It catalogs p… | 28 | 2016 | active |
| GAIR-NLP/O1-Journey A research project and report series from GAIR at Shanghai Jiao Tong University documenting the journey of replicating OpenAI's O1 reasonin… | 22 | 2002 | active |
| vonzosten/awesome-LangGraph A curated awesome-list indexing the LangChain and LangGraph ecosystem, covering frameworks, tools, templates, community projects, and learn… | 63 | 1981 | active |
| ymcui/Chinese-LLaMA-Alpaca-3 Chinese-LLaMA-Alpaca-3 is a project releasing Chinese-adapted Llama-3 base and instruct large language models, trained via incremental pret… | 52 | 1979 | active |
| InternLM/Tutorial A hands-on tutorial repository for the InternLM large language model ecosystem, structured as a multi-level challenge camp with tasks, docs… | 62 | 1972 | active |
| gkamradt/langchain-tutorials A collection of Jupyter notebook tutorials and example projects teaching the LangChain library, including a two-part cookbook covering core… | 31 | 7484 | maintenance |
| 12britz/awesome-free-models A curated awesome-list of free AI models, APIs, and tools, covering open-weight models, free API tiers, local inference tools, and the surr… | 58 | 1934 | active |
| liyupi/yu-ai-code-mother An educational full-stack project and tutorial series for building an enterprise-grade AI code generation platform using Spring Boot 3, Lan… | 62 | 1909 | active |
| tau-bench τ-Bench (tau2-bench) is a Python benchmark for evaluating LLM agents on tool-agent-user interaction in real-world domains like retail, airl… | 79 | 1882 | active |
| Fafa-DL/Lhy_Machine_Learning A collection of lecture slides, notes, and homework assignments for Hung-yi Lee's 2021/2022/2023 Spring Machine Learning courses, maintaine… | 32 | 7108 | maintenance |
| czl9707/build-your-own-openclaw A step-by-step tutorial with 18 progressive lessons teaching how to build an AI agent from a simple chat loop to a lightweight multi-agent … | 56 | 1876 | active |
| HuangOwen/Awesome-LLM-Compression A curated awesome-list of research papers and tools on large language model compression, covering quantization, pruning and sparsity, disti… | 74 | 1865 | active |
| cfregly/ai-performance-engineering Code, labs, and resources accompanying the O'Reilly book 'AI Systems Performance Engineering', covering GPU optimization, distributed train… | 63 | 1863 | active |
| ray-project/llm-applications A comprehensive tutorial repository (Jupyter notebooks plus guide) for building production-grade RAG-based LLM applications using Ray. It c… | 62 | 1855 | active |
| petergpt/bullshit-benchmark BullshitBench is a benchmark dataset and evaluation harness that tests whether AI models detect and push back on nonsensical prompts rather… | 59 | 1836 | active |
| hexiecs/talk-normal A curated system prompt that makes any LLM respond concisely and naturally, removing verbose corporate filler. Distributed as a shell-insta… | 49 | 1836 | active |
| jamesob/local-llm A personal guide and configuration repository for running state-of-the-art LLMs and speech-to-text locally on consumer/prosumer hardware. I… | 54 | 1800 | active |
| ai-hero-dev/ai-hero AI Hero is an open-source collection of course material, runnable examples, exercises, and libraries for learning AI engineering, created b… | 64 | 1787 | active |
| openai/openai-cua-sample-app A TypeScript sample application from OpenAI demonstrating how to use the Computer Using Agent (CUA) via the Responses API against browser e… | 53 | 1775 | active |
| DjangoPeng/openai-quickstart A comprehensive open-source tutorial and learning guide for developing applications with large language models, built as Jupyter Notebooks.… | 33 | 1773 | active |
| tmylla/Awesome-LLM4Cybersecurity A curated awesome-list and systematic literature review tracking 861+ papers on large language models applied to cybersecurity, organized i… | 70 | 1761 | active |
| neural-maze/agentic-patterns-course A Jupyter Notebook course implementing the four agentic patterns (reflection, tool use, planning/ReAct, and multiagent) from scratch using … | 31 | 1743 | active |
| asinghcsu/AgenticRAG-Survey A survey repository accompanying the arXiv paper 'Agentic Retrieval-Augmented Generation: A Survey on Agentic RAG', providing a taxonomy, v… | 42 | 1723 | active |
| Barca0412/Introduction-to-Quantitative-Finance A Chinese-language open-source knowledge base for quantitative finance research, featuring a multi-factor equity investing tutorial, curate… | 73 | 1696 | active |
| microsoft/edgeai-for-beginners A Microsoft open-source curriculum teaching beginners the fundamentals of Edge AI, including popular models, inference techniques, model op… | 63 | 1670 | active |
| centerforaisafety/hle Humanity's Last Exam (HLE) is a multi-modal benchmark of 2,500 expert-written questions across dozens of academic subjects, designed to tes… | 63 | 1665 | active |
| lizhe2004/Awesome-LLM-RAG-Application A curated awesome-list of resources for building LLM applications using the RAG (Retrieval-Augmented Generation) pattern. It collects paper… | 58 | 1650 | active |
| NirDiamant/Controllable-RAG-Agent A tutorial repository demonstrating an advanced, controllable RAG agent for complex question answering, built with a deterministic graph-ba… | 63 | 1621 | active |
| emarco177/langchain-course A project-based open-source course teaching how to build AI agents with LangChain v1+ and LangGraph in Python. It includes seven hands-on p… | 73 | 1615 | active |
| pguso/rag-from-scratch An educational repository that teaches Retrieval-Augmented Generation (RAG) by building it step by step from scratch in JavaScript, using l… | 49 | 1607 | active |
| Tencent-Hunyuan/Tencent-Hunyuan-Large Official repository for Tencent Hunyuan-Large, a 52B-parameter (A13B active) mixture-of-experts open-source large language model with up to… | 22 | 1582 | active |
| Google-Health/medgemma MedGemma is a collection of Gemma 3 model variants trained on medical text and imagery (a 4B multimodal version and a 27B text-only version… | 59 | 1574 | active |
| llm2014/llm_benchmark A personal, long-running benchmark that tracks large language model performance on logic, math, programming, and intuition tasks using a pr… | 65 | 1567 | active |
| WeiboAI/VibeThinker VibeThinker is a family of small dense reasoning language models (1.5B and 3B parameters) from WeiboAI, trained with a Spectrum-to-Signal p… | 60 | 1561 | active |
| SemiAnalysisAI/InferenceX InferenceX is an open-source, vendor-neutral continuous benchmarking platform that measures LLM inference performance across serving framew… | 71 | 1554 | active |
| neural-maze/philoagents-course An open-source course teaching how to build an AI-powered game simulation engine where agents impersonate historical philosophers like Plat… | 42 | 1537 | active |
| amitshekhariitbhu/llm-internals A curated collection of blogs and videos teaching how large language models work internally, from tokenization and BPE to attention math an… | 58 | 1533 | active |
| daveebbelaar/python-whatsapp-bot A tutorial-style repository and starter code for building AI-powered WhatsApp bots in pure Python using the Meta WhatsApp Cloud API, Flask,… | 27 | 1526 | active |
| phodal/understand-prompt A Chinese-language tutorial repository (Jupyter Notebook based) exploring AI prompt usage across programming, image generation, and writing… | 31 | 5558 | maintenance |
| SkyworkAI/Skywork The Skywork series of open-source large language models (13B Base, Chat, Math, and multimodal MM variants) pre-trained on 3.2TB of multilin… | 32 | 1498 | active |
| rasbt/llm-architecture-gallery Source metadata (models.yml) for Sebastian Raschka's LLM Architecture Gallery, a curated reference of ~99 modern language-model architectur… | 59 | 1495 | active |
| Chainlit/cookbook A collection of example demo projects showing how to build chatbot UIs with Chainlit, a Python framework for conversational AI applications… | 47 | 1424 | active |
| groq/groq-api-cookbook A collection of tutorials, sample code, and guidelines for building applications with the Groq API, maintained as Jupyter Notebook examples… | 69 | 1418 | active |
| mythrantic/ollama-docker A Docker Compose configuration that deploys Ollama together with its dependencies, including an Open WebUI chat frontend, in one command. I… | 63 | 1418 | active |
| felladrin/awesome-ai-web-search A curated awesome-list of open-source software that combines Large Language Models with web search, organized as a timeline. It covers tool… | 65 | 1417 | active |
| benman1/generative_ai_with_langchain Companion code repository for the Packt book 'Generative AI with LangChain, Second Edition', containing Jupyter notebook examples for build… | 72 | 1411 | active |
| KalyanKS-NLP/rag-zero-to-hero-guide A comprehensive open-source guide and course for learning Retrieval-Augmented Generation (RAG) from basics to advanced topics. It includes … | 26 | 1410 | active |
| ykhli/local-ai-stack A starter kit (boilerplate) for building fully local AI applications with zero API costs, beginning with a document Q&A chat app. It combin… | 27 | 1391 | active |
| SCIR-HI/Huatuo-Llama-Med-Chinese BenTsao (formerly HuaTuo) is a collection of large language models instruction-tuned on Chinese medical knowledge, built from LLaMA, Chines… | 71 | 4986 | maintenance |
| IQuestLab/IQuest-Coder-V1 IQuest-Coder-V1 is a family of open code large language models (7B, 14B, and 40B variants including Base, Instruct, and Thinking versions) … | 47 | 1389 | active |
| philschmid/gemini-samples A collection of Jupyter notebook samples, snippets, and guides demonstrating how to use Google DeepMind Gemini models. It covers function c… | 52 | 1372 | active |
| Langboat/Mengzi3 Mengzi3 is a series of open-source Chinese-focused large language models (8B and 13B parameters) released by Langboat in Base and Chat vari… | 25 | 1369 | active |
| XiaomiMiMo/MiMo-V2-Flash MiMo-V2-Flash is a 309B-parameter Mixture-of-Experts language model (15B active) from Xiaomi designed for efficient reasoning, coding, and … | 43 | 1368 | active |
| meituan-longcat/LongCat-Flash-Chat LongCat-Flash-Chat is the official repository for Meituan's LongCat-Flash, a 560-billion-parameter Mixture-of-Experts (MoE) foundation lang… | 58 | 1365 | active |
| DEEP-PolyU/Awesome-LLM-based-Text2SQL A curated awesome-list accompanying a TKDE 2025 survey on LLM-based text-to-SQL, collecting research papers, benchmarks, datasets, and open… | 60 | 1358 | active |
| google-gemini/starter-applets A collection of small starter apps from Google AI Studio demonstrating how to build interactive experiences with the Gemini API. Each apple… | 10 | 1356 | active |
| poe-platform/server-bot-quick-start A companion repository to the Poe server bot tutorial, containing starter code and example bots (echo, prompt, wrapper, image generation, m… | 74 | 1350 | active |
| jxzhangjhu/Awesome-LLM-RAG A curated awesome-list of advanced papers, tutorials, workshops, and resources on Retrieval Augmented Generation (RAG) in Large Language Mo… | 69 | 1343 | active |