resource: llm-inference
368 resources, primary matches first, then adoption-weighted; health v2 shown.
| Resource | Health v2 | Stars | Maturity |
|---|---|---|---|
| rasbt/reasoning-from-scratch The official code repository for the book 'Build a Reasoning Model (From Scratch)' by Sebastian Raschka, containing step-by-step PyTorch im… | 71 | 5070 | active |
| trigaten/Learn_Prompting Learn Prompting is a free, comprehensive open-source guide and course platform for prompt engineering and generative AI, cited by OpenAI an… | 23 | 4727 | active |
| huggingface/notebooks A collection of Jupyter notebooks demonstrating how to use Hugging Face libraries such as Transformers, Datasets, and Diffusers. It serves … | 77 | 4600 | active |
| TingsongYu/PyTorch-Tutorial-2nd A free open-source Chinese-language book and companion Jupyter Notebook codebase teaching PyTorch from basics through CV, NLP, and LLM appl… | 67 | 4584 | active |
| mongodb-developer/GenAI-Showcase MongoDB's official showcase repository of Jupyter notebooks, sample apps, and workshops demonstrating Retrieval-Augmented Generation (RAG),… | 70 | 4260 | active |
| huggingface/course The free, open-source Hugging Face course teaching how to apply Transformers to NLP and LLM tasks using the Hugging Face ecosystem (Transfo… | 73 | 4155 | active |
| lintsinghua/claude-code-book A 420,000-word Chinese-language book (with English edition) that deeply analyzes the architecture of Claude Code as an AI Agent Harness, co… | 59 | 4142 | active |
| didilili/ai-agents-from-zero A comprehensive open-source Chinese-language tutorial and learning roadmap for building AI agents and LLM applications, covering LangChain,… | 55 | 4094 | active |
| wwwzhouhui/dify-for-dsl A curated collection of Dify DSL workflow files (.yml) that can be imported into the Dify open-source LLM application platform. Each workfl… | 66 | 3865 | active |
| Sumanth077/ai-engineering-toolkit A curated list of 100+ libraries and frameworks for AI engineers building with large language models, covering vector databases, orchestrat… | 54 | 3378 | active |
| Meirtz/Awesome-Context-Engineering A curated awesome-list and survey of context engineering for LLMs and AI agents, collecting hundreds of papers, frameworks, and implementat… | 56 | 3283 | active |
| Sumanth077/Hands-On-AI-Engineering A curated collection of practical, production-ready AI engineering projects in Python, covering AI agents, RAG pipelines, OCR systems, and … | 65 | 2945 | active |
| MARKTECHPOST-AI-MEDIA-INC/AI-Agents-Projects-Tutorials A curated collection of Jupyter notebook tutorials and implementations covering agentic AI, multi-agent systems, memory, planning, and reas… | 63 | 2881 | active |
| google-ai-edge/mediapipe-samples Official collection of sample code and tutorials for Google's MediaPipe on-device machine learning platform. It demonstrates how to build c… | 78 | 2809 | active |
| underlines/awesome-ml A curated awesome-list of machine learning resources covering LLMs, image, video, and audio models, plus analytics and data science. It org… | 40 | 2719 | active |
| echonoshy/cgft-llm A hands-on tutorial series (in Chinese) for learning large language model technologies, with Jupyter Notebook code, written docs, and video… | 60 | 2663 | active |
| ray-project/kuberay KubeRay is a Kubernetes operator and toolkit for deploying and managing Ray applications on Kubernetes. It provides RayCluster, RayJob, and… | 95 | 2650 | active |
| liyupi/yu-ai-agent A tutorial-based project by programmer Yupi teaching AI application development with Java 21, Spring Boot 3, and Spring AI. Learners build … | 47 | 2630 | active |
| LearnPrompt/LearnPrompt A permanently free, open-source Chinese-language AIGC course and learning path covering AI coding tools (Claude Code, Codex), agent enginee… | 74 | 2599 | active |
| langchain-ai/langchain-nextjs-template A starter template scaffolding a LangChain.js application in Next.js, with example API routes for chat, structured output, agents, and RAG.… | 73 | 2521 | active |
| ForceInjection/AI-fundamentals A comprehensive Chinese-language learning resource collection covering the full AI infrastructure stack, from GPU/TPU hardware architecture… | 69 | 2376 | active |
| Sahir619/fable-method A distilled set of agent skills (think/act/prove/grow) capturing the working methodology of Claude Fable 5, packaged as a Claude Code plugi… | 75 | 2253 | active |
| AmberLJC/LLMSys-PaperList A curated list of academic papers, tutorials, and projects on Large Language Model systems, covering training, serving, agentic systems, an… | 71 | 2233 | active |
| aws-samples/amazon-bedrock-workshop A hands-on workshop of Jupyter Notebook labs for Amazon Bedrock, AWS's managed foundation model service. It covers text generation, RAG wit… | 73 | 2193 | active |
| break-into-data/ai-engineer-toolkit A curated toolkit of frameworks, tools, and learning resources for becoming an AI engineer and building production-grade AI applications. I… | 39 | 2184 | active |
| greshake/llm-security A research repository demonstrating indirect prompt injection attacks against application-integrated LLMs like Bing Chat, GPT-4, and LangCh… | 45 | 2130 | active |
| javahongxi/whatsmars A curated collection of Java ecosystem study modules and runnable samples covering Spring Boot, Redis, Dubbo, RocketMQ, Kafka, Elasticsearc… | 96 | 1967 | active |
| ornith-ai/Ornith-1 Ornith is a family of open-weight large language models (397B scale) designed for agentic tasks, released under MIT license with weights ho… | 58 | 1958 | active |
| ai-that-works/ai-that-works A weekly live-streamed series (Tuesdays 10 AM PST) by the BAML and HumanLayer creators covering production AI engineering through live codi… | 64 | 1912 | active |
| vstorm-co/full-stack-ai-agent-template A production-ready full-stack project generator that scaffolds FastAPI + Next.js 15 applications with AI agents, RAG pipelines, WebSocket s… | 80 | 1856 | active |
| SocialAI-tianji/Tianji Tianji is an open-source Chinese-language LLM application and tutorial project focused on social nuance ('renqing shigu') scenarios, coveri… | 35 | 1822 | active |
| XiaomingX/indie-hacker-tools-plus A curated awesome-list of tech stacks, tools, and templates for independent developers building products, especially those going global ('出… | 66 | 1815 | active |
| caomaolufei/AIInfraGuide An open-source Chinese-language knowledge base and learning guide covering the full AI infrastructure stack, from GPU hardware and CUDA pro… | 58 | 1806 | active |
| lihanghang/NLP-Knowledge-Graph A curated Chinese-language collection of research notes, papers, tools, datasets, and links covering NLP, knowledge graphs, knowledge-base … | 34 | 1763 | active |
| neural-maze/ava-whatsapp-agent-course Ava is a course project and codebase for building a WhatsApp AI agent that chats realistically, understands voice and images, and replies w… | 43 | 1673 | active |
| lucaswalter/n8n-ai-automations A curated collection of n8n workflow JSON templates and AI agent configurations published by The Recap AI YouTube channel and its Skool com… | 50 | 1606 | active |
| karpathy/LLM101n LLM101n is a planned course by Andrej Karpathy and Eureka Labs that teaches building a Storyteller AI large language model end-to-end, from… | 10 | 37505 | experimental |
| aws-samples/amazon-bedrock-samples A collection of Jupyter notebook examples and guides for getting started with Amazon Bedrock, AWS's managed generative AI service. It cover… | 73 | 1496 | active |
| modelscope/modelscope-classroom ModelScope Classroom is a collection of deep learning and large language model tutorials from the ModelScope community, delivered as Jupyte… | 61 | 1482 | active |
| ikatsov/tensor-house TensorHouse is a collection of reference Jupyter notebooks and demo AI/ML applications covering enterprise use cases such as marketing, pri… | 23 | 1452 | active |
| alan345/AI-Fullstack-SaaS-Boilerplate A fullstack SaaS boilerplate built with tRPC, Fastify, React 19, Drizzle ORM, and Better Auth, with integrated AI chat via OpenAI and Serve… | 78 | 1408 | active |
| philschmid/deep-learning-pytorch-huggingface A collection of Jupyter notebook tutorials and examples for deep learning with PyTorch and Hugging Face libraries like Transformers, Datase… | 35 | 1392 | active |
| ModelTC/LightX2V-Qwen-Image-Lightning Qwen-Image-Lightning provides distilled LoRA weights that accelerate the Qwen-Image text-to-image and image-editing models to 4-8 step infe… | 45 | 1356 | active |
| tanishqkumar/beyond-nanogpt An educational repository of minimal, annotated, from-scratch implementations of ~100 modern deep learning techniques, bridging nanoGPT and… | 48 | 1340 | active |
| Acmesec/theAIMythbook A Chinese-language guidebook ('AI Myth Book') covering large language model fundamentals, prompt design, AI applications in security work, … | 17 | 1331 | active |
| Yuan-ManX/ai-game-devtools A curated awesome-list hub cataloging AI-powered game development tools across categories like LLMs, world models, agents, code, image, tex… | 72 | 1316 | active |
| TommyZihao/vlm_arm A tutorial project connecting a Mycobot 280 Pi robotic arm to multimodal large language models (GPT-4o, Claude 3, Yi-Vision, Qwen-VL) to bu… | 55 | 1274 | active |
| openvinotoolkit/open_model_zoo A collection of pre-trained deep learning models (Intel and public) plus demos and tools for use with the OpenVINO inference toolkit. It in… | 77 | 4420 | maintenance |
| whwangovo/pyre-code A self-hosted coding practice platform with ~76 ML implementation problems covering attention, training, RLHF, diffusion, and GNNs, graded … | 51 | 1253 | active |
| e2b-dev/awesome-ai-sdks A curated awesome-list database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging, and deploying autonomous AI … | 69 | 1215 | active |
| YUANZHUO-BNU/metahuman_overview A curated Chinese-language overview of digital human (metahuman) technologies, covering avatar appearance, voice cloning, lip sync, and con… | 28 | 1192 | active |
| deepseek-ai/profile-data A public release of PyTorch Profiler traces from DeepSeek's V3/R1 training and inference infrastructure, showing computation-communication … | 25 | 1182 | active |
| cedrickchee/awesome-transformer-nlp A curated awesome-list of NLP resources focused on Transformer networks, attention mechanisms, GPT/BERT, ChatGPT, LLMs, and transfer learni… | 32 | 1149 | active |
| elastic/elasticsearch-labs A collection of executable Python notebooks and example applications from Elastic demonstrating how to use Elasticsearch as a vector databa… | 74 | 1123 | active |
| neural-maze/realtime-phone-agents-course A hands-on course repository teaching how to build realtime AI voice agents that handle live phone calls. It covers FastRTC for low-latency… | 53 | 1085 | active |
| kubeflow/community-distribution The official Kubeflow Community Distribution providing manifests to install the full Kubeflow Platform (Pipelines, KServe, Central Dashboar… | 92 | 1036 | active |
| langchain-ai/langsmith-cookbook A collection of practical Jupyter notebook recipes and examples for using LangSmith to debug, trace, evaluate, and improve LLM applications… | 10 | 1036 | active |
| opencv/opencv_zoo A collection of pre-trained computer vision models tuned for OpenCV's DNN inference module, accompanied by benchmarking tools for various h… | 61 | 1034 | active |
| serverless/aws-ai-stack AWS AI Stack is a full-stack boilerplate for building serverless AI applications on AWS, combining Lambda, API Gateway, DynamoDB, EventBrid… | 60 | 1007 | active |
| google/BIG-bench BIG-bench is a collaborative benchmark with over 200 tasks for probing and measuring the capabilities of large language models. It includes… | 10 | 3247 | maintenance |
| anthropics/cwc-workshops Workshop materials from Anthropic's 'Code with Claude' events, covering building and evaluating agents with Claude Managed Agents, Skills, … | 58 | 2026 | maintenance |
| roboflow/awesome-openai-vision-api-experiments A curated collection of experiments demonstrating how to build applications on top of the OpenAI Vision API (GPT-4V), including zero-shot c… | 27 | 1690 | maintenance |
| langchain-ai/streamlit-agent A collection of reference implementations of LangChain agents built as Streamlit apps, including streaming chat, memory, search-enabled cha… | 10 | 1643 | maintenance |
| FullStackRetrieval-com/RetrievalTutorials A collection of Jupyter Notebook tutorials and guides teaching retrieval and Retrieval Augmented Generation (RAG) for LLM applications, fro… | 26 | 1482 | maintenance |
| zixian2021/AI-interview-cards A curated repository of over 1000 machine learning and deep learning interview questions and answers organized into 25 categories, includin… | 30 | 1352 | maintenance |
| jarmuine/claude-code A mirror of a publicly exposed source snapshot of Anthropic's Claude Code CLI, leaked via a source map file in the npm distribution on Marc… | 48 | 2281 | experimental |
| daveebbelaar/langchain-experiments A collection of Jupyter Notebook experiments demonstrating how to build LLM-powered applications with the LangChain library and OpenAI mode… | 30 | 1140 | experimental |
| cortexlabs/cortex Cortex is an open-source platform for deploying, managing, and scaling machine learning models in production on AWS, built on top of EKS. I… | 23 | 8011 | abandoned |
← prev page 4 / 4