function: llm-inference
3362 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| dotnet/skills A curated collection of agent skills and custom agents from the .NET team, packaged as plugins for AI coding agents like Copilot CLI and Cl… | 64 | 5256 | active |
| ningzimu/codex-ppt-skill An agent skill (SKILL.md-based) that turns articles, reports, papers, or notes into image-based PowerPoint presentations by planning an out… | 77 | 5245 | active |
| lmstudio-ai/lms lms is the official command-line tool for LM Studio, built on the lmstudio.js SDK. It lets users manage local LLMs (list, download, load, u… | 69 | 5232 | active |
| kodu-ai/claude-coder Kodu (Claude Coder) is an autonomous AI coding agent distributed as a VS Code extension. It takes natural-language task descriptions and bu… | 31 | 5228 | active |
| jina-ai/node-DeepResearch A TypeScript agent that iteratively searches the web, reads webpages, and reasons with an LLM (Gemini, OpenAI, or local) until it finds a c… | 58 | 5225 | active |
| neo4j-labs/llm-graph-builder A web application that transforms unstructured data (PDFs, DOCs, TXTs, YouTube videos, web pages) into a knowledge graph stored in Neo4j us… | 90 | 5197 | active |
| transformerlab/transformerlab-app Transformer Lab is an open-source desktop application (built with Electron and Python) that provides a unified GUI for training, fine-tunin… | 84 | 5179 | active |
| YILS-LIN/short-video-factory Short Video Factory is an open-source cross-platform desktop application that uses AI to generate and automatically edit short videos from … | 78 | 5176 | active |
| maziyarpanahi/openmed OpenMed is a local-first healthcare AI SDK for clinical named-entity recognition and HIPAA PII/PHI de-identification that runs entirely on-… | 83 | 5166 | active |
| linuxhsj/openclaw-zero-token OpenClaw Zero Token is a fork of OpenClaw that provides a unified gateway to major LLM providers (ChatGPT, Claude, Gemini, DeepSeek, Qwen, … | 74 | 5154 | active |
| OpenBMB/AgentVerse AgentVerse is a Python framework for deploying multiple LLM-based agents, offering two frameworks: task-solving (multi-agent collaboration … | 20 | 5115 | active |
| Exafunction/windsurf.vim windsurf.vim is a Vim and Neovim plugin providing free, AI-powered code autocomplete as a Copilot alternative. It integrates the Windsurf (… | 65 | 5106 | active |
| su-kaka/gcli2api A self-hosted Python service that converts GeminiCLI and Antigravity into OpenAI-, Gemini-, and Claude-compatible API endpoints. It can be … | 62 | 5100 | active |
| looplj/axonhub AxonHub is an open-source AI gateway written in Go that lets any SDK call 100+ LLMs through a unified API. It provides built-in failover, l… | 79 | 5078 | active |
| camel-ai/oasis OASIS is an open-source social media simulator that uses large language model and rule-based agents to mimic the behavior of up to one mill… | 75 | 5061 | active |
| unicity-aos/capsule-react A Rust ReAct loop coordinator that implements a stateless state machine for the reasoning-and-action cycle in agent systems. It is part of … | 76 | 5053 | active |
| deepseek-ai/DeepSeek-V2 DeepSeek-V2 is a strong, economical Mixture-of-Experts language model released with open weights, inference code, and evaluation tooling. T… | 24 | 5039 | active |
| vllm-project/aibrix AIBrix is an open-source, cloud-native framework from the vLLM project providing essential building blocks for scalable, cost-efficient Gen… | 83 | 5038 | active |
| developersdigest/llm-answer-engine A Perplexity-inspired AI answer engine built with Next.js, the Vercel AI SDK, LangChain.JS, Groq/Mixtral, Brave Search, Serper, and OpenAI.… | 61 | 5036 | active |
| tencentmusic/supersonic SuperSonic is an AI+BI platform that combines Chat BI (natural language querying powered by LLMs) with Headless BI (a governed semantic lay… | 64 | 5030 | active |
| huggingface/text-embeddings-inference Text Embeddings Inference (TEI) is a Rust-based toolkit from Hugging Face for deploying and serving open-source text embedding, re-ranker, … | 84 | 5028 | active |
| Adam-CAD/CADAM CADAM is an open-source web application that converts natural language descriptions and images into 3D CAD models using LLM-powered agents … | 77 | 5019 | active |
| GaiaNet-AI/gaianet-node GaiaNet node is a shell-based installer and runtime for running your own decentralized AI agent service locally. It deploys an LLM inferenc… | 48 | 5017 | active |
| pollinations/pollinations Pollinations is an open-source generative AI platform offering free APIs for text, image, and vision model inference without requiring API … | 77 | 4996 | active |
| pkuliyi2015/multidiffusion-upscaler-for-automatic1111 An Automatic1111 Stable Diffusion WebUI extension that enables generating and upscaling ultra-large images (2K+) on GPUs with limited VRAM … | 30 | 4994 | active |
| gd3kr/BlenderGPT A Blender add-on that integrates OpenAI's GPT-4/GPT-3.5 into Blender's UI, letting users control the 3D software with natural language comm… | 30 | 4977 | active |
| icip-cas/PPTAgent PPTAgent is an agentic Python framework that automatically generates PowerPoint presentations from documents using a two-stage, edit-based … | 70 | 4954 | active |
| pytorch/executorch ExecuTorch is PyTorch's framework for exporting and running AI models on-device across mobile, embedded, and edge hardware, with a tiny (~5… | 95 | 4953 | active |
| ztxz16/fastllm fastllm is a high-performance C++ LLM inference library with its own custom operators, requiring no PyTorch dependency. It supports tensor-… | 74 | 4945 | active |
| going-doer/Paper2Code PaperCoder is a multi-agent LLM system that automatically generates a code repository from a machine learning research paper via a planning… | 52 | 4925 | active |
| joonspk-research/generative_agents The official code release for the Stanford 'Generative Agents' research paper, implementing computational agents powered by LLMs that simul… | 28 | 21995 | maintenance |
| Martian-Engineering/lossless-claw A Lossless Context Management (LCM) plugin for OpenClaw that replaces sliding-window context truncation with a DAG-based summarization syst… | 82 | 4894 | active |
| ag2ai/ag2 AG2 (formerly AutoGen) is an open-source Python framework for building AI agents and orchestrating multi-agent systems, supporting LLM inte… | 84 | 4890 | active |
| google-deepmind/alphageometry Google DeepMind's implementation of AlphaGeometry and DDAR, AI systems that solve Olympiad-level geometry theorem proving problems. It comb… | 55 | 4879 | active |
| mistralai/mistral-vibe Mistral Vibe is an open-source command-line coding agent powered by Mistral's models, providing a conversational interface to explore and m… | 79 | 4876 | active |
| akitaonrails/ai-memory A Rust CLI and MCP server that provides long-term memory for AI coding agent CLIs like Claude Code, Codex, and Devin. It captures session c… | 76 | 4845 | active |
| deepjavalibrary/djl Deep Java Library (DJL) is an engine-agnostic, high-level deep learning framework for Java that supports backends like PyTorch, TensorFlow,… | 80 | 4842 | active |
| facebookresearch/lingua Meta Lingua is a minimal, fast LLM training and inference library built on easy-to-modify PyTorch components for research purposes. It supp… | 36 | 4766 | active |
| Integuru-AI/Integuru Integuru is an AI agent that reverse-engineers platforms' internal APIs by analyzing browser network requests (HAR files) and building depe… | 62 | 4760 | active |
| Anil-matcha/AI-Youtube-Shorts-Generator An open-source Python tool that turns long-form YouTube videos into vertical 9:16 short clips using LLM-based highlight detection, Whisper … | 66 | 4738 | active |
| SakuraLLM/SakuraLLM SakuraLLM is a series of fine-tuned open large language models for Japanese-to-Chinese translation specialized in light novel and Galgame (… | 61 | 4735 | active |
| manycore-research/SpatialLM SpatialLM is a 3D large language model that processes point cloud data (from monocular video, RGBD images, or LiDAR) and generates structur… | 62 | 4719 | active |
| AgnesAI-Labs/AgnesAI-Models Official gateway and model catalog for Agnes AI, providing OpenAI-compatible API access to multimodal foundation models covering text, imag… | 58 | 4705 | active |
| yangjian102621/geekai GeekAI is an open-source, self-hosted AI content creation platform integrating chat, image generation (MidJourney, DALL-E, Stable Diffusion… | 95 | 4686 | active |
| u14app/deep-research Deep Research is a web application that uses any large language model (Gemini, OpenAI, Anthropic, DeepSeek, Grok, Ollama, etc.) combined wi… | 72 | 4684 | active |
| Ironclad/rivet Rivet is an open-source visual AI programming environment consisting of a desktop IDE for building AI agents and prompt chains via a node-b… | 77 | 4680 | active |
| harbor-framework/harbor Harbor is a Python framework from the creators of Terminal-Bench for evaluating and optimizing AI agents and language models in containeriz… | 85 | 4664 | active |
| Tencent/TNN TNN is a high-performance, lightweight deep learning inference framework developed by Tencent Youtu Lab, supporting mobile, desktop, and se… | 32 | 4648 | active |
| OpenNMT/CTranslate2 CTranslate2 is a C++ and Python library for fast, memory-efficient inference of Transformer models on CPU and GPU. It uses quantization, la… | 96 | 4644 | stable |
| promptslab/Promptify Promptify is a Python library that turns LLMs into task-based NLP engines, providing high-level APIs for NER, classification, QA, and custo… | 65 | 4635 | active |
| deepseek-ai/Engram Official implementation of Engram, a conditional memory module from DeepSeek that modernizes N-gram embeddings for O(1) lookup as a new spa… | 43 | 4614 | active |
| TencentCloudADP/youtu-agent Youtu-Agent is a Python framework for building, running, and evaluating autonomous LLM agents, supporting ReAct-style single agents and pla… | 57 | 4604 | active |
| get-convex/chef Chef is an AI-powered full-stack web app builder by the Convex team, forked from bolt.diy, that generates apps with a built-in reactive dat… | 54 | 4603 | active |
| kyegomez/tree-of-thoughts A Python library implementing the Tree of Thoughts algorithm for deliberate, multi-step problem solving with large language models. It prov… | 35 | 4591 | active |
| ruc-datalab/DeepAnalyze DeepAnalyze is the first agentic LLM (DeepAnalyze-8B, built on Qwen) for autonomous data science, capable of running the full pipeline from… | 61 | 4565 | active |
| SWE-agent/SWE-agent SWE-agent is a Python framework that lets a language model autonomously use tools to fix GitHub issues, find cybersecurity vulnerabilities,… | 67 | 20147 | maintenance |
| fixie-ai/ultravox Ultravox is a fast multimodal LLM that understands human speech directly without a separate ASR stage, by projecting audio into the LLM's e… | 44 | 4555 | active |
| chaitin/MonkeyCode MonkeyCode is an open-source, enterprise-grade AI coding platform that combines managed development environments, AI model management, and … | 80 | 4553 | active |
| VRSEN/agency-swarm Agency Swarm is a Python framework for building multi-agent AI applications on top of the OpenAI Agents SDK. It lets developers define spec… | 92 | 4540 | active |
| JetBrains/koog Koog is a JetBrains-built Kotlin/Java framework for creating fault-tolerant, enterprise-ready AI agents on the JVM, with multiplatform depl… | 84 | 4536 | active |
| phodal/auto-dev AutoDev is an AI-native multi-agent coding development platform built on Kotlin Multiplatform, distributed as an IntelliJ IDEA plugin, VS C… | 85 | 4535 | active |
| OAID/Tengine Tengine is a lightweight, high-performance, modular deep learning inference engine developed by OPEN AI LAB for embedded and edge devices. … | 27 | 4531 | active |
| EvoScientist/EvoScientist EvoScientist is a Python-based multi-agent framework for building self-evolving AI scientists that plan, research, code, analyze data, and … | 82 | 4501 | active |
| openai/harmony OpenAI's Rust library (with first-class Python bindings) for rendering and parsing the harmony response format used by its open-weight gpt-… | 52 | 4487 | active |
| kaixindelele/ChatPaper ChatPaper is a Python tool that uses ChatGPT to summarize arXiv papers, translate full PDFs, polish academic writing, and simulate peer rev… | 62 | 19780 | maintenance |
| microsoft/LMOps A Microsoft research initiative collecting code and papers on fundamental techniques for building AI products with large language models, c… | 74 | 4465 | active |
| anc95/ChatGPT-CodeReview A GitHub App and GitHub Action that automatically reviews pull requests using ChatGPT/OpenAI models, posting AI-generated review comments o… | 95 | 4458 | active |
| ibttf/interview-coder Interview Coder is an Electron-based desktop application that provides AI assistance during technical interviews, using GPT/OpenAI models t… | 45 | 4447 | active |
| zai-org/GLM-4.5 GLM-4.5 (and successors GLM-4.6/4.7) is a family of open-weight Mixture-of-Experts foundation models from Z.ai focused on agentic tasks, re… | 47 | 4416 | active |
| MemeCalculate/moyin-creator Moyin Creator is a production-grade AI film creation desktop application that covers the full pipeline from script to finished video, with … | 75 | 4412 | active |
| zgsm-ai/costrict CoStrict is an open-source, enterprise-focused AI coding assistant delivered as VS Code and JetBrains extensions, offering strict-mode code… | 81 | 4391 | active |
| embabel/embabel-agent Embabel Agent is an agentic AI framework for the JVM, written in Kotlin with first-class Java and Spring Boot support. It provides typed, g… | 86 | 4386 | active |
| EvolvingLMMs-Lab/lmms-eval lmms-eval is a unified Python framework for evaluating large multimodal models across text, image, video, and audio tasks, with 100+ benchm… | 85 | 4377 | active |
| modelscope/ms-agent MS-Agent is a lightweight Python framework from ModelScope for building LLM-powered agents with autonomous exploration capabilities. It sup… | 87 | 4369 | active |
| meta-llama/PurpleLlama Purple Llama is Meta's umbrella project of tools and benchmarks for assessing and improving the security of large language models. It inclu… | 71 | 4365 | active |
| open-compass/VLMEvalKit VLMEvalKit is an open-source Python toolkit for evaluating large vision-language models (LMMs/LVLMs) across 80+ benchmarks with support for… | 62 | 4359 | active |
| Doriandarko/maestro Maestro is a Python framework that uses an orchestrator LLM (originally Claude Opus) to break down objectives into sub-tasks, delegate them… | 25 | 4357 | active |
| BuilderIO/micro-agent Micro Agent is an open-source CLI AI agent that generates unit tests from a natural language prompt and then iterates on code until all tes… | 24 | 4328 | active |
| whoiskatrin/sql-translator SQL Translator is a free, open-source web application that converts natural language queries into SQL code and translates SQL back into hum… | 44 | 4323 | active |
| crmne/ruby_llm RubyLLM is a Ruby framework providing a unified, expressive interface to all major AI providers (OpenAI, Anthropic, Google, Ollama, and any… | 83 | 4322 | active |
| ymcui/Chinese-LLaMA-Alpaca A project releasing Chinese-adapted LLaMA and instruction-tuned Alpaca large language models with extended Chinese vocabulary, plus pre-tra… | 56 | 18931 | maintenance |
| tloen/alpaca-lora A repository of scripts for reproducing Stanford Alpaca-style instruction tuning of LLaMA models using low-rank adaptation (LoRA) on consum… | 30 | 18906 | maintenance |
| leetcode-mafia/cheetah Cheetah is a macOS app that provides real-time AI coaching for software engineering interviews. It transcribes conversation audio locally w… | 21 | 4257 | active |
| algorithmicsuperintelligence/optillm OptiLLM is an OpenAI API-compatible optimizing inference proxy that applies 20+ inference-time techniques (e.g., Mixture of Agents, MCTS, c… | 81 | 4252 | active |
| ModelTC/LightLLM LightLLM is a Python-based LLM inference and serving framework designed for lightweight deployment, easy scalability, and high throughput. … | 84 | 4243 | active |
| kirodotdev/Kiro Kiro is an agentic IDE and CLI that helps developers go from prototype to production using spec-driven development, agent hooks, powers, an… | 63 | 4225 | active |
| zhayujie/bot-on-anything Bot on Anything is a lightweight Python framework for building AI chatbots that connect large language models (ChatGPT, Claude, Gemini, ERN… | 62 | 4216 | active |
| SylphAI-Inc/AdalFlow AdalFlow is a PyTorch-like Python library for building and auto-optimizing LLM application workflows such as chatbots, RAG pipelines, and a… | 67 | 4211 | active |
| eth-sri/lmql LMQL is a query/programming language for large language models, implemented as a Python-based superset that lets developers interleave prom… | 32 | 4208 | active |
| jwohlwend/boltz Boltz is a family of open-source biomolecular interaction models (Boltz-1 and Boltz-2) that predict complex structures and binding affiniti… | 63 | 4177 | active |
| llm-d/llm-d llm-d is a Kubernetes-native distributed LLM inference serving stack that orchestrates model servers like vLLM and SGLang across clusters. … | 82 | 4164 | active |
| 0xNyk/council-of-high-intelligence A shell-based skill/plugin that runs structured multi-persona deliberation for hard decisions across AI coding agents like Claude Code, Cod… | 75 | 4162 | active |
| Spark NLP Spark NLP is an open-source natural language processing library built natively on Apache Spark, providing scalable NLP annotations and tran… | 96 | 4159 | stable |
| ArcInstitute/evo2 Evo 2 is a DNA foundation language model (1B-40B parameters) that models genomes at single-nucleotide resolution with up to 1 million base … | 62 | 4157 | active |
| FareedKhan-dev/all-agentic-architectures A Python library packaging 35 production-grade agentic AI architectures (Reflexion, LATS, GraphRAG, MemGPT, Voyager, etc.) as runnable Arch… | 63 | 4154 | active |
| dataelement/Clawith Clawith is an open-source multi-agent collaboration platform where each AI agent has a persistent identity, long-term memory, and its own w… | 82 | 4138 | active |
| openai/transformer-debugger Transformer Debugger (TDB) is an OpenAI tool for investigating specific behaviors of small language models, combining automated interpretab… | 60 | 4124 | active |
| IDEA-CCNL/Fengshenbang-LM Fengshenbang-LM is an open-source suite of Chinese large language models and a PyTorch training framework from IDEA Research's CCNL lab, ai… | 71 | 4123 | active |
| langroid/langroid Langroid is a Python framework for building LLM-powered applications using multi-agent programming, where agents encapsulate LLM conversati… | 93 | 4102 | active |
| copilot.lua A pure Lua Neovim plugin that replaces copilot.vim, providing GitHub Copilot AI code suggestions with a Lua API for integration. It include… | 95 | 4096 | active |