function: llm-inference
3362 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| gvzdv/claudish-to-english A Claude Code plugin that rewrites assistant messages into plain English using a local LLM via ollama, or alternatively the codex CLI, Anth… | 67 | 2287 | experimental |
| jennyzzt/dgm Darwin Gödel Machine (DGM) is a research implementation of a self-improving AI agent that iteratively rewrites its own codebase and validat… | 35 | 2254 | experimental |
| Sumandora/remove-refusals-with-transformers A proof-of-concept Python script that removes refusal behavior from LLMs by ablating the refusal direction using pure Hugging Face Transfor… | 48 | 2149 | experimental |
| emcf/engshell Engshell is an English-language shell powered by LLMs that translates natural-language commands into executable Python code on any OS. It i… | 60 | 2148 | experimental |
| YiVal/YiVal YiVal is an open-source Python framework that automatically tunes prompts, RAG configurations, and model parameters for generative AI appli… | 19 | 2133 | experimental |
| etched-ai/open-oasis Inference code and model weights for Oasis 500M, an interactive world model from Decart and Etched that generates gameplay video autoregres… | 22 | 2123 | experimental |
| microsoft/aici AICI (Artificial Intelligence Controller Interface) is a Microsoft Research prototype that lets developers write Wasm-based controllers to … | 19 | 2076 | experimental |
| renatoasse/opensquad opensquad is a multi-agent orchestration framework that lets users describe tasks in natural language and automatically assembles teams of … | 49 | 2070 | experimental |
| fiatrete/OpenDAN-Personal-AI-OS OpenDAN is an open-source Personal AI Operating System that consolidates various AI modules into one platform for personal use. It lets use… | 53 | 2054 | experimental |
| fikrikarim/parlor Parlor is a fully on-device, real-time multimodal voice assistant similar to GPT-Live, combining speech recognition, a Gemma vision-languag… | 78 | 2039 | experimental |
| openTrinity/mycontext MyContext is a local-first desktop application that builds a persistent personal work context layer by connecting signals from instant mess… | 57 | 1998 | experimental |
| browser-use/macOS-use A Python library that lets LLM-powered AI agents control and interact with any macOS application via the accessibility layer, from the make… | 25 | 1973 | experimental |
| losfair/blueboat Blueboat is an all-in-one, multi-tenant serverless JavaScript runtime written in Rust, designed for frictionless horizontal scalability. It… | 23 | 1924 | experimental |
| weaviate/elysia Elysia is an agentic platform and Python package from Weaviate where a decision agent dynamically chooses tools arranged in a decision tree… | 56 | 1923 | experimental |
| Mini-Omni Mini-Omni is an open-source multimodal large language model that performs real-time end-to-end speech-to-speech conversation with streaming… | 22 | 1922 | experimental |
| Lightricks/LTX-Desktop LTX Desktop is an open-source desktop application for generating videos with Lightricks' LTX generative video models, either locally on sup… | 82 | 1920 | experimental |
| AntigmaLabs/ante Ante is a self-contained terminal-based coding agent harness written in Rust, distributed as a single ~15MB binary with zero runtime depend… | 79 | 1908 | experimental |
| jina-ai/dev-gpt Dev-GPT is a Python CLI tool that simulates a virtual development team (Product Manager, Developer, DevOps) powered by OpenAI models. Users… | 30 | 1869 | experimental |
| Standard-Intelligence/hertz-dev Hertz-dev is an open-source 8.5B parameter autoregressive base model for full-duplex conversational audio, released by Standard Intelligenc… | 22 | 1799 | experimental |
| StartupHakk/OpenMonoAgent.ai OpenMonoAgent is a terminal-native coding agent that runs entirely on local hardware, pairing a .NET 10 CLI with a bundled llama.cpp infere… | 58 | 1795 | experimental |
| cfortuner/promptable Promptable is a TypeScript/JavaScript library for building LLM-powered applications, providing prompt templating, model providers (OpenAI, … | 10 | 1745 | experimental |
| antirez/voxtral.c A pure C, zero-dependency inference implementation of Mistral's Voxtral Realtime 4B speech-to-text model, with a streaming C API and CLI fo… | 45 | 1738 | experimental |
| Cormanz/smartgpt SmartGPT is an experimental Rust program that lets LLMs like GPT-3.5 and GPT-4 autonomously complete complex tasks by breaking them into su… | 30 | 1736 | experimental |
| eylonmiz/react-agent ReactAgent is an open-source autonomous LLM agent that uses GPT-4 to generate and compose React components from user stories. It is built w… | 20 | 1655 | experimental |
| skyllwt/AutoSci AutoSci is a wiki-centric AI research platform that automates the full scientific research lifecycle — reading literature, thinking, runnin… | 59 | 1649 | experimental |
| collabora/WhisperFusion WhisperFusion is a real-time voice chat application that combines WhisperLive speech-to-text, a Mistral/Phi LLM, and WhisperSpeech text-to-… | 26 | 1647 | experimental |
| deepseek-ai/DeepSeek-V3.2-Exp DeepSeek-V3.2-Exp is an experimental open-weight large language model release that introduces DeepSeek Sparse Attention for more efficient … | 40 | 1640 | experimental |
| lidangzzz/goal-driven Goal-Driven is a prompt-based multi-agent methodology that wraps coding agents like Claude Code or Codex in a master-agent loop, keeping su… | 47 | 1614 | experimental |
| cyberpapiii/chipotlai-max Chipotlai Max is a meme fork of the OpenCode AI coding agent that hardcodes Chipotle's reverse-engineered 'Pepper' support chatbot as the d… | 53 | 1530 | experimental |
| protectai/rebuff Rebuff is a self-hardening prompt injection detector that protects LLM-powered applications through multi-layered defenses: heuristics, a d… | 10 | 1521 | experimental |
| vercel-labs/openreview OpenReview is an open-source, self-hosted AI code review bot that deploys to Vercel and connects to GitHub via a GitHub App. Mentioning @op… | 46 | 1516 | experimental |
| daveshap/ACE_Framework ACE (Autonomous Cognitive Entities) is an open-source framework for building fully autonomous AI agents that run entirely on local hardware… | 10 | 1504 | experimental |
| murtaza-nasir/maestro MAESTRO is a self-hosted AI-powered research platform that plans and executes complex research tasks using AI agents. It generates detailed… | 59 | 1495 | experimental |
| jdagdelen/hyperDB HyperDB is a lightweight, local vector database library for Python with a C++/MKL-accelerated backend, designed to store and query document… | 23 | 1406 | experimental |
| ProjectUnifree/unifree A Python CLI tool that helps migrate Unity game projects to other engines, primarily Godot and Unreal Engine. It scans Unity projects for m… | 28 | 1400 | experimental |
| test-time-training/ttt-lm-pytorch Official PyTorch implementation of Test-Time Training (TTT) layers, a sequence modeling layer with linear complexity whose hidden state is … | 23 | 1388 | experimental |
| YGYOOO/WorldX WorldX is an open-source web application that generates an AI-driven virtual world from a single sentence, creating maps, pixel-art charact… | 55 | 1384 | experimental |
| socketteer/loom Loom is an experimental tree-based writing interface for collaborating with GPT-3, letting users explore branching continuations of a text … | 32 | 1380 | experimental |
| gorilla-llm/gorilla-cli Gorilla CLI is a command-line tool that turns plain-English objectives into candidate shell commands using LLMs like Gorilla LLM, GPT-4, an… | 19 | 1374 | experimental |
| GradientHQ/parallax Parallax is a distributed model serving framework that lets you build your own AI cluster across heterogeneous, geographically dispersed de… | 66 | 1368 | experimental |
| ghuntley/loom Loom is an AI-powered coding agent written in Rust that provides a REPL interface for interacting with LLM-driven agents capable of file sy… | 50 | 1364 | experimental |
| Claw-AI-Lab/Claw-AI-Lab Claw AI Lab is a self-hosted multi-agent platform that simulates a full AI research lab from a single prompt, orchestrating specialized age… | 54 | 1353 | experimental |
| OpenBB-finance/experimental-openbb-platform-agent A Python library and R&D playground from OpenBB that builds LLM-powered financial analyst agents on top of the OpenBB Platform. Agents use … | 17 | 1344 | experimental |
| linyiLYi/voice-assistant A simple single-script Python demo of a local voice assistant that uses Whisper (via Apple MLX) for speech recognition and a local Yi large… | 26 | 1323 | experimental |
| DLYuanGod/TinyGPT-V TinyGPT-V is an efficient multimodal large language model built on small backbones (Phi-2 2.7B), combining vision and language capabilities… | 55 | 1316 | experimental |
| anc95/writely Writely is an open-source browser extension for Chrome, Firefox, and Edge that brings GPT-powered AI writing assistance to any editable web… | 36 | 1297 | experimental |
| zhnt/loushang Loushang is an AI-native agent harness for coding workflows, delivered as a Python CLI and terminal workbench (`loushang code`) with multi-… | 58 | 1257 | experimental |
| microsoft/prompty Prompty is a markdown-based file format (.prompty) for authoring LLM prompts with YAML frontmatter for model config, inputs, tools, and tem… | 71 | 1252 | experimental |
| nethical6/conversation-steganography A Go CLI tool that hides encrypted secret messages inside natural-looking chat text generated by a local LLM (GPT-2), enabling covert commu… | 55 | 1239 | experimental |
| rapidpages/rapidpages Rapidpages is a prompt-first IDE that generates React and Tailwind CSS components from natural language descriptions using AI. It can be se… | 27 | 1231 | experimental |
| NoDataFound/hackGPT hackGPT is a Python/Jupyter-based chatbot application that leverages OpenAI and ChatGPT APIs for security-oriented tasks like malware analy… | 75 | 1202 | experimental |
| soongenwong/claudecode An open-source, Rust-based terminal AI coding agent inspired by Anthropic's Claude Code, offering an interactive agent shell, one-shot prom… | 54 | 1194 | experimental |
| Runfusion/Fusion Fusion is an open-source multi-agent orchestrator that acts as a 'software factory': AI agents plan, build, review, and ship code from plai… | 82 | 1193 | experimental |
| AutoArk/TinyEngram TinyEngram is an open research project exploring DeepSeek-AI's Engram architecture and memory injection as an alternative to LoRA for param… | 53 | 1191 | experimental |
| Ido-Levi/Hephaestus Hephaestus is a Python-based semi-structured agentic framework where AI agents dynamically create tasks and build workflows as they discove… | 39 | 1183 | experimental |
| farzaa/gemini-bball A demo project from a viral tweet that uses Google's Gemini API to analyze basketball video frames, with an OpenCV-based visualizer. The co… | 31 | 1166 | experimental |
| elfvingralf/macOSpilot-ai-assistant macOSpilot is a macOS desktop AI assistant built with Electron that answers spoken or typed questions about whatever application is current… | 26 | 1157 | experimental |
| axflow/axflow Axflow is a modular TypeScript framework for building natural language powered AI applications, composed of packages like @axflow/models (S… | 19 | 1121 | experimental |
| berylliumsec/nebula Nebula is an AI-powered penetration testing desktop application that combines a terminal, browser, notes, findings, and reporting into one … | 92 | 1097 | experimental |
| CSCB/vibe-mouse An open-source Python desktop application that redefines mouse interaction by letting users bind customizable 'Skills' to buttons, with mul… | 55 | 1086 | experimental |
| thinking-machines-lab/batch_invariant_ops A Python library that replaces standard PyTorch CUDA kernels with batch-invariant versions, ensuring identical results regardless of batch … | 40 | 1067 | experimental |
| yoheinakajima/ditto Ditto is a simple self-building coding agent that generates multi-file Flask applications from natural language descriptions via a web inte… | 22 | 1067 | experimental |
| srush/llama2.rs A pure Rust implementation of Llama2 inference optimized for fast CPU execution, featuring 4-bit GPT-Q quantization, SIMD support, and memo… | 28 | 1063 | experimental |
| ddupont808/GPT-4V-Act GPT-4V-Act is a multimodal AI agent that combines GPT-4V(ision) with a Chromium browser, using Set-of-Mark prompting and a DOM auto-labeler… | 27 | 1058 | experimental |
| oxylabs/ai-scraper-py AI-Scraper is a Python library and scrape agent from Oxylabs AI Studio that extracts data from webpages using natural language prompts inst… | 51 | 1055 | experimental |
| Omniplex-ai/omniplex Omniplex is an open-source, self-hosted alternative to Perplexity, an AI-powered answer engine that combines web search with LLMs to genera… | 24 | 1053 | experimental |
| orca-wm/Orca Orca is a general world foundation model from BAAI centered on Next-State-Prediction, learning a unified world latent space from visual and… | 57 | 1038 | experimental |
| huggingface/optimum-nvidia Optimum-NVIDIA is a Python library that bridges Hugging Face Transformers with NVIDIA TensorRT-LLM for highly optimized LLM inference on NV… | 58 | 1037 | experimental |
| trotsky1997/MathBlackBox MathBlackBox (MCTSr) is a Python research implementation of Monte Carlo Tree Self-Refine, an algorithm that combines MCTS with LLM self-ref… | 24 | 1033 | experimental |
| microsoft/agentrc AgentRC is a Microsoft CLI tool (also a VS Code extension) that measures how 'AI-ready' a repository is and generates context files like Co… | 69 | 1031 | experimental |
| agents-io/PokeClaw PokeClaw is an open-source Android app that runs an on-device LLM (Gemma 4 via LiteRT) to control and automate your phone, with no cloud or… | 70 | 1020 | experimental |
| susiai/susi_shell A suite of Python-based command line tools for interacting with AI services directly from the terminal, including chat, text completion, tr… | 41 | 1002 | experimental |
| meta-llama/llama Meta's official repository containing inference code and download scripts for Llama 2 large language models (7B to 70B parameters). The rep… | 32 | 59579 | abandoned |
| continuedev/continue Continue is an open-source AI coding agent distributed as a CLI, VS Code extension, and JetBrains plugin, offering agent mode, chat, edit, … | 88 | 35644 | abandoned |
| Pythagora-io/gpt-pilot GPT Pilot was an AI coding agent that aimed to act as an 'AI developer', generating full applications step-by-step from a specification usi… | 68 | 33685 | abandoned |
| voideditor/void Void is an open-source AI code editor forked from VS Code, offering chat, agent mode, inline edits, and autocomplete with any LLM provider … | 10 | 28825 | abandoned |
| openai/gpt-2 Official OpenAI repository containing code and pretrained model weights for GPT-2, from the paper 'Language Models are Unsupervised Multita… | 10 | 25021 | abandoned |
| RooCodeInc/Roo-Code Roo Code is a VS Code extension that provides a team of AI coding agents inside the editor, with modes for coding, architecture planning, d… | 10 | 24324 | abandoned |
| openai/swarm Swarm is an experimental, educational Python framework from OpenAI for lightweight multi-agent orchestration, built on the Chat Completions… | 60 | 21925 | abandoned |
| QwenLM/Qwen The official repository for Qwen (Tongyi Qianwen), Alibaba Cloud's family of pretrained and chat large language models, with weights on Hug… | 60 | 21654 | abandoned |
| opencode-ai/opencode OpenCode is a terminal-based AI coding agent written in Go, providing a TUI for interacting with multiple AI providers (OpenAI, Anthropic, … | 10 | 13697 | abandoned |
| fuergaosi233/wechat-chatgpt A TypeScript bot that connects OpenAI's ChatGPT API to WeChat using the wechaty library, supporting text conversations, DALL·E image genera… | 22 | 13238 | abandoned |
| idootop/mi-gpt MiGPT is a Node.js/Docker application that connects Xiaomi's XiaoAI smart speakers to ChatGPT and Doubao, turning them into custom AI voice… | 10 | 12508 | abandoned |
| mistralai/mistral-inference The official minimal Python library from Mistral AI for running inference with Mistral open-weight models such as Mistral 7B, Mixtral, Code… | 10 | 10832 | abandoned |
| microsoft/vscode-copilot-chat The GitHub Copilot Chat extension for Visual Studio Code, providing AI chat, inline suggestions, and autonomous agent capabilities inside t… | 10 | 9976 | abandoned |
| aliasrobotics/cai Cybersecurity AI (CAI) is an open-source Python framework of specialized AI agents for offensive security tasks such as penetration testing… | 10 | 9810 | abandoned |
| intel/ipex-llm IPEX-LLM is a PyTorch LLM acceleration library for Intel hardware (iGPU, NPU, Arc/Flex/Max GPUs, and CPU), offering low-bit quantization (F… | 10 | 8859 | abandoned |
| nebuly-ai/optimate OptiMate is a collection of Python libraries from Nebuly AI for optimizing AI model performance, including Speedster for inference accelera… | 23 | 8329 | abandoned |
| EleutherAI/gpt-neo GPT-Neo is EleutherAI's implementation of model- and data-parallel GPT-3-style transformer language models built on mesh-tensorflow, with r… | 10 | 8270 | abandoned |
| ChatAnyTeam/ChatAny ChatAny is a self-hostable web application that aggregates ChatGPT-style AI chat with AI image generation services like Midjourney and Stab… | 53 | 6491 | abandoned |
| rustformers/llm An ecosystem of Rust libraries built on GGML for running large language model inference locally, including a CLI binary and reusable crates… | 10 | 6152 | abandoned |
| Lightning-AI/lit-llama Lit-LLaMA is an independent, Apache 2.0-licensed implementation of the LLaMA language model built on nanoGPT, covering pre-training, fine-t… | 43 | 6085 | abandoned |
| qodo-ai/qodo-cover Qodo Cover is an AI-powered tool that automatically generates unit tests to increase code coverage, using LLMs to write and validate tests … | 60 | 5627 | abandoned |
| ramon-victor/freegpt-webui A Python web application providing a ChatGPT-style chat UI backed by the G4F (gpt4free) API, allowing access to GPT-3.5/4 models without an… | 10 | 5615 | abandoned |
| dsdanielpark/Bard-API An unofficial Python package that returns Google Bard (now Gemini) responses by reverse-engineering the web interface using cookie values i… | 10 | 5177 | abandoned |
| opencx-labs/copilot A TypeScript library for building AI copilot/sidekick experiences powered by large language models. The project is no longer maintained, pe… | 10 | 5109 | abandoned |
| biobootloader/wolverine Wolverine is a Python CLI tool that runs Python scripts and, when they crash, sends the error to GPT-4 which edits the file and reruns it r… | 30 | 5072 | abandoned |
| AutoGPTQ/AutoGPTQ AutoGPTQ is a Python library for quantizing large language models using the GPTQ weight-only quantization algorithm, with user-friendly API… | 10 | 5070 | abandoned |
| transcranial/keras-js A JavaScript library for running trained Keras deep learning models directly in the browser, with GPU acceleration via WebGL 2. It also sup… | 23 | 4963 | abandoned |
| Stability-AI/StableSwarmUI StableSwarmUI is a modular web-based user interface for Stable Diffusion image generation, emphasizing accessible powertools, high performa… | 24 | 4948 | abandoned |