function: llm-inference
3362 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| utkusen/promptmap promptmap2 is an automated prompt injection scanner for custom LLM applications, supporting white-box testing of system prompts and black-b… | 53 | 1263 | active |
| Yuliang-Liu/MonkeyOCRv2 MonkeyOCRv2 is a document-native vision encoder and visual-text foundation model for Document AI, pretrained on the 113M-image MonkeyDoc v2… | 58 | 1261 | active |
| math-inc/OpenGauss Open Gauss is a project-scoped workflow orchestrator that gives the `gauss` CLI a multi-agent frontend for Lean 4 theorem proving workflows… | 48 | 1261 | active |
| firecrawl/fire-enrich Fire Enrich is an AI-powered data enrichment web application that transforms a list of email addresses into rich company datasets, includin… | 39 | 1261 | active |
| thu-ml/Motus Motus is the official implementation of a unified latent action world model for robotics, combining a video generation model, a vision-lang… | 43 | 1260 | active |
| bug0inc/passmark Passmark is an open-source TypeScript library that extends Playwright to run end-to-end browser regression tests written in plain English. … | 57 | 1258 | active |
| X-Square-Robot/wall-x Wall-X is the open-source training and inference stack for X Square Robot's WALL series of embodied foundation models (VLAs) for general-pu… | 61 | 1252 | active |
| fpgaminer/joycaption JoyCaption is an open, free, and uncensored image captioning Visual Language Model (VLM) with released weights and training scripts. It gen… | 53 | 1250 | active |
| EmergenceAI/Agent-E Agent-E is an open-source agent-based system that automates actions on the user's computer, currently focusing on browser automation via na… | 61 | 1249 | active |
| unum-cloud/UForm UForm is a compact multimodal AI library providing tiny image-text embedding models (64-768 dimensions, Matryoshka-style) and small generat… | 55 | 1248 | active |
| Heavrnl/TelegramForwarder A self-hosted Telegram message forwarder built on Telethon that copies messages from multiple source chats to target chats with keyword/reg… | 52 | 1247 | active |
| gitmylo/audio-webui An all-in-one web UI for audio-related neural networks, bundling text-to-speech (Bark), voice conversion/cloning (RVC), and text-to-audio/m… | 30 | 1246 | active |
| supavec/supavec Supavec is an open-source RAG-as-a-Service platform (an alternative to Carbon.ai) that lets developers upload documents, generate embedding… | 48 | 1236 | active |
| TheSmallHanCat/sora2api A self-hosted OpenAI-compatible API gateway that wraps Sora's text-to-video and image generation capabilities behind standard /v1/chat/comp… | 10 | 1232 | active |
| OStudi/short-video-generator-AI An open-source Python tool that turns YouTube videos into ready-to-post vertical short videos by automatically detecting highlights, adding… | 57 | 1228 | active |
| ElectricAlexis/NotaGen NotaGen is a symbolic music generation model that produces high-quality classical sheet music using LLM-style training paradigms: pre-train… | 32 | 1225 | active |
| deusyu/translate-book An agent skill for Codex, Claude Code, and OpenClaw that translates entire books in PDF, DOCX, or EPUB format into any language. It convert… | 58 | 1223 | active |
| firecrawl/web-agent An open-source TypeScript framework for building autonomous web research agents, layered from a Next.js chat template down to an agent core… | 50 | 1223 | active |
| bowang-lab/MedRAX MedRAX is a medical reasoning agent framework that integrates chest X-ray analysis tools (segmentation, grounding, report generation, disea… | 42 | 1223 | active |
| 666ghj/DeepSearchAgent-Demo A framework-free Python implementation of a deep search AI agent that generates high-quality research reports through multi-round web searc… | 34 | 1223 | active |
| GML-MMGroup/GMTalker GMTalker is an interactive 3D digital human system rendered with Unreal Engine, integrating speech recognition, speech synthesis, natural l… | 46 | 1222 | active |
| jx-sec/jxwaf JXWAF is an open-source web application firewall powered by an AI large language model, combining an AI security model, a semantic analysis… | 67 | 1221 | active |
| uezo/ChatdollKit ChatdollKit is a Unity SDK that turns 3D character models into voice-enabled chatbots and virtual assistants. It integrates LLMs (ChatGPT, … | 76 | 1218 | active |
| thClaws/thClaws thClaws is an open-source AI agent harness written in native Rust that ships as a single binary offering a desktop GUI, CLI, headless, and … | 77 | 1214 | active |
| mbrg/power-pwn Power Pwn is an offensive and defensive security toolset for Microsoft 365 Power Platform and AI services, including Copilot Studio, custom… | 63 | 1213 | active |
| alibaba/lumenx LumenX is an AI-native platform for turning novel text into publishable motion comic and short drama videos. It provides a full pipeline fr… | 59 | 1209 | active |
| SalesforceAIResearch/enterprise-deep-research Enterprise Deep Research (EDR) is a multi-agent deep research system from Salesforce AI Research that combines a master planning agent, spe… | 56 | 1205 | active |
| modelscope/sirchmunk Sirchmunk is an agentic, embedding-free search engine that turns raw files into a self-evolving knowledge base in real time, without vector… | 83 | 1204 | active |
| superlinear-ai/raglite RAGLite is a Python toolkit for building Retrieval-Augmented Generation (RAG) pipelines backed by DuckDB or PostgreSQL, with hybrid keyword… | 85 | 1200 | active |
| GoogleCloudPlatform/vertex-ai-creative-studio GenMedia Creative Studio is a web application showcasing Google Cloud's generative media APIs including Gemini Image (Nano Banana), Veo vid… | 90 | 1199 | active |
| deepseek-ai/DeepSeek-VL DeepSeek-VL is an open-source vision-language foundation model for real-world multimodal understanding, released with model weights and inf… | 25 | 4177 | maintenance |
| vercel-labs/workflow-builder-template A template for building a visual AI workflow automation platform, built on Vercel's Workflow DevKit with a drag-and-drop React Flow editor.… | 60 | 1196 | active |
| zai-org/CogAgent CogAgent is an open-source vision-language model (VLM) based GUI agent that understands screen captures and natural language to automate in… | 33 | 1195 | active |
| FranciscoMoretti/chat-js ChatJS is an open-source, production-ready AI chat application built with Next.js and TypeScript, offering authentication, 120+ models via … | 84 | 1192 | active |
| TrafficGuard/typedai TypedAI is a TypeScript-first platform for building and running autonomous AI agents, LLM workflows, chatbots, and AI software engineering … | 52 | 1192 | active |
| nvk/llm-wiki A plugin that lets AI agents (Claude Code, OpenAI Codex, OpenCode, portable agents) compile and maintain LLM-curated knowledge bases as pla… | 77 | 1188 | active |
| composio-community/secure-openclaw A self-hostable personal AI assistant that runs 24x7 on your messaging platforms (WhatsApp, Telegram, Signal, iMessage), powered by Claude … | 57 | 1188 | active |
| NVIDIA/audio-flamingo NVIDIA's PyTorch implementation of the Audio Flamingo series of large audio-language models (AF1, AF2, AF3, and Music Flamingo) for audio u… | 50 | 1187 | active |
| Jwuthri/Tracely-ai Tracely is a self-hosted, trace-native CI/CD and observability platform for AI agents. It ingests agent traces over OpenTelemetry, grades t… | 58 | 1186 | active |
| HiveNexus/HiveChat HiveChat is a self-hostable AI chat application designed for small and medium-sized teams, with multi-user management, group-based permissi… | 39 | 1186 | active |
| thinkany-ai/rag-search A RAG (retrieval-augmented generation) search API service built with FastAPI by the ThinkAny AI search engine team. It combines web search … | 25 | 1179 | active |
| warmshao/FasterLivePortrait A real-time portrait animation application based on LivePortrait that animates still photos or videos using a driving video, image, audio, … | 38 | 1178 | active |
| Azure-Samples/chat-with-your-data-solution-accelerator A Microsoft solution accelerator that deploys a ChatGPT-style Q&A experience grounded in your own documents, using Azure OpenAI models and … | 94 | 1177 | active |
| ztx888/HaloWebUI HaloWebUI is a self-hosted AI chat platform forked from Open WebUI, with a localized Chinese interface plus added model billing and usage s… | 55 | 1173 | active |
| aliyun/SimAI SimAI is a large-scale network simulation toolkit from Alibaba Cloud for modeling AI training and inference workloads on GPU clusters, publ… | 66 | 1171 | active |
| aegra/aegra Aegra is an open-source, self-hosted backend server for running LangGraph AI agents, serving as a drop-in replacement for LangSmith Deploym… | 85 | 1169 | active |
| FunnyWolf/agentic-soc-platform Agentic SOC Platform (ASP) is an open-source, agent-centric security operations platform that ingests SIEM/webhook alerts, correlates them … | 81 | 1168 | active |
| Ricky-7-Yan/intelligent-audit-system AuditPilot is an enterprise AI agent workbench for audit delivery, combining evidence-grounded agentic RAG, governed tool execution, evalua… | 60 | 1167 | active |
| soniqo/speech-swift An open-source Swift toolkit for on-device speech AI on Apple Silicon, providing ASR, TTS, speech-to-speech, VAD, and speaker diarization v… | 83 | 1164 | active |
| CyberAgentAILab/TANGO TANGO is a research library from CyberAgent AI Lab that generates co-speech gesture videos by reenactment, using hierarchical audio-motion … | 39 | 1163 | active |
| Linaom1214/TensorRT-For-YOLO-Series A Python and C++ toolkit for running YOLO-series object detection models (YOLOv3 through YOLOv12, YOLOX) with NVIDIA TensorRT, including ON… | 44 | 1161 | active |
| bodaay/HuggingFaceModelDownloader A Go-based CLI utility for downloading models and datasets from the HuggingFace Hub with parallel, resumable downloads. It includes an inte… | 87 | 1160 | active |
| gemelo-ai/vocos Vocos is a fast neural vocoder that synthesizes audio waveforms from acoustic features such as mel-spectrograms or EnCodec tokens. It uses … | 65 | 1157 | stable |
| Michaelliv/pi-generative-ui A pi extension that replicates Claude.ai's generative UI system, letting an LLM stream interactive HTML/SVG widgets (sliders, charts, anima… | 67 | 1155 | active |
| vm0-ai/vm0 VM0 (Zero) is an AI agent platform that acts as a 'trustworthy AI teammate', connecting to 1,400+ tools (Slack, Notion, Gmail, Linear, GitH… | 80 | 1154 | active |
| CopilotKit/OpenTag OpenTag is an open-source, self-hosted knowledge-work AI agent for Slack and Microsoft Teams, built as the starter application for the Chan… | 80 | 1154 | active |
| OpenGVLab/VisionLLM VisionLLM is a series of open-source multimodal large language models from OpenGVLab that unify vision-centric tasks under language instruc… | 33 | 1154 | active |
| Woolverine94/biniou biniou is a self-hosted web UI for 30+ generative AI models covering image, video, audio, and text generation, built with Gradio and Huggin… | 63 | 1150 | active |
| magicrew/doc7 doc7 is a Go CLI tool that converts PDFs, Office files, scans, screenshots, charts, formulas, and diagrams into AI-ready Markdown using any… | 77 | 1148 | active |
| ttttccxxui/DataInfra-RedactionEverything A local-first redaction workbench that detects and anonymizes sensitive information in documents, scanned PDFs, images, Word files, and pla… | 60 | 1147 | active |
| FlagOpen/RoboBrain2.5 RoboBrain 2.5 is an open-source embodied AI foundation model from BAAI that combines multimodal large language model capabilities with 3D s… | 50 | 1140 | active |
| geek-fun/dockit DocKit is an open-source, privacy-first desktop GUI client for managing Elasticsearch, OpenSearch, DynamoDB, MongoDB, and EasySearch from a… | 95 | 1138 | active |
| rhymes-ai/Allegro Allegro is an open-source text-to-video generation model that produces high-quality 720p videos up to 6 seconds at 15 FPS from text prompts… | 24 | 1136 | active |
| RinDig/Interpretable-Context-Methodology Interpretable Context Methodology (ICM) is a Python-based methodology that uses folder structure as agent architecture, replacing framework… | 57 | 1133 | active |
| Rath-Team/OpenRath OpenRath is a PyTorch-like Python framework for building dynamic multi-agent and multi-session workflows. It models runtime state as explic… | 78 | 1131 | active |
| codelibs/fess Fess is an open-source, self-hosted enterprise search server built on OpenSearch with a browser-based admin UI, built-in crawlers for web s… | 95 | 1128 | active |
| zsyggg/paper-craft-skills A collection of Claude Code / Codex agent skills that turn academic papers into method figures, visual slide decks, and in-depth HTML artic… | 53 | 1128 | active |
| PriesiaMioShirakana/DragonianVoice A C++ inference library for running ONNX-based TTS, SVC (singing voice conversion), and SVS (singing voice synthesis) models, supporting ar… | 40 | 1128 | active |
| jerry-ai-dev/MODULAR-RAG-MCP-SERVER A modular, pluggable RAG (Retrieval-Augmented Generation) framework exposed as an MCP (Model Context Protocol) server, so AI assistants lik… | 47 | 1127 | active |
| mrkrsl/web-search-mcp A locally hosted MCP (Model Context Protocol) server written in TypeScript that gives local LLMs web search capabilities without requiring … | 36 | 1127 | active |
| wandb/weave Weave is a Python/TypeScript toolkit by Weights & Biases for developing AI-powered applications, providing LLM tracing, agent observability… | 92 | 1124 | active |
| hijohnnylin/neuronpedia Neuronpedia is an open source AI interpretability platform for exploring, visualizing, and steering the internals of language models. It ho… | 92 | 1122 | active |
| localgpt-app/localgpt LocalGPT is a local-only AI assistant built in Rust that ships as a single binary with a CLI, desktop GUI, embedded web UI, HTTP API, and M… | 55 | 1121 | active |
| THUDM/SwissArmyTransformer SwissArmyTransformer (sat) is a PyTorch library for developing custom Transformer model variants where models like BERT, GPT, T5, GLM, and … | 23 | 1121 | active |
| zyx0814/FilePress FilePress is a PHP/MySQL file-driven website building system that reimagines cloud storage as a publishing platform, offering rich file vie… | 86 | 1120 | active |
| pullfrog/pullfrog Pullfrog is an open-source, model-agnostic GitHub bot that runs coding agents (Claude, Codex, etc.) inside your repo's GitHub Actions. It t… | 81 | 1118 | active |
| QQ3221197721/cloudai-fusion CloudAI Fusion is a Go-based cloud-native platform that unifies multi-cloud infrastructure management with AI-assisted GPU scheduling acros… | 59 | 1115 | active |
| easydoc-ai/easydoc EasyDoc is a multimodal document processing API that converts unstructured documents like PDFs into hierarchical, machine-readable JSON. It… | 35 | 1115 | active |
| ardha27/AI-Waifu-Vtuber An AI waifu Vtuber application that listens to your voice via Whisper speech recognition, generates in-character replies with OpenAI, and s… | 68 | 1114 | active |
| FujiwaraChoki/supoclip SupoClip is an open-source, AI-powered video clipping tool that turns long videos like podcasts and streams into vertical 9:16 short clips … | 62 | 1113 | active |
| amazon-science/RAGChecker RAGChecker is an automatic evaluation framework for diagnosing Retrieval-Augmented Generation (RAG) systems. It provides holistic and diagn… | 25 | 1112 | active |
| ENTERPILOT/GoModel GoModel is an open-source AI gateway and control plane written in Go that exposes a unified OpenAI-compatible and Anthropic-compatible API … | 80 | 1109 | active |
| ATH-MaaS/Pixelle-MCP Pixelle MCP is an open-source omnimodal AIGC framework that converts ComfyUI workflows (local or RunningHub cloud) into MCP tools with zero… | 44 | 1109 | active |
| OpenMOSS/MOVA MOVA is an open-source foundation model and toolkit for joint video-audio generation, synthesizing synchronized video and audio in a single… | 60 | 1108 | active |
| Onelevenvy/flock Flock is a cross-platform desktop multi-agent harness built with Rust, Tauri, and React, powered by the langgraph-rust engine. It provides … | 82 | 1103 | active |
| EmbeddedLLM/JamAIBase JamAI Base is an open-source backend-as-a-service platform for AI that combines an embedded SQLite database and LanceDB vector database wit… | 66 | 1103 | active |
| stephenschoettler/hermes-lcm A lossless context management plugin for Hermes Agent that replaces one-shot prompt compression with a SQLite-backed, DAG-based context eng… | 80 | 1102 | active |
| zai-org/CogView4 CogView4, CogView3-Plus and CogView3 are open-source text-to-image generation models from Zhipu AI, with CogView4 being a 6B-parameter DiT-… | 28 | 1102 | active |
| XiaoLuoLYG/GOD GOD (Govern, Observe, Direct) is a real-time control room for inspecting and steering societies of LLM-powered agents, letting operators pa… | 74 | 1097 | active |
| HalFrgrd/flyline Flyline is a Bash plugin written in Rust that replaces readline to provide a modern command-line editing experience. It adds syntax highlig… | 84 | 1095 | active |
| Eyeline-Labs/Go-with-the-Flow Official implementation of the CVPR 2025 Oral paper 'Go-with-the-Flow', which controls motion in video diffusion models by replacing i.i.d.… | 41 | 1094 | active |
| localai-org/depth-anything.cpp A from-scratch C++17/ggml port of ByteDance's Depth Anything 2 and 3 models for dependency-free monocular metric depth and camera pose infe… | 58 | 1090 | active |
| wenge-research/x-agent X-Agent (智川) is an open-source, self-hosted enterprise agent development platform by Wenge that lets users build AI applications with zero … | 34 | 1088 | active |
| heymrun/heym Heym is an AI-native, low-code workflow automation platform with a visual drag-and-drop editor for building agentic systems. It provides LL… | 78 | 1087 | active |
| dtsola/xiaoyaosearch XiaoyaoSearch is a cross-platform desktop application (Electron + Python/FastAPI) that lets users find local files using AI-powered semanti… | 70 | 1085 | active |
| Alpha-VLLM/Lumina-mGPT-2.0 Lumina-mGPT 2.0 is a stand-alone decoder-only autoregressive model trained from scratch that unifies a broad range of image generation task… | 42 | 1085 | active |
| StreetLamb/tribe Tribe AI is a low-code web application for rapidly building and coordinating multi-agent teams using drag-and-drop, built on LangChain and … | 49 | 1084 | active |
| Geekgineer/YOLOs-CPP YOLOs-CPP is a production-ready, cross-platform C++ inference library for the YOLO model family (v5 through YOLO26), built on ONNX Runtime … | 88 | 1081 | active |
| XiaomiMiMo/MiMo-Audio Xiaomi's open-source 7B audio language model family (Base and Instruct) plus a 1.2B RVQ audio tokenizer, pretrained on 100M+ hours of audio… | 57 | 1077 | active |
| IAHispano/Applio Applio is an open-source, MIT-licensed voice conversion suite built on RVC that lets users convert audio into other voices, train custom vo… | 90 | 3677 | maintenance |