function: llm-inference
3362 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| wzpan/wukong-robot wukong-robot is a modular Chinese-language voice assistant / smart speaker project in Python that combines offline wake-word detection, ASR… | 32 | 7126 | active |
| enricoros/big-AGI Big-AGI is an open-source AI workspace web application that lets users chat with many state-of-the-art LLM providers (OpenAI, Anthropic, Ge… | 93 | 7102 | active |
| rocketride-org/rocketride-server RocketRide is an open-source AI pipeline engine with a high-throughput C++ runtime and 100+ Python-extensible nodes for building, debugging… | 80 | 7090 | active |
| vespa-engine/vespa Vespa is an open-source, distributed AI search platform and serving engine that combines full-text search, vector/tensor search, and machin… | 95 | 7069 | stable |
| SakanaAI/AI-Scientist-v2 An end-to-end autonomous AI research system that generates hypotheses, runs machine learning experiments, analyzes data, and writes complet… | 46 | 7050 | active |
| katanemo/plano Plano is an AI-native proxy server and data plane for agentic applications, built on Envoy by its core contributors. It centralizes agent r… | 85 | 7017 | active |
| ddean2009/MoneyPrinterPlus A Python desktop application that uses AI LLMs to batch-generate short videos with one click, including automatic video mashup/remixing and… | 30 | 7008 | active |
| cloudflare/agentic-inbox A self-hosted email client with an integrated AI agent that runs entirely on Cloudflare Workers. Incoming mail is handled via Cloudflare Em… | 49 | 6998 | active |
| deeppavlov/DeepPavlov DeepPavlov is an open-source Python NLP library built on PyTorch and Hugging Face transformers for developing, training, and deploying stat… | 39 | 6989 | active |
| openai/openai-realtime-agents A Next.js TypeScript demo application showcasing advanced agentic patterns (Chat-Supervisor and Sequential Handoff) built on the OpenAI Rea… | 48 | 6966 | active |
| InternLM/MindSearch MindSearch is an open-source, LLM-based multi-agent framework that mimics human cognition to perform deep web searches, similar to Perplexi… | 27 | 6918 | active |
| lintsinghua/DeepAudit DeepAudit is an open-source multi-agent AI system for automated code vulnerability discovery and security auditing, with a React frontend a… | 72 | 6905 | active |
| yihong0618/xiaogpt A Python application that connects Xiaomi AI Speakers to ChatGPT and other LLMs, letting users ask questions starting with a trigger phrase… | 64 | 6901 | active |
| gaozhangmin/boxplayer BoxPlayer is a cross-platform desktop application that unifies multiple cloud drives (Aliyun Drive, Baidu, 115, Quark, OneDrive, etc.), loc… | 97 | 6878 | active |
| TencentQQGYLab/AppAgent AppAgent is an LLM-based multimodal agent framework that operates smartphone apps through human-like interactions such as tapping and swipi… | 32 | 6860 | active |
| zhinianboke/xianyu-auto-reply A self-hosted multi-account automation system for the Xianyu (Goofish) second-hand marketplace, built with Python/FastAPI, React, MySQL, Re… | 62 | 6787 | active |
| Dooy/chatgpt-web-midjourney-proxy A unified web/desktop UI for ChatGPT plus AI image, music, and video generation services like Midjourney, Suno, Luma, Runway, and Flux. It … | 76 | 6785 | active |
| langchain-ai/opengpts OpenGPTs is an open-source platform for building and hosting custom AI assistants similar to OpenAI's GPTs and Assistants API. It is built … | 10 | 6731 | active |
| firebase/firebase-ios-sdk The official Firebase SDK for Apple platforms (iOS, macOS, tvOS, watchOS, visionOS), providing open-source client libraries for Firebase pr… | 99 | 6660 | stable |
| Chanzhaoyu/chatgpt-web A self-hosted ChatGPT demo web application built with Express (Node.js backend) and Vue 3 frontend. It supports two access methods: the off… | 10 | 31491 | maintenance |
| ultraworkers/claw-code-parity A temporary Rust workspace tracking parity work for the claw-code coding agent while the original repo undergoes migration to Rust. It prov… | 10 | 6650 | active |
| Yuliang-Liu/MonkeyOCR MonkeyOCR is a lightweight large multimodal model (LMM) for document parsing that uses a Structure-Recognition-Relation triplet paradigm to… | 60 | 6635 | active |
| 11cafe/jaaz Jaaz is an open-source multimodal creative assistant application that serves as a privacy-focused, locally usable alternative to Canva and … | 53 | 6589 | active |
| steipete/summarize Summarize is a Node.js CLI and Chrome/Firefox extension that extracts clean text from web pages, PDFs, YouTube videos, podcasts, and audio/… | 82 | 6577 | active |
| apurvsinghgautam/robin Robin is an AI-powered dark web OSINT investigation tool that uses LLMs to refine queries, filter results from dark web search engines, and… | 84 | 6438 | active |
| CodePilot CodePilot is a multi-model AI agent desktop client built with Electron and Next.js that connects to 17+ AI providers through a single inter… | 78 | 6421 | active |
| vllm-project/vllm-omni vLLM-Omni is a Python framework extending vLLM for efficient inference and serving of omni-modality models, including diffusion transformer… | 83 | 6369 | active |
| argmaxinc/argmax-oss-swift A Swift SDK providing turn-key on-device speech AI frameworks for Apple Silicon, including WhisperKit (speech-to-text with Whisper), Speake… | 91 | 6338 | active |
| htdt/godogen A generator that publishes thin game repos where AI coding agents (Claude Code or Codex) autonomously build complete games for Godot 4, Bev… | 57 | 6334 | active |
| ThinkInAIXYZ/deepchat DeepChat is an open-source, local-first AI agent desktop client built with Electron that connects to multiple LLM providers like OpenAI, Cl… | 86 | 6288 | active |
| nickscamara/open-deep-research An open-source clone of OpenAI's Deep Research, built as a Next.js web application. It uses Firecrawl's search and extract APIs to gather l… | 20 | 6282 | active |
| PaddlePaddle/PaddleX PaddleX is a low-code, all-in-one AI development tool built on the PaddlePaddle framework, bundling 200+ pretrained models into 33 producti… | 92 | 6251 | active |
| oomol-lab/pdf-craft pdf-craft is a Python library that converts PDF files into Markdown or EPUB, with a focus on scanned books and documents. It uses OCR (loca… | 87 | 6226 | active |
| JimmyLv/BibiGPT-v1 BibiGPT is an AI-powered web application that summarizes videos and audio from platforms like Bilibili, YouTube, TikTok, and podcasts, gene… | 57 | 6194 | active |
| zenstory-ai/oh-story-claudecode A skill pack for Claude Code and compatible AI coding agents that provides an end-to-end workflow for writing Chinese web fiction, covering… | 80 | 6112 | active |
| Helicone/helicone Helicone is an open-source LLM observability platform and AI gateway that logs, monitors, and analyzes LLM API requests with a one-line int… | 79 | 6104 | active |
| anthropics/claude-code-security-review A GitHub Action that uses Anthropic's Claude to perform AI-powered security reviews of pull requests, analyzing code diffs for vulnerabilit… | 48 | 6093 | active |
| Tencent/AI-Infra-Guard Tencent's full-stack AI red teaming platform that scans AI infrastructure, agents, MCP servers, and skills for vulnerabilities and evaluate… | 88 | 5984 | active |
| netease-youdao/LobsterAI LobsterAI is an open-source, desktop-grade AI agent application by NetEase Youdao that performs real work like data analysis, slides, docum… | 78 | 5953 | active |
| ChaoningZhang/MobileSAM MobileSAM is the official implementation of a lightweight version of Meta's Segment Anything Model (SAM), replacing the heavyweight image e… | 65 | 5858 | stable |
| ModelEngine-Group/nexent Nexent is a zero-code, self-hosted platform for auto-generating production-grade AI agents from natural language prompts, built on Harness … | 85 | 5839 | active |
| joeseesun/qiaomu-anything-to-notebooklm A Claude Code Skill that ingests content from 15+ sources (WeChat articles, web pages, YouTube, PDFs, EPUB, Office docs, audio) and uploads… | 62 | 5824 | active |
| aidlearning/AidLearning-FrameWork AidLux (originally AidLearning) is an AIoT development platform that runs a native Ubuntu Linux environment with GUI, deep learning tooling… | 70 | 5797 | active |
| vercel-labs/open-agents Open Agents is an open-source reference application and template for building cloud-hosted background coding agents on Vercel. It combines … | 60 | 5790 | active |
| PySpur-Dev/pyspur PySpur is an open-source visual playground and builder for AI agent workflows, letting engineers build agents via drag-and-drop UI or Pytho… | 64 | 5778 | active |
| OpenWhispr/openwhispr OpenWhispr is an open-source, privacy-first voice-to-text dictation desktop app for macOS, Windows, and Linux. It supports fully local tran… | 81 | 5766 | active |
| Eventual-Inc/Daft Daft is a high-performance distributed data engine with a Python dataframe API, implemented in Rust, designed for AI and multimodal workloa… | 95 | 5730 | active |
| coze-dev/coze-loop Coze Loop is an open-source, self-hostable platform for full-lifecycle AI agent development, offering prompt engineering with a visual play… | 74 | 5705 | active |
| areal-project/AReaL AReaL is a large-scale asynchronous reinforcement learning system that bridges foundation model training with agent-based applications, sup… | 87 | 5696 | active |
| elder-plinius/T3MP3ST T3MP3ST is a multi-agent offensive-security framework that turns existing AI coding agents (Claude Code, Codex, Ollama, etc.) into autonomo… | 58 | 5684 | active |
| ZSeven-W/openpencil OpenPencil is an open-source, AI-native vector design application where users generate and edit UI designs on an infinite canvas via natura… | 68 | 5673 | active |
| OpenBMB/UltraRAG UltraRAG is a low-code Python framework from OpenBMB for building complex RAG pipelines using MCP servers and YAML-based orchestration with… | 80 | 5672 | active |
| antiwork/shortest Shortest is an AI-powered end-to-end testing framework that lets developers write browser tests in plain English, executed via Anthropic's … | 67 | 5667 | active |
| ageerle/ruoyi-ai RuoYi AI is an open-source, enterprise-grade full-stack AI assistant platform built in Java on the RuoYi ecosystem and LangChain4j. It unif… | 91 | 5666 | active |
| basketikun/infinite-canvas An open-source infinite canvas workbench for AI-driven visual creation, combining canvas orchestration, AI image generation, reference-imag… | 80 | 5629 | active |
| the-open-agent/openagent OpenAgent is a self-hosted, single-binary personal AI assistant platform built in Go that combines LLM chat, RAG knowledge bases, and auton… | 94 | 5571 | active |
| zenml-io/zenml ZenML is an open-source MLOps framework for building, deploying, and managing production ML pipelines, LLM workflows, and AI agents on any … | 98 | 5564 | active |
| gpustack/gpustack GPUStack is an open-source GPU cluster manager for AI model serving that orchestrates inference engines like vLLM, SGLang, and TensorRT-LLM… | 90 | 5560 | active |
| TableProApp/TablePro TablePro is a free, open-source, native macOS (and iOS/iPadOS) database client supporting 29 SQL and NoSQL engines through native drivers, … | 79 | 5559 | active |
| iflytek/astron-rpa AstronRPA is an open-source enterprise-grade Robotic Process Automation desktop application with a visual low-code/no-code designer for aut… | 70 | 5540 | active |
| HKUDS/ClawTeam ClawTeam is a framework-agnostic Python CLI that orchestrates swarms of AI coding agents (Claude Code, Codex, Cursor, and any CLI agent) to… | 65 | 5518 | active |
| modstart-lib/aigcpanel AIGCPanel is an open-source, all-in-one AI digital human desktop application built with TypeScript, Vue3, and Electron for Windows, macOS, … | 88 | 5482 | active |
| lemonade-sdk/lemonade Lemonade is a local AI server that runs optimized LLMs (plus image, speech, and embedding models) on your own GPU and NPU, exposing OpenAI-… | 82 | 5472 | active |
| BIT-DataLab/Edit-Banana Edit Banana is an open-source Python framework that converts static images and PDFs of diagrams, flowcharts, and charts into fully editable… | 60 | 5469 | active |
| mayocream/koharu Koharu is a local-first desktop application that automates manga translation using machine learning, combining text/bubble detection, OCR, … | 82 | 5410 | active |
| remsky/Kokoro-FastAPI A Dockerized FastAPI wrapper around the Kokoro-82M text-to-speech model exposing an OpenAI-compatible speech endpoint with CPU, NVIDIA, AMD… | 88 | 5373 | active |
| nanbingxyz/5ire 5ire is a cross-platform desktop AI assistant and MCP (Model Context Protocol) client that connects to major LLM providers like OpenAI, Ant… | 81 | 5346 | active |
| superduper-io/superduper Superduper is an open-source Python framework for building database-integrated AI applications and agents, connecting models, embeddings, a… | 49 | 5316 | active |
| FunnyWolf/Viper VIPER is a self-hosted red teaming and adversary simulation platform with a web UI, 100+ post-exploitation modules covering MITRE ATT&CK, a… | 85 | 5279 | active |
| tagspaces/tagspaces TagSpaces is an open-source, offline-first desktop and mobile application for organizing, tagging, and previewing local files, notes, and t… | 95 | 5256 | active |
| beclab/Olares Olares is an open-source personal cloud operating system built on Kubernetes that turns your own hardware into a self-hosted AI platform fo… | 89 | 5242 | active |
| wenet-e2e/wenet WeNet is a production-first, end-to-end automatic speech recognition (ASR) toolkit built on PyTorch with transformer/conformer models. It p… | 62 | 5227 | active |
| shareAI-lab/Kode-CLI Kode CLI is a terminal-based AI coding agent that understands codebases, edits files, runs commands, and automates developer workflows. It … | 63 | 5212 | active |
| katanaml/sparrow Sparrow is an open-source framework for structured data extraction from documents (PDFs, images) using ML, LLMs, and Vision LLMs, with sche… | 95 | 5202 | active |
| SuanmoSuanyangTechnology/MemoryBear MemoryBear is an AI memory management system that gives LLM agents and chatbots human-like long-term memory across a full lifecycle of perc… | 84 | 5088 | active |
| dmMaze/BallonsTranslator A desktop GUI application that uses deep learning to automatically translate comics and manga, combining text detection, OCR, inpainting, a… | 99 | 5065 | active |
| Marker-Inc-Korea/AutoRAG AutoRAG 2.0 is a self-evolving librarian agent that searches local document collections (PDFs, wikis, notes) and curates results into struc… | 93 | 5055 | active |
| dtyq/magic MagiCrew (dtyq/magic) is an open-source, enterprise-grade all-in-one AI productivity platform combining a generalist AI agent, workflow eng… | 63 | 4994 | active |
| FellouAI/eko Eko is a production-ready JavaScript framework for building reliable AI agents and agentic workflows from natural language, running in both… | 63 | 4951 | active |
| campfirein/byterover-cli ByteRover CLI (brv) is a TypeScript-based interactive REPL/TUI tool that gives AI coding agents a persistent, structured memory layer via a… | 76 | 4948 | active |
| babaohuang/GeminiProChat A minimal web chat interface for Google's Gemini Pro API, built with TypeScript and Astro. It can be self-hosted via Vercel, Railway, Zeabu… | 61 | 4882 | active |
| ethanniser/NextFaster NextFaster is a highly performant e-commerce template built with Next.js 15, featuring partial prerendering, Server Actions, Drizzle ORM on… | 66 | 4878 | active |
| vitali87/code-graph-rag Code-Graph-RAG is a Python CLI tool and MCP server that parses multi-language codebases with Tree-sitter, builds a knowledge graph of code … | 85 | 4828 | active |
| eastlondoner/vibe-tools vibe-tools is a TypeScript CLI that gives AI coding agents like Cursor an 'AI team' of subagents and advanced skills such as browser automa… | 38 | 4824 | active |
| ace-step/ACE-Step ACE-Step is an open-source foundation model for music generation that combines diffusion-based generation with a deep compression autoencod… | 49 | 4788 | active |
| SeldonIO/seldon-core Seldon Core 2 is an MLOps and LLMOps framework for deploying, managing, and scaling machine learning models and modular AI applications on … | 72 | 4778 | active |
| Rasa Open Source Rasa Open Source is a Python framework for building text- and voice-based conversational AI assistants, combining NLU (intent/entity recogn… | 65 | 21306 | maintenance |
| openai/chatgpt-retrieval-plugin A FastAPI-based retrieval backend that provides semantic search over personal or organizational documents using natural language queries, w… | 30 | 21213 | maintenance |
| MoonshotAI/Kimi-Audio Kimi-Audio is an open-source audio foundation model (7B parameters) that unifies audio understanding, generation, and speech conversation i… | 31 | 4731 | active |
| Osmantic/ODS ODS (Osmantic Deployment System) is a self-hosted AI server installer and runtime that turns a PC, Mac, or Linux machine into a private AI … | 80 | 4716 | active |
| mindspore-ai/mindspore MindSpore is an open-source deep learning framework for training and inference across mobile, edge, and cloud scenarios. It provides automa… | 32 | 4700 | active |
| gradio-app/fastrtc FastRTC is a Python library that turns any Python function into a real-time audio and video stream over WebRTC or WebSockets. It includes b… | 58 | 4622 | active |
| x-cmd/x-cmd X-CMD is a POSIX shell (bash/zsh/ash/dash) toolkit offering 300+ shell/awk modules and a 600+ curated CLI package system, installable witho… | 95 | 4589 | active |
| agentgateway/agentgateway Agentgateway is an open-source, Rust-based proxy and gateway for agentic AI traffic, handling LLM provider routing, MCP tool servers, and A… | 81 | 4563 | active |
| joanrod/star-vector StarVector is a foundation model that generates scalable vector graphics (SVG) code from images and text by treating vectorization as a cod… | 49 | 4560 | active |
| truefoundry/trueforge TrueForge is an open-source agent harness that provides the runtime layer turning an LLM into a working agent, with MCP tools, skills, sand… | 79 | 4552 | active |
| Tencent-Hunyuan/HunyuanVideo-1.5 HunyuanVideo-1.5 is Tencent's lightweight 8.3B-parameter video generation model supporting text-to-video and image-to-video synthesis. The … | 50 | 4534 | active |
| TencentARC/InstantMesh InstantMesh is a feed-forward framework for generating 3D meshes from a single image using sparse-view large reconstruction models (LRM/Ins… | 25 | 4509 | active |
| FlowElement-xinliuyuansu/m_flow M-flow is a Python bio-inspired cognitive memory engine that treats graph topology as the retrieval scoring engine rather than a supportive… | 61 | 4500 | active |
| Awarexone/Agentic-Bug-Hunter An AI-powered bug bounty hunting toolkit that automates reconnaissance, vulnerability testing, finding validation, and report generation fo… | 77 | 4464 | active |