function: llm-inference
3362 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| chatchat-space/Langchain-Chatchat Langchain-Chatchat is an open-source, offline-deployable RAG and Agent application built on Langchain and LLMs such as ChatGLM, Qwen, and L… | 44 | 38581 | active |
| lfnovo/open-notebook Open Notebook is an open-source, privacy-focused alternative to Google's Notebook LM that lets users organize multi-modal sources (PDFs, vi… | 86 | 37711 | active |
| google-ai-edge/mediapipe MediaPipe is Google's cross-platform framework for deploying on-device machine learning solutions for live and streaming media. It provides… | 94 | 36731 | stable |
| khoj-ai/khoj Khoj is a self-hostable personal AI assistant ('second brain') that answers questions from your own documents and the web using local or on… | 85 | 36730 | active |
| 1Panel-dev/1Panel 1Panel is an open-source web-based Linux server management panel and lightweight AI management platform, offering a graphical interface for… | 98 | 36638 | active |
| Crosstalk-Solutions/project-nomad Project NOMAD is a self-hosted, offline-first knowledge and education server that packages Wikipedia, books, courses, offline maps, and opt… | 84 | 36327 | active |
| spaCy spaCy is an industrial-strength natural language processing library for Python and Cython, featuring pretrained pipelines for 70+ languages… | 99 | 33849 | stable |
| langfuse/langfuse Langfuse is an open-source AI engineering platform for LLM observability, tracing, evaluation, prompt management, and metrics, deployable a… | 92 | 33767 | active |
| dgtlmoon/changedetection.io A self-hosted web application for monitoring websites and detecting content changes, with alerts via Discord, Slack, Telegram, email, webho… | 93 | 33356 | active |
| zeroclaw-labs/zeroclaw ZeroClaw is a fast, lightweight personal AI assistant agent runtime written as a single Rust binary that you self-host. It connects to many… | 81 | 32660 | active |
| fishaudio/fish-speech Fish Speech is an open-source state-of-the-art text-to-speech system (Fish Audio S2) trained on over 10 million hours of audio across ~50 l… | 74 | 32413 | active |
| onyx-dot-app/onyx Onyx is an open-source, self-hostable AI chat platform that connects LLMs to company documents, apps, and people via RAG, 50+ data connecto… | 92 | 31777 | active |
| nanocoai/nanoclaw NanoClaw is a lightweight, self-hosted personal AI assistant that runs each agent inside its own isolated Docker container for OS-level sec… | 82 | 30626 | active |
| vercel-labs/agent-skills Vercel's official collection of packaged skills (instructions and scripts) for AI coding agents like Claude Code, Cursor, and Windsurf, fol… | 71 | 30507 | active |
| getzep/graphiti Graphiti is an open-source Python framework for building and querying temporal knowledge graphs (Context Graphs) for AI agents. It incremen… | 84 | 30324 | active |
| topoteretes/cognee Cognee is an open-source Python library and platform that gives AI agents persistent long-term memory by ingesting data in any format and b… | 91 | 30281 | active |
| feder-cr/Jobs_Applier_AI_Agent_AIHawk AIHawk is an open-source Python AI agent that automates job applications by scraping job postings via browser automation and auto-applying … | 58 | 30260 | active |
| BigPizzaV3/CodexPlusPlus Codex++ is an open-source external launcher and management tool for the OpenAI Codex / ChatGPT desktop apps, built with Rust and Tauri. It … | 77 | 29693 | active |
| labring/FastGPT FastGPT is an open-source AI agent building platform built on large language models, offering out-of-the-box knowledge base (RAG) managemen… | 93 | 29477 | active |
| simstudioai/sim Sim is an open-source collaborative AI workspace for building, deploying, and monitoring AI agents and workflows via a visual builder, chat… | 84 | 29475 | active |
| 78/xiaozhi-esp32 XiaoZhi is an open-source MCP-based AI voice chatbot firmware for ESP32-family microcontrollers, connecting large language models like Qwen… | 88 | 29186 | active |
| assafelovic/gpt-researcher GPT Researcher is an open-source autonomous deep research agent that plans research questions, scrapes web and local sources, and produces … | 96 | 29160 | active |
| garrytan/gbrain GBrain is a self-hosted 'brain layer' for AI agents that combines a knowledge graph, vector search, and a synthesis engine to return cited … | 77 | 29146 | active |
| mastra-ai/mastra Mastra is a TypeScript framework for building AI-powered applications and autonomous agents, with model routing across 40+ providers, graph… | 86 | 27495 | active |
| QwenLM/qwen-code Qwen Code is an open-source AI coding agent that runs in the terminal, providing agentic code editing, review, and automation powered by Qw… | 81 | 27405 | active |
| ATH-MaaS/Pixelle-Video Pixelle-Video is an AI-powered fully automated short video engine that turns a single topic into a finished video. It automatically writes … | 67 | 27344 | active |
| onlook-dev/onlook Onlook is an open-source, AI-first visual code editor that lets designers visually build, style, and edit React (Next.js + TailwindCSS) app… | 66 | 26563 | active |
| vercel/ai The AI SDK is a TypeScript toolkit from Vercel for building AI-powered applications and agents, providing a unified API for text generation… | 92 | 26432 | active |
| deepset-ai/haystack Haystack is an open-source Python AI orchestration framework by deepset for building production-ready LLM applications, agents, and RAG sys… | 99 | 26325 | stable |
| resemble-ai/chatterbox Chatterbox is a family of state-of-the-art open-source text-to-speech models by Resemble AI, including multilingual and low-latency Turbo v… | 52 | 26163 | active |
| xai-org/grok-build Grok Build is SpaceXAI's terminal-based AI coding agent, written in Rust, that runs as a full-screen interactive TUI. It understands codeba… | 57 | 26100 | active |
| zai-org/Open-AutoGLM Open-AutoGLM is an open phone agent model and framework built on AutoGLM that understands phone screens multimodally and automates Android … | 48 | 26091 | active |
| Cinnamon/kotaemon Kotaemon is an open-source RAG-based application providing a clean, customizable UI for chatting and doing question answering with your own… | 84 | 25716 | active |
| yikart/AiToEarn AiToEarn is an open-source AI content marketing agent platform that helps solo creators and businesses generate, publish, and monetize cont… | 83 | 25313 | active |
| nextai-translator/nextai-translator A browser extension and cross-platform desktop application that provides translation of selected text using the ChatGPT/OpenAI API. It also… | 97 | 24975 | active |
| TencentCloud/TencentDB-Agent-Memory TencentDB Agent Memory is a self-hosted team-level memory hub for AI agents that converts conversations, docs, and code into four reusable … | 81 | 24677 | active |
| promptfoo/promptfoo Promptfoo is an open-source CLI and library for evaluating and red-teaming LLM applications, prompts, agents, and RAG pipelines. It support… | 92 | 24603 | active |
| PaddlePaddle/Paddle PaddlePaddle is an industrial-grade deep learning framework written in C++ with Python APIs, supporting high-performance single-machine and… | 84 | 24062 | active |
| facebookresearch/audiocraft A PyTorch library from Meta for audio processing and generation with deep learning, featuring the EnCodec neural audio codec and generative… | 61 | 23586 | active |
| index-tts/index-tts IndexTTS is an industrial-level zero-shot text-to-speech system that clones a voice from a single reference audio clip. The latest IndexTTS… | 78 | 23511 | active |
| micro/go-micro Go Micro is a Go framework and CLI that combines an AI agent harness with a microservices framework, giving agents tools, memory, guardrail… | 95 | 23043 | active |
| QwenAudio/CosyVoice CosyVoice is a multilingual large voice generation model (TTS) with full-stack inference, training, and deployment support. It offers zero-… | 61 | 22925 | active |
| Skyvern-AI/skyvern Skyvern is an open-source AI browser automation framework that uses LLMs and computer vision to interact with websites, offering a Playwrig… | 88 | 22852 | active |
| 1Panel-dev/MaxKB MaxKB is an open-source, self-hosted platform for building enterprise-grade AI agents with RAG pipelines, workflow orchestration, and MCP t… | 94 | 22612 | active |
| claude-code-best/claude-code An open-source, buildable and debuggable reimplementation of Anthropic's Claude Code terminal-native agentic coding system, written in Type… | 79 | 22224 | active |
| wavetermdev/waveterm Wave Terminal is an open-source, cross-platform terminal emulator with integrated AI assistance, durable SSH sessions, file previews, a bui… | 92 | 22112 | active |
| vxcontrol/pentagi PentAGI is a self-hosted, fully autonomous multi-agent AI system for performing complex penetration testing tasks, built in Go with a React… | 78 | 22033 | active |
| jina-ai/serve Jina-serve is a Python framework for building and deploying multimodal AI services that communicate via gRPC, HTTP, and WebSockets. It prov… | 40 | 21861 | active |
| eclipse-theia/theia Eclipse Theia is an open-source framework written in TypeScript for building custom cloud (browser-based) and desktop IDEs and tools, with … | 98 | 21655 | active |
| comet-ml/opik Opik is an open-source LLM observability and evaluation platform by Comet for tracing, evaluating, and monitoring LLM applications, RAG pip… | 92 | 21624 | active |
| coze-dev/coze-studio Coze Studio is an open-source, all-in-one AI agent development platform with visual, no-code/low-code tools for building, debugging, and de… | 73 | 21506 | active |
| Agent Development Kit (ADK) Agent Development Kit (ADK) is Google's open-source, code-first framework for building, evaluating, and deploying AI agents, available in P… | 82 | 21299 | active |
| vectorize-io/hindsight Hindsight is an open-source agent memory system that gives AI agents persistent long-term memory that learns and consolidates knowledge ove… | 79 | 21228 | active |
| chidiwilliams/buzz Buzz is a cross-platform desktop application that transcribes and translates audio and video offline using OpenAI's Whisper models. It offe… | 95 | 21147 | active |
| THU-MAIC/OpenMAIC OpenMAIC is an open-source multi-agent interactive classroom that delivers immersive AI-driven learning experiences with one click. Built w… | 81 | 20934 | active |
| vercel/chatbot A full-featured, hackable Next.js AI chatbot template built by Vercel on top of the AI SDK, with chat history persistence, authentication, … | 70 | 20876 | active |
| anywhere-labs/dsh-desktop DSH Desktop is a community-maintained open-source desktop client for Windows and macOS that wraps the DeepSeek Harness local Web UI, host s… | 79 | 20723 | active |
| Tencent/WeKnora WeKnora is an open-source, LLM-powered knowledge platform by Tencent that turns raw documents into a queryable RAG system, an autonomous Re… | 84 | 20700 | active |
| livekit/livekit LiveKit is an open-source, scalable WebRTC SFU media server written in Go that provides realtime video, audio, and data transport for appli… | 99 | 20530 | stable |
| mksglu/context-mode An open-source MCP plugin that optimizes AI coding agent context windows by intercepting large tool outputs, storing them in a local FTS5 i… | 74 | 20167 | active |
| camel-ai/owl OWL is a multi-agent collaboration framework built on the CAMEL-AI framework for automating real-world tasks through dynamic agent interact… | 64 | 20104 | active |
| modelscope/FunASR FunASR is an industrial end-to-end speech recognition toolkit built on PyTorch, offering ASR, VAD, punctuation restoration, speaker diariza… | 99 | 20036 | active |
| dzhng/deep-research An AI-powered deep research agent that iteratively generates search queries, scrapes web content, and refines its research direction using … | 55 | 19603 | active |
| pydantic/pydantic-ai Pydantic AI is a type-safe Python SDK for building AI agents and LLM applications, with a typed agent loop, structured outputs, tool callin… | 86 | 19518 | active |
| elizaOS/eliza elizaOS is an open-source TypeScript framework and product stack for building and running autonomous AI agents, including a core runtime, C… | 90 | 19176 | active |
| state-spaces/mamba Mamba is a PyTorch library implementing the selective state space model (SSM) architecture for linear-time sequence modeling, with hardware… | 85 | 18783 | active |
| google/skills A collection of Agent Skills for Google products and technologies, primarily Google Cloud, installable via skills.sh or npx. It provides re… | 59 | 18720 | active |
| Huanshere/VideoLingo VideoLingo is an all-in-one AI video translation, localization, and dubbing tool that produces Netflix-quality single-line subtitles with w… | 80 | 18266 | active |
| arc53/DocsGPT DocsGPT is an open-source AI platform for building private agents, assistants, and enterprise search over your own documents. It includes a… | 93 | 18229 | active |
| RightNow-AI/openfang OpenFang is an open-source Agent Operating System written in Rust that runs autonomous AI agents on schedules, 24/7, with pre-built capabil… | 68 | 18135 | active |
| microsoft/agent-lightning Agent Lightning is a lightweight (~3,500-line) agentic reinforcement learning framework from Microsoft for training LLM-powered agents with… | 85 | 17863 | active |
| langbot-app/LangBot LangBot is an open-source, production-grade platform for building AI-powered instant messaging bots, connecting LLMs and agent workflows to… | 94 | 17558 | active |
| rowboatlabs/rowboat Rowboat is an open-source desktop AI coworker that indexes your email, meetings, Slack, and conversations into a living backlinked knowledg… | 87 | 17417 | active |
| Wan Wan is an open-source family of large-scale video generation models (Wan2.1/Wan2.2) with Python inference code and pretrained weights for t… | 50 | 17291 | active |
| lllyasviel/FramePack FramePack is a next-frame-prediction video diffusion framework and desktop application that generates long videos progressively while compr… | 31 | 17229 | active |
| browser-use/browser-harness Browser Harness is a self-healing Python harness that connects LLM agents directly to a real browser via a single editable CDP websocket. A… | 81 | 17160 | active |
| QwenLM/Qwen-Agent Qwen-Agent is a Python framework for building LLM agent applications on top of Qwen models, providing function calling, MCP support, code i… | 61 | 17018 | active |
| nashsu/llm_wiki LLM Wiki is a cross-platform desktop application that automatically turns your documents into an organized, interlinked knowledge base. Unl… | 81 | 16834 | active |
| weaviate/weaviate Weaviate is an open-source, cloud-native vector database written in Go that stores both objects and vector embeddings, combining vector sim… | 95 | 16754 | stable |
| memvid/memvid Memvid is a single-file memory layer for AI agents that packages data, embeddings, and search indexes into one portable .mv2 file. It repla… | 78 | 16449 | active |
| MemoriLabs/Memori Memori is agent-native memory infrastructure that turns LLM agent execution and conversation into structured, persistent state. It ships as… | 80 | 16241 | active |
| triggerdotdev/trigger.dev Trigger.dev is an open-source TypeScript platform for building and deploying durable background jobs, long-running AI workflows, and AI age… | 94 | 16135 | active |
| tracel-ai/burn Burn is a Rust-based tensor library and deep learning framework supporting training and inference through a unified API. It JIT-compiles te… | 89 | 15816 | active |
| langchain-ai/openwiki OpenWiki is a TypeScript CLI that uses a Deep Agents documentation agent to generate and continuously maintain a linked Markdown wiki for a… | 80 | 15711 | active |
| vibrantlabsai/ragas Ragas is a Python library for evaluating LLM applications with objective, LLM-driven metrics and systematic experiment loops. It also gener… | 71 | 15485 | active |
| KittenML/KittenTTS KittenTTS is an open-source, ultra-lightweight text-to-speech library built on ONNX, with models ranging from 15M to 80M parameters (25-80 … | 66 | 15403 | active |
| coderamp-labs/gitingest Gitingest turns any Git repository into a prompt-friendly text digest of its codebase, suitable for feeding into LLMs. It is available as a… | 68 | 15350 | active |
| GaiZhenbiao/ChuanhuChatGPT Chuanhu Chat is a Python/Gradio-based web GUI for chatting with ChatGPT and many other LLMs (GPT-5/4, Claude, Gemini, ChatGLM, Llama, Ollam… | 60 | 15278 | active |
| midday-ai/midday Midday is an open-source, all-in-one business management application for freelancers, contractors, and solo entrepreneurs, offering invoici… | 79 | 14923 | active |
| botpress/botpress Botpress is an open-source platform and hub for building, deploying, and managing GPT/LLM-powered chatbots and AI agents, with a visual stu… | 67 | 14879 | active |
| pipecat-ai/pipecat Pipecat is an open-source Python framework (BSD-2) for building real-time voice and multimodal conversational AI agents. It orchestrates sp… | 89 | 14769 | active |
| SesameAILabs/csm CSM (Conversational Speech Model) is Sesame's speech generation model that produces conversational audio from text and audio context, using… | 30 | 14720 | active |
| Tencent-Hunyuan/Hunyuan3D-2 Tencent's open-source Hunyuan3D-2 system for generating high-resolution 3D assets using large-scale diffusion models, supporting image-to-3… | 43 | 14646 | active |
| microsoft/RD-Agent RD-Agent is a Microsoft open-source framework that uses LLM-powered agents to automate research and development processes such as factor mi… | 75 | 14342 | active |
| NanmiCoder/cc-haha A local-first cross-platform desktop workspace for Claude Code and AI coding agents, built with Electron, React, and TypeScript. It provide… | 81 | 14232 | active |
| chatfire-AI/huobao-drama Huobao Drama is a self-hosted, AI-powered end-to-end short drama generation platform that automates the full pipeline from a one-sentence i… | 60 | 14141 | active |
| fathah/hermes-desktop Hermes One is a community-maintained native desktop app (Electron + React + TypeScript) for installing, configuring, and chatting with the … | 79 | 14044 | active |
| lsdefine/GenericAgent GenericAgent is a minimal self-evolving autonomous agent framework (~3K lines of seed code) that gives any LLM system-level control over a … | 78 | 14042 | active |
| Open-LLM-VTuber/Open-LLM-VTuber Open-LLM-VTuber is a cross-platform AI companion application that enables real-time voice conversations with LLMs, featuring a Live2D avata… | 67 | 13473 | active |
| xszyou/Fay Fay is an open-source Python digital human framework that connects 2.5D/3D/mobile/web digital humans or OpenAI-compatible LLMs to business … | 75 | 13455 | active |