function: llm-inference
3362 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| uptrain-ai/uptrain UpTrain is an open-source Python platform for evaluating and improving LLM applications, offering 20+ preconfigured evaluation checks cover… | 23 | 2364 | active |
| bionic-gpt/bionic-gpt Bionic is an open-source, self-hosted enterprise AI platform written in Rust that provides a ChatGPT-like workspace with agentic runtime, R… | 91 | 2363 | active |
| geekgeekrun/geekgeekrun GeekGeekRun is a free, open-source desktop application (built on Electron, Vue, Puppeteer, SQLite/TypeORM) that automates job hunting on th… | 79 | 2359 | active |
| GuDong2003/xianyu-auto-reply-fix A self-hosted Xianyu (Goofish) marketplace customer-service management system built with FastAPI, SQLite, and Playwright. It supports multi… | 82 | 2357 | active |
| facebookresearch/perception_models Meta's Perception Models repository hosting state-of-the-art image, video, and audio encoders (Perception Encoder, PE) and a multimodal lan… | 54 | 2355 | active |
| heshengtao/comfyui_LLM_party A ComfyUI plugin providing a comprehensive set of nodes for building LLM agent workflows, including MCP server support, RAG/GraphRAG, TTS, … | 65 | 2348 | active |
| oinone/oinone-pamirs Oinone Pamirs is the Java back-end of Oinone, an AI-powered low-code framework that is 100% metadata-driven and positions itself as infrast… | 63 | 2348 | active |
| 1backend/1backend 1Backend is an AI-native microservices platform written in Go that combines a framework, proxy, and runtime for building distributed applic… | 76 | 2343 | active |
| vercel/chat Chat SDK is a unified TypeScript SDK for building chat bots and AI agents that run across Slack, Microsoft Teams, Google Chat, Discord, Tel… | 78 | 2341 | active |
| simonlin1212/Vibe-Research Vibe-Research is an open-source, local-first personal AI investment research dashboard for China A-shares (plus US and HK stocks), built wi… | 79 | 2334 | active |
| 1517005260/graph-rag-agent A Python framework that integrates GraphRAG, LightRAG, and Neo4j-based graph building to construct knowledge graphs and perform explainable… | 43 | 2332 | active |
| SkyworkAI/Matrix-Game Matrix-Game is Skywork AI's open-source series of interactive world foundation models that generate real-time, streaming video in response … | 52 | 2323 | active |
| ningzimu/image-to-editable-ppt-skill A Codex skill that converts slide images, PDFs, and image-based PPTX files into fully editable PowerPoint decks. It normalizes inputs into … | 76 | 2322 | active |
| getopenscreen/openscreen OpenScreen is a free, open-source desktop screen recorder and video editor for Windows, macOS, and Linux that turns raw captures into polis… | 82 | 2319 | active |
| Xiangyu-CAS/xiaohongshu-ops-skill A skill for the OpenClaw agent that turns it into a Xiaohongshu (RedNote) operations assistant, using browser automation (CDP) to analyze f… | 50 | 2317 | active |
| codedogQBY/ReadAny ReadAny is a local-first, AI-powered cross-platform e-book reader for desktop and mobile. It combines RAG-based chat with your books, hybri… | 81 | 2311 | active |
| trypromptly/LLMStack LLMStack is a no-code platform for building generative AI agents, workflows, and chatbots by chaining multiple LLMs and connecting them to … | 30 | 2311 | active |
| mflux-community/mflux MFLUX is a native MLX implementation of state-of-the-art generative image and video models (Flux, Qwen-Image, Z-Image, and others), ported … | 90 | 2304 | active |
| llmsresearch/paperbanana An open-source, community implementation of Google Research's PaperBanana paper, providing an agentic Python framework that generates publi… | 78 | 2301 | active |
| guy-hartstein/company-research-agent A multi-agent company research application built with LangGraph and Tavily that generates comprehensive due-diligence reports on any compan… | 75 | 2264 | active |
| Tongyi-MAI/MAI-UI Qwen-UI-Agent (MAI-UI) is a foundation GUI agent model from Alibaba's Tongyi-MAI team that unifies mobile, desktop, browser, and deep-resea… | 60 | 2261 | active |
| liangdabiao/Seedance2-Storyboard-Generator A Claude Code skill and workflow toolkit that converts novels or stories into multi-episode video series by generating four-act screenplays… | 55 | 2259 | active |
| IBM/AssetOpsBench AssetOpsBench is an open-source benchmark and framework from IBM for building, orchestrating, and evaluating domain-specific AI agents for … | 64 | 2256 | active |
| fishaudio/Bert-VITS2 Bert-VITS2 is a text-to-speech model implementation combining the VITS2 architecture with multilingual BERT embeddings, written in Python. … | 63 | 8796 | maintenance |
| coleam00/mcp-crawl4ai-rag An MCP server that combines Crawl4AI web crawling with RAG capabilities backed by a Supabase vector database, exposing tools for AI agents … | 34 | 2246 | active |
| YFGaia/dify-plus Dify-Plus is an enterprise-enhanced fork of the Dify LLM application platform, adding a management center built on gin-vue-admin plus enter… | 75 | 2240 | active |
| vasu-devs/JustHireMe JustHireMe is a local-first desktop workbench (Tauri frontend, Python backend) that scrapes job postings, ranks role fit against your profi… | 78 | 2238 | stable |
| dstackai/dstack dstack is an open-source, vendor-agnostic control plane for GPU provisioning and orchestration that works across GPU clouds, Kubernetes, an… | 95 | 2236 | active |
| learnhouse/learnhouse LearnHouse is a next-generation open-source learning management system (LMS) for creating, sharing, and selling educational content. It com… | 99 | 2234 | active |
| Kocoro-lab/Shannon Shannon is a production-oriented multi-agent orchestration framework written in Go (with Rust components) that coordinates AI agent swarms … | 78 | 2226 | active |
| apple/ml-ferret Apple's Ferret, an end-to-end multimodal large language model (MLLM) that accepts any-form referring and grounds anything in its responses,… | 27 | 8669 | maintenance |
| daodao97/chatmcp ChatMCP is a cross-platform AI chat client built in Dart/Flutter that implements the Model Context Protocol (MCP). It supports multiple LLM… | 39 | 2224 | active |
| openstatusHQ/data-table-filters A shadcn/ui-based collection of copy-paste components and patterns for building filterable React data tables with TanStack Table, offering … | 67 | 2213 | active |
| trykimu/videoeditor Kimu is an open-source, AI-powered web video editor positioned as an alternative to CapCut and Canva. It combines a React/Remotion-based mu… | 58 | 2202 | active |
| meizhong986/WhisperJAV WhisperJAV is a local, privacy-preserving subtitle generator for Japanese adult videos, combining Qwen3-ASR, Whisper, TEN-VAD/FireRedVAD vo… | 94 | 2200 | active |
| mhss1/MyBrain My Brain is an all-in-one Android productivity app combining tasks, markdown notes, calendar, diary with mood tracking, and bookmarks, plus… | 98 | 2199 | active |
| agentstack-ai/AgentStack AgentStack is a Python CLI tool that scaffolds AI agent projects, generating a preconfigured stack of frameworks (CrewAI, LangGraph, OpenAI… | 38 | 2190 | active |
| adams549659584/go-proxy-bingai A self-hosted demo site for Microsoft New Bing AI built with Vue3 and Go, providing a consistent Bing-like UI without requiring login. It p… | 20 | 8455 | maintenance |
| beelzebub-labs/beelzebub Beelzebub is an open-source deception runtime framework written in Go that deploys adaptive, LLM-powered honeypot decoy services across SSH… | 98 | 2167 | active |
| huohuoer/wechat-cli A command-line tool that queries local WeChat data including chat history, contacts, sessions, and favorites, with on-the-fly SQLCipher dec… | 48 | 2164 | active |
| Tencent-Hunyuan/HunyuanVideo-Avatar HunyuanVideo-Avatar is Tencent's open-source model and inference code for high-fidelity audio-driven human animation, generating talking av… | 45 | 2162 | active |
| watercrawl/WaterCrawl WaterCrawl is a self-hostable web application (Python/Django/Scrapy/Celery) that crawls websites and transforms web content into LLM-ready … | 82 | 2158 | active |
| jd-opensource/JoyAI-Image JoyAI-Image is a unified multimodal foundation model for image understanding, text-to-image generation, and instruction-guided image editin… | 58 | 2149 | active |
| proma-ai/Proma Proma is a local-first, open-source AI desktop application that combines multi-model chat, a general-purpose agent runtime, workspaces, ski… | 78 | 2147 | active |
| kleinlee/DH_live DH_live (mini) is an open-source 2D talking-head digital human toolkit that generates real-time lip-synced avatar video from a single refer… | 67 | 2139 | active |
| google-antigravity/antigravity-cli Antigravity CLI is a terminal-based AI coding agent from Google that understands codebases, makes permissioned edits, and executes commands… | 81 | 2137 | active |
| crshdn/mission-control Autensa (crshdn/mission-control) is a self-hosted Autonomous Product Engine that runs AI agents to research your market, generate scored fe… | 72 | 2137 | active |
| PKU-YuanGroup/Helios Helios is a 14B autoregressive diffusion model for real-time, minute-scale video generation supporting text-to-video, image-to-video, and v… | 59 | 2132 | active |
| GAIR-NLP/daVinci-MagiHuman daVinci-MagiHuman is an open-source 15B-parameter single-stream transformer foundation model that jointly generates synchronized audio and … | 49 | 2115 | active |
| River-Zhang/ICEdit ICEdit (In-Context Edit) is a research framework for instruction-based image editing built on large-scale Diffusion Transformers, using a L… | 45 | 2104 | active |
| OpenCoworkAI/open-cowork Open Cowork is an open-source AI agent desktop application for Windows and macOS that wraps Claude Code and other models (OpenAI, Gemini, D… | 76 | 2100 | active |
| mikubaka88/CCFA-Skills A family of 17 agent skills for shaping the research storyline of CCF-A academic papers, covering ideation, literature retrieval, experimen… | 79 | 2091 | active |
| Weizhena/Deep-Research-skills A structured deep research skill (prompt/workflow package) for Claude Code, OpenCode, and Codex that runs a two-phase research process: out… | 60 | 2087 | active |
| milind-soni/OpenMausBot OpenMausBot is an open-source, local-first desktop chat application (Electron, TypeScript) where each contact is an AI agent powered by Cla… | 57 | 2081 | active |
| agentset-ai/agentset Agentset is an open-source RAG-as-a-service platform that handles document ingestion, chunking, embeddings, retrieval, and agentic search w… | 61 | 2079 | active |
| shuyu-labs/BigBanana-AI-Director BigBanana AI Director is a self-hosted, industrial-grade AI platform for generating short dramas and motion comics end-to-end, from script … | 80 | 2076 | active |
| ammaarreshi/Gemini-Search A Perplexity-style AI search engine web application powered by Google's Gemini 2.0 Flash model with Google Search grounding. It provides AI… | 21 | 2069 | active |
| cogwheel0/conduit Conduit is a native Flutter-based iOS and Android client for Open WebUI, OpenAI-compatible endpoints, Ollama, OpenRouter, and Hermes agents… | 80 | 2064 | active |
| Kritt-ai/open-kritt open·kritt is an open-source, self-hosted AI vulnerability research platform that decomposes a codebase into focused security tasks, runs A… | 79 | 2053 | active |
| PRIS-CV/DemoFusion DemoFusion is a CVPR 2024 framework that extends open-source latent diffusion models like SDXL to generate high-resolution images without a… | 48 | 2041 | stable |
| akl7777777/ShellGPT ShellGPT is a free, multi-platform ChatGPT client supporting GPT-3.5, GPT-4, NewBing, and Claude without requiring an API key or login. It … | 40 | 2026 | active |
| Kochava-Studios/witsy Witsy is a cross-platform desktop AI assistant built with Electron and Vue 3 that lets users chat with many LLM providers using their own A… | 69 | 2024 | active |
| afar1/fieldtheory-cli A TypeScript CLI that syncs X/Twitter bookmarks to local markdown files, provides BM25 full-text search and LLM-based classification, and e… | 58 | 2018 | active |
| dqzg12300/fridaUiTools fridaUiTools is a PyQt5 desktop workbench that wraps Frida into a unified GUI for attaching to processes, managing hook script templates, v… | 86 | 2011 | active |
| cortexkit/magic-context Magic Context is a TypeScript library that gives coding agents self-managing, unbounded memory so a single session can last indefinitely. I… | 77 | 2008 | active |
| HKUDS/MiniRAG MiniRAG is an extremely simple retrieval-augmented generation framework designed to work with small, open-source language models. It uses s… | 39 | 2008 | active |
| supermemoryai/markdowner Markdowner is a fast web service that converts any website into LLM-ready markdown, with optional LLM filtering, detailed responses, and au… | 24 | 2001 | active |
| atomicstrata/llm-wiki-compiler llmwiki is a Node.js CLI knowledge compiler that turns raw sources (papers, docs, notes, PDFs, URLs) into an interlinked, citation-traceabl… | 79 | 1996 | active |
| karpathy/jobs A research tool that scrapes the Bureau of Labor Statistics Occupational Outlook Handbook (342 occupations) and renders an interactive tree… | 47 | 1996 | active |
| jd-opensource/JoyAI-Echo JoyAI-Echo is a Python framework for long-horizon audio-visual generation, producing coherent multi-shot videos up to ~5 minutes with paire… | 58 | 1995 | active |
| envoyproxy/ai-gateway Envoy AI Gateway is an open-source, Kubernetes-native gateway built on Envoy Gateway that manages traffic from application clients to Gener… | 88 | 1993 | stable |
| kkbo8005/mitan Mitan (密探) is an all-in-one penetration testing and security assessment desktop application integrating asset mapping, subdomain brute-forc… | 79 | 1989 | active |
| tsingyuai/growth-lab Growth Lab is an open-source, end-to-end AI growth system that runs product marketing and user-acquisition loops through natural-language c… | 56 | 1989 | active |
| msoedov/agentic_security Agentic Security is an open-source LLM vulnerability scanner and AI red-teaming toolkit that probes large language models and agent workflo… | 87 | 1984 | active |
| Linzaer/Ultra-Light-Fast-Generic-Face-Detector-1MB An ultra-lightweight face detection model (~1MB FP32, ~300KB quantized) designed for edge computing devices, with slim and RFB variants tra… | 32 | 7546 | maintenance |
| showlab/Show-o Show-o is a research repository implementing a unified transformer model that combines autoregressive and discrete diffusion modeling for m… | 50 | 1976 | active |
| mudler/LocalAGI LocalAGI is a self-hostable, privacy-focused AI agent platform written in Go that lets users create no-code agents, automations, and chatbo… | 90 | 1965 | active |
| RedPlanetHQ/core CORE is an open-source, self-hosted personal AI operating system that runs as an always-on assistant with persistent memory and integration… | 81 | 1962 | active |
| omnimind-ai/OmniBot OpenOmniBot (OmniBot) is an on-device AI agent app for Android, built with a native Kotlin host and Flutter UI, that runs a full understand… | 82 | 1957 | active |
| kadirnar/whisper-plus A Python library wrapping OpenAI Whisper-family models (including distil-whisper and MLX variants) for fast speech-to-text transcription wi… | 60 | 1955 | active |
| iniwap/AIWriteX AIWriteX is a Python-based desktop application that automates WeChat Official Account content creation using CrewAI multi-agent workflows, … | 86 | 1939 | active |
| Stack-Cairn/LiveAgent LiveAgent is a local-first AI agent desktop client built with Tauri 2, React, Rust, and Go, supporting multi-model access and local tool ex… | 81 | 1929 | active |
| microsoft/sample-app-aoai-chatGPT A Microsoft sample web chat application that connects to Azure OpenAI chat models, including support for the 'On Your Data' feature with da… | 74 | 1927 | active |
| szczyglis-dev/py-gpt PyGPT is an open-source, all-in-one desktop AI assistant for Linux, Windows, and Mac, written in Python. It supports chat, agents, vision, … | 92 | 1903 | active |
| oficcejo/aiagents-stock A Python multi-AI-agent stock analysis and monitoring system for mainland China A-shares, simulating a team of securities analysts to produ… | 53 | 1902 | active |
| hank9999/kiro.rs A Rust-based proxy service that exposes an Anthropic Claude API-compatible endpoint and translates requests to the Kiro API. It supports SS… | 74 | 1900 | active |
| showlab/ShowUI ShowUI is an open-source, lightweight 2B vision-language-action model for GUI agents and computer use, accepted at CVPR 2025. The repositor… | 57 | 1897 | active |
| AutoArk/EVA-OS EVA OS / EVA Platform is a real-time multimodal AI operating system and development platform for next-generation smart hardware, combining … | 68 | 1890 | active |
| 7836246/cursor2api A self-hosted proxy service that converts Cursor's free documentation-page AI chat endpoint into OpenAI Chat Completions and Anthropic Mess… | 69 | 1886 | active |
| twitter/communitynotes The public repository for Twitter/X's Community Notes, hosting the open-source scoring algorithm code, documentation, and a template AI not… | 76 | 1885 | active |
| flybirdxx/ComfyUI-Qwen-TTS A ComfyUI custom node plugin that wraps Alibaba's Qwen3-TTS model for speech synthesis, zero-shot voice cloning, and natural-language voice… | 54 | 1884 | active |
| BidingCC/BuildingAI BuildingAI is an open-source, enterprise-grade platform for visually assembling AI applications without code, described as the 'WordPress o… | 86 | 1878 | active |
| numtide/llm-agents.nix A Nix package repository providing pre-packaged AI coding agents and development tools (Claude Code, Amp, Codex, Cline, etc.) installable v… | 58 | 1876 | active |
| yologdev/yoyo-evolve yoyo is an open-source terminal coding agent written in Rust that autonomously evolves its own source code — reading its code, planning imp… | 80 | 1870 | active |
| e-p-armstrong/augmentoolkit Augmentoolkit is a Python application that generates domain-expert fine-tuning datasets from uploaded documents and trains custom LLMs on t… | 60 | 1868 | active |
| jingsongliujing/OnnxOCR A lightweight multilingual OCR library rebuilt from PaddleOCR models to run on ONNXRuntime, removing the PaddlePaddle dependency for fast i… | 74 | 1867 | active |
| Omni-Avatar/OmniAvatar OmniAvatar is an audio-driven full-body avatar video generation model built on Wan2.1 text-to-video diffusion models with LoRA-based audio … | 34 | 1861 | active |
| OpenNMT OpenNMT is an open-source ecosystem for neural machine translation and sequence learning, with PyTorch (OpenNMT-py) and TensorFlow (OpenNMT… | 44 | 7014 | maintenance |
| sourcery-ai/sourcery Sourcery is an AI-powered automated code review service that reviews pull requests on GitHub and GitLab, posting summaries, inline comments… | 97 | 1858 | active |
| stephengpope/thepopebot A self-hosted autonomous AI agent platform that combines chat (Telegram and web), coding agents (Claude Code, Codex, Gemini, etc.), and liv… | 69 | 1853 | active |