function: llm-inference
3362 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| cohere-ai/cohere-toolkit Cohere Toolkit is a deployable all-in-one RAG application with prebuilt frontend and backend components for building LLM-based products. It… | 10 | 3177 | active |
| liyown/ai-trend-publish TrendPublish is a TypeScript-based automated content pipeline for WeChat Official Accounts that scrapes multiple sources (Twitter/X, RSS, s… | 82 | 3158 | active |
| TurixAI/TuriX-CUA TuriX is an open-source computer-use agent (CUA) that lets AI models take real actions on a desktop GUI - clicking, typing, and navigating … | 70 | 3156 | active |
| yetone/cumora Cumora is a cross-platform team chat application where AI agents participate as first-class teammates alongside humans, with personas, memo… | 79 | 3149 | active |
| chenyme/Chenyme-AAVT Chenyme-AAVT is a fully automated audio/video translation application that uses Whisper (faster-whisper) for speech recognition, large lang… | 10 | 3128 | active |
| liaohch3/claude-tap claude-tap is a local proxy and trace viewer for AI coding agents like Claude Code, Codex CLI, and Gemini CLI. It intercepts real API traff… | 77 | 3125 | active |
| Snailclimb/interview-guide An open-source AI-powered interview platform built with Spring Boot 4.1, Java 25, Spring AI 2.0, React, PostgreSQL/pgvector, and Redis. It … | 59 | 3106 | active |
| guillaume-be/rust-bert A Rust-native library providing ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT-2, RoBERTa, BART, etc.), por… | 60 | 3076 | active |
| Nutlope/self.so Self.so is an open-source web application that turns a resume or LinkedIn profile into a professional personal website in one click. It use… | 62 | 3073 | active |
| spiceai/spiceai Spice.ai OSS is a portable Rust runtime (~140 MB binary) that combines federated SQL querying, accelerated data materialization, full-text … | 95 | 3070 | active |
| hegelai/prompttools PromptTools is an open-source Python library for testing, experimenting with, and evaluating prompts, LLMs (OpenAI, Anthropic, LLaMA, etc.)… | 50 | 3051 | active |
| TanStack/ai TanStack AI is a type-safe, provider-agnostic TypeScript SDK for building AI applications with streaming chat, tool calling, agents, struct… | 80 | 3028 | active |
| xyproto/algernon Algernon is a small, self-contained web server and application server written in pure Go, bundling HTTP/2, HTTP/3 (QUIC), Lua/Teal scriptin… | 93 | 3027 | active |
| SharpAI/DeepCamera DeepCamera is an open-source AI camera skills platform that runs local VLM scene analysis, object detection, face recognition, and person r… | 86 | 3019 | active |
| kyutai-labs/delayed-streams-modeling Kyutai's repository of Speech-To-Text and Text-To-Speech models built on the Delayed Streams Modeling framework, with implementations in Py… | 47 | 3017 | active |
| GH05TCREW/pentestagent PentestAgent is a Python-based AI agent framework for black-box penetration testing that orchestrates LLM-driven security testing workflows… | 62 | 3010 | active |
| deepnote/deepnote Deepnote is an open-source, AI-first drop-in replacement for Jupyter notebooks with a human-readable YAML format, block-based architecture … | 79 | 2998 | active |
| Netw0rkNoob/VulnClaw VulnClaw is an AI-driven penetration testing CLI tool that combines an LLM agent, MCP toolchain, and curated pentest skills to automate the… | 80 | 2997 | active |
| codigoencasa/builderbot BuilderBot is an open-source TypeScript framework for building WhatsApp (and Telegram) chatbots with keyword-driven conversation flows, plu… | 84 | 2966 | active |
| Jpisnice/shadcn-ui-mcp-server A Model Context Protocol (MCP) server that gives AI assistants access to shadcn/ui component source code, demos, blocks, and metadata acros… | 60 | 2960 | active |
| dwgx/WindsurfAPI A zero-dependency Node.js reverse proxy that exposes Windsurf/Devin Desktop's 100+ cloud AI models (Claude, GPT, Gemini, DeepSeek, Kimi, GL… | 77 | 2950 | active |
| KevinWang676/Bark-Voice-Cloning A one-click hub of Gradio Web UIs and Colab notebooks for open-source voice cloning, TTS, and voice conversion models including Bark, GPT-S… | 67 | 2947 | active |
| qxcnm/Codex-Manager CodexManager is a local desktop application plus service process for managing multiple Codex CLI accounts, API keys, and usage quotas in on… | 82 | 2940 | active |
| yunionio/cloudpods Cloudpods is an open-source, Golang-based cloud-native unified multi/hybrid-cloud platform ('a cloud on clouds') that manages on-premise KV… | 77 | 2935 | active |
| qingchencloud/clawpanel ClawPanel is a cross-platform desktop and web control panel for managing multiple AI agent runtimes (OpenClaw, Hermes Agent, DeepSeek Harne… | 78 | 2931 | active |
| sherlockchou86/VideoPipe VideoPipe is a C++ framework for video analysis and structuring that works like a pipeline of independent, composable nodes. It integrates … | 54 | 2931 | active |
| Saiyan-World/goku Goku is a family of flow-based (rectified flow Transformer) foundation models for joint image and video generation, released by HKU and Byt… | 23 | 2905 | active |
| 0xemmkty/QuantMuse A Python-based quantitative trading system combining factor analysis, ML models, and LLM-powered market analysis with real-time market data… | 36 | 2900 | active |
| datascale-ai/opentalking OpenTalking is an open-source Python framework for building real-time AI digital-human (talking avatar) conversation products. It orchestra… | 65 | 2897 | active |
| oceanbase/seekdb seekdb is an AI-native search database from OceanBase that unifies relational, vector, full-text, JSON, and GIS data in a single MySQL-comp… | 74 | 2882 | active |
| fqscfqj/Y2A-Auto Y2A-Auto is a self-hosted Python application that automates re-uploading YouTube videos to AcFun and bilibili. It handles the full pipeline… | 82 | 2845 | active |
| kaitranntt/ccs CCS is a TypeScript CLI tool that manages multiple AI provider profiles and accounts for Claude Code and compatible CLIs, switching between… | 78 | 2833 | active |
| superlinked/sie SIE (Superlinked Inference Engine) is an open-source, self-hosted inference server and production cluster that serves 100+ open models (emb… | 92 | 2830 | active |
| leptonai/leptonai LeptonAI is a Python library and `lep` CLI for operating NVIDIA DGX Cloud Lepton, a platform that unifies global GPU compute for AI develop… | 94 | 2825 | active |
| sahibzada-allahyar/YC-Killer A collection of open-source, enterprise-grade AI agents intended as free alternatives to commercial Y Combinator startups. It includes a de… | 64 | 2792 | active |
| mshumer/OpenDeepResearcher A Jupyter Notebook (with a Gradio UI variant) implementing an autonomous AI research agent that iteratively generates search queries, fetch… | 29 | 2791 | active |
| opentiny/tiny-engine TinyEngine is a Vue-based low-code engine for building custom low-code platforms across different domains. It supports online real-time vis… | 91 | 2784 | active |
| minitap-ai/mobile-use An open-source Python AI agent framework that controls real Android and iOS devices using natural language commands, built on LangGraph. It… | 73 | 2784 | active |
| imanoop7/Ollama-OCR A Python package and Streamlit web app that performs OCR on images and PDFs using vision language models served through Ollama. It supports… | 26 | 2780 | active |
| opensolon/solon Solon is a Java enterprise application development framework built from scratch as a lighter, faster alternative to Spring Boot/Spring Clou… | 95 | 2774 | active |
| jnsahaj/lumen Lumen is a fast terminal-based git diff viewer and code review TUI written in Rust, shipped as a single static binary. It offers side-by-si… | 84 | 2769 | active |
| erupts/erupt Erupt is an annotation-driven Java framework for Spring Boot that turns annotated JPA entity classes into full-featured admin pages with ze… | 95 | 2763 | active |
| AutoArk/GPA GPA (General Purpose Audio) is a unified autoregressive audio-language model that performs text-to-speech, automatic speech recognition, an… | 54 | 2762 | active |
| yilewang/llm-for-zotero A Zotero plugin that integrates large language models into the Zotero PDF reader, enabling grounded paper chat, summarization, figure extra… | 78 | 2761 | active |
| echohive42/AI-reads-books-page-by-page A Python script that reads PDF books page by page, using AI to extract knowledge points and generate progressive summaries at configurable … | 61 | 2756 | active |
| control-theory/gonzo Gonzo is a Go-based terminal UI (TUI) for real-time log analysis, inspired by k9s. It visualizes log streams with charts, filtering, and AI… | 79 | 2755 | active |
| protectai/vulnhuntr Vulnhuntr is a Python CLI tool that uses large language models combined with static code analysis to autonomously discover exploitable vuln… | 24 | 2747 | active |
| devflowinc/trieve Trieve is an all-in-one API platform for semantic vector search, typo-tolerant full-text and neural search, recommendations, RAG, and analy… | 61 | 2717 | active |
| dvorka/mindforger MindForger is a desktop personal knowledge management tool that combines a thinking notebook with a full-featured Markdown editor/IDE. It m… | 61 | 2715 | active |
| zinja-coder/jadx-ai-mcp A JADX plugin that bundles an MCP server, allowing LLM clients like Claude to interact with the JADX decompiler for Android APK analysis. I… | 84 | 2711 | active |
| dscripka/openWakeWord openWakeWord is an open-source Python library for detecting wake words (or phrases) in streaming audio, with pre-trained models for common … | 49 | 2702 | active |
| wanikua/danghuangshang Danghuangshang is an open-source multi-agent collaboration system built on the OpenClaw framework, modeling an AI 'imperial court' after Mi… | 55 | 2699 | active |
| SkyworkAI/SkyReels-V1 SkyReels V1 is an open-source human-centric video foundation model with Text-to-Video and Image-to-Video variants, fine-tuned from HunyuanV… | 25 | 2696 | active |
| stochasticai/xTuring xTuring is a Python library for fine-tuning, evaluating, and running open-source large language models such as LLaMA, GPT-J, GPT-2, Qwen, a… | 52 | 2674 | active |
| JIA-Lab-research/LISA LISA (Large Language Instructed Segmentation Assistant) is a multimodal large language model that performs reasoning-based image segmentati… | 31 | 2674 | active |
| georgia-tech-db/evadb EvaDB is a Python database system for building AI-powered applications, exposing a SQL API that queries structured data, videos, and unstru… | 10 | 2673 | active |
| darkzOGx/youtube-automation-agent AgentTube is a self-hosted Node.js application that uses AI agents to run a YouTube channel end to end: researching topics, writing scripts… | 82 | 2666 | active |
| UKGovernmentBEIS/inspect_ai Inspect is an open-source Python framework from the UK AI Security Institute for running large language model evaluations, with composable … | 71 | 2640 | active |
| anliyuan/Ultralight-Digital-Human An ultralight talking-head (digital human) model that animates a person's face from audio input and runs in real time on mobile devices. It… | 64 | 2627 | active |
| confident-ai/deepteam DeepTeam is an open-source Python framework for red teaming LLM systems, AI agents, RAG pipelines, and chatbots. It simulates adversarial a… | 67 | 2623 | active |
| firecrawl/open-agent-builder Open Agent Builder is a visual, no-code workflow builder for creating AI agent pipelines powered by Firecrawl web scraping. It provides a d… | 38 | 2618 | active |
| papersgpt/papersgpt-for-zotero PapersGPT is a Zotero plugin that lets researchers chat with single PDFs, multiple documents, or their entire library using cloud LLMs (Cha… | 87 | 2612 | active |
| visa/visa-vulnerability-agentic-harness VVAH is Visa's open-source agentic harness for autonomous vulnerability discovery, remediation, and validation using frontier AI models. It… | 67 | 2601 | active |
| Mininglamp-AI/Mano-P Mano-P is an open-source GUI-VLA (vision-language-action) agent model and SDK for edge devices, enabling purely vision-driven cross-platfor… | 55 | 2589 | active |
| liou666/polyglot Polyglot is a cross-platform desktop (and web) application for practicing spoken language with AI conversation partners, built on ChatGPT f… | 39 | 2585 | active |
| lealone/Lealone Lealone is a Java-based full-stack, self-evolving general-purpose AI agent built on top of a high-performance NewSQL/RDBMS engine with asyn… | 67 | 2581 | active |
| taoshihan1991/goflylivechat GOFLY LIVE CHAT is an open-source, self-hosted customer support live chat system written in Go with a VueJS frontend. It supports real-time… | 50 | 2573 | active |
| vita-epfl/Stable-Video-Infinity Stable Video Infinity (SVI) is a research codebase for infinite-length video generation using video diffusion transformers with an error-re… | 55 | 2556 | active |
| zixiiu/Digital_Life_Server A Python server backend for a 'digital life' voice assistant that combines speech recognition, ChatGPT-based conversation, sentiment analys… | 30 | 2554 | active |
| AIGC-Audio/AudioGPT AudioGPT is a Python framework that wraps multiple audio foundation models (for speech, singing, sound, and talking-head tasks) behind a GP… | 30 | 10167 | maintenance |
| chatdoc-com/OCRFlux OCRFlux is a Python toolkit built on a 3B-parameter vision-language model that converts PDFs and images into clean Markdown, handling compl… | 53 | 2533 | active |
| Intent-Lab/VisionClaw VisionClaw is a real-time AI assistant app for Meta Ray-Ban smart glasses that streams camera frames and microphone audio to the Gemini Liv… | 59 | 2529 | active |
| apache/burr Apache Burr is a Python framework for building stateful applications that make decisions, such as chatbots, agents, and simulations, using … | 87 | 2528 | active |
| vllm-project/production-stack vLLM Production Stack is a reference implementation for deploying vLLM LLM inference at scale on Kubernetes, distributed via Helm charts. I… | 85 | 2526 | active |
| HiDream-ai/HiDream-I1 HiDream-I1 is an open-source 17B-parameter text-to-image generative foundation model based on a Sparse Diffusion Transformer, with full and… | 34 | 2512 | active |
| bilibili/Index-anisora Index-AniSora is Bilibili's open-source anime video generation model, capable of creating video shots in diverse anime styles from images, … | 62 | 2505 | active |
| pingcap/ossinsight OSSInsight is a web analytics platform that analyzes over 10 billion GitHub events to provide rankings, trends, and comparisons of open sou… | 67 | 2498 | active |
| aurora-develop/aurora A Go service that exposes ChatGPT Web capabilities as an OpenAI-compatible API, including chat completions, responses, file Q&A, image gene… | 90 | 2485 | active |
| mattzcarey/shippie Shippie is an extendable AI code-review agent that reads pull request diffs, explores the codebase with developer tools, and posts focused … | 92 | 2483 | active |
| QIN2DIM/hcaptcha-challenger A Python library that solves hCaptcha challenges using multimodal large language models and ONNX vision models (YOLO, CLIP, ResNet) integra… | 86 | 2482 | active |
| GaParmar/img2img-turbo A research library implementing one-step image-to-image translation models (CycleGAN-Turbo and pix2pix-turbo) built on SD-Turbo diffusion m… | 41 | 2476 | active |
| amap-cvlab/ABot-World ABot-World is an open-source interactive world model that generates infinite, explorable video worlds from a single image, running on a sin… | 58 | 2462 | active |
| cisco-ai-defense/skill-scanner A security scanner for AI agent skills that detects prompt injection, data exfiltration, and malicious code patterns using pattern-based de… | 80 | 2460 | active |
| data-infra/cube-studio CubeStudio is an open-source, cloud-native, all-in-one AI platform covering the full machine learning lifecycle (MLOps/MaaS/LLMOps), includ… | 80 | 2448 | active |
| modstart-lib/linkandroid LinkAndroid is an open-source, cross-platform desktop application built with Electron that connects Android phones to PCs over USB or Wi-Fi… | 88 | 2442 | active |
| iliane5/meridian Meridian is an open-source AI-powered news intelligence system that scrapes hundreds of RSS sources, clusters and analyzes articles with LL… | 31 | 2442 | active |
| metarank/metarank Metarank is an open-source, low-code Learning-to-Rank service that personalizes search results, listings, and recommendations using real-ti… | 88 | 2434 | active |
| ShinMegamiBoson/OpenPlanter OpenPlanter is a recursive-language-model investigation agent that ingests heterogeneous datasets (corporate registries, campaign finance, … | 48 | 2434 | active |
| Alan AI SDK Alan AI SDK is a set of client libraries for embedding Alan AI's conversational AI agents and intelligent app layer into web, iOS, Android,… | 93 | 2431 | active |
| docmd-io/docmd docmd is a zero-configuration documentation compiler that turns a folder of Markdown files into a static documentation website, client-side… | 82 | 2428 | active |
| open-webui/pipelines Pipelines is a UI-agnostic, OpenAI API-compatible plugin framework for adding custom Python logic and workflows to any client that speaks t… | 41 | 2428 | active |
| pnnbao97/VieNeu-TTS VieNeu-TTS is an on-device Vietnamese text-to-speech library with instant zero-shot voice cloning from short reference clips, supporting bi… | 84 | 2427 | active |
| ace-trump-tech/MindPaw MindPaw is an open-source desktop quadruped robot dog built on ESP8266 with roughly ¥50 in parts, featuring voice control, gesture recognit… | 58 | 2427 | active |
| wan-h/awesome-digital-human-live2d An open-source digital human application that combines Live2D avatars with LLM-powered conversation, integrating ASR, LLM, TTS, and agent o… | 62 | 2413 | active |
| CodeBoarding/CodeBoarding CodeBoarding is an open-source CLI and toolchain that combines static analysis with LLM reasoning to generate interactive architecture diag… | 85 | 2400 | active |
| Alibaba-Quark/LiveAvatar LiveAvatar is an open-source implementation of an ECCV 2026 paper for streaming, real-time, infinite-length audio-driven avatar video gener… | 61 | 2386 | active |
| ailia-ai/ailia-models A collection of 400+ pre-trained state-of-the-art AI models (object detection, pose estimation, speech recognition, LLMs, image generation,… | 77 | 2385 | active |
| uptrain-ai/uptrain UpTrain is an open-source Python platform for evaluating and improving LLM applications, offering 20+ preconfigured evaluation checks cover… | 23 | 2362 | active |
| bionic-gpt/bionic-gpt Bionic is an open-source, self-hosted enterprise AI platform written in Rust that provides a ChatGPT-like workspace with agentic runtime, R… | 91 | 2357 | active |
| samugit83/redamon RedAmon is an AI-powered agentic red team framework that automates offensive security operations end-to-end, chaining reconnaissance, explo… | 81 | 2354 | active |