zylon-ai/private-gpt

Health v2 · maintenance only

Adoption not part of the score

57471 stars · 7611 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

PrivateGPT is an open-source Python API layer that turns local or OpenAI-compatible LLM servers into production AI applications, providing RAG, tools, MCP connectors, text-to-SQL, and a messages API. It does not run models itself but connects to any inference server implementing /v1/chat/completions, and ships a built-in workbench UI for testing.

Use cases

• build a private chatbot over my own documents
• run RAG on local models without cloud APIs
• expose an OpenAI-style API on top of Ollama
• add file ingestion and citations to an AI app
• connect local LLMs to custom tools and MCP servers
• query databases and CSVs with natural language
• deploy an on-premise AI assistant for sensitive data

When to choose

• you need private, on-premise AI with no cloud dependency
• you already run an OpenAI-compatible server like Ollama, llama.cpp, or vLLM
• you want production-tested RAG, tools, and MCP building blocks behind one API
• you are building an AI product and want to avoid rebuilding backend primitives

When to avoid

• you only need raw model inference without higher-level features
• you want a fully managed cloud AI service
• you need a polished end-user workspace rather than an API layer (consider Zylon)
• your stack is not Python-friendly

Facets

framework · maturity active

rag agent-framework llm-inference api-framework mcp chatbot artificial-intelligence large-language-models privacy self-hosted developer-tools python self-hosted windows cross-platform local-llm openai-compatible on-premise private-ai ollama text-to-sql citations api-layer retrieval-augmented-generation ai-agents docker linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="zylon-ai/private-gpt")