PromtEngineer/localGPT

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

22205 stars · 2462 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

LocalGPT is a fully private, on-premise document intelligence platform that lets users chat with, summarize, and query their own documents using local GPT models, with no data leaving the device. It implements an advanced RAG pipeline with hybrid vector and full-text search, cross-encoder reranking, and a smart router between RAG and direct LLM answering.

Use cases

• chat with my pdf documents locally
• ask questions about my files without uploading to the cloud
• build a private document Q&A system
• run RAG on my own machine with local LLMs
• summarize documents privately on-device
• search my document collection with AI

When to choose

• privacy is critical and documents must never leave your device
• you want a self-hosted RAG pipeline with hybrid search and reranking
• you have a GPU or local hardware to run open-source LLMs
• you need a modular, configurable document intelligence stack

When to avoid

• you want a fully managed cloud service with no local setup
• you lack the hardware to run local LLM inference
• you need multi-user enterprise document management out of the box
• you only need simple keyword search without LLM answering

Facets

application · maturity active

rag llm-inference search-engine chatbot nlp large-language-models artificial-intelligence privacy self-hosted python self-hosted cross-platform local-llm document-qa hybrid-search vector-database lancedb reranker private-ai on-premise retrieval-augmented-generation docker gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="PromtEngineer/localGPT")