# h2oai/h2ogpt

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

Repository: https://github.com/h2oai/h2ogpt
Canonical: https://ross.abutalabs.com/products/h2ogpt
Homepage: http://h2o.ai
Language: Python
License: Apache-2.0
License Family: permissive
Topics: chatgpt, llm, ai, embeddings, generative, gpt, gpt4all, pdf, private, privategpt, vectorstore, llama2, mixtral, fedramp
Archived: true
Last push: 2025-10-09T23:30:01+00:00

## Health v2 (maintenance only)
Score: 10/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 46, release rhythm 8, longevity 89
- inputs: {"age_days": 1258, "days_push": 328, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: archived
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 11969, forks 1303 (observed 2026-08-28T04:10:50.578110+00:00)

## What it is
h2oGPT is an Apache-2.0 open-source application for chatting with local, private LLMs and querying/summarizing your own documents (PDFs, Word, images, video, audio, code) with RAG. It provides a Gradio web UI and CLI, supports many models via HF, llama.cpp, GPT4All, and AutoGPTQ, and includes vision, image generation, STT/TTS, and authentication features.

## Use cases
- chat with local private gpt offline
- ask questions about my pdf documents
- summarize documents with an llm
- run a private chatgpt alternative on my own machine
- build a document question answering chatbot
- self-host a private ai assistant with voice
- index and search my files with embeddings

## When to choose
- you need 100% private, offline LLM chat and document Q&A
- you want a self-hosted RAG pipeline with a ready-made UI
- you need support for many model backends (llama.cpp, HF, GPT4All, AutoGPTQ) on CPU or GPU
- you want built-in OCR, vision, image generation, and speech features in one app

## When to avoid
- you only need a lightweight library to embed LLM calls in your own app
- you want a fully managed hosted service rather than self-hosting
- you need a minimal single-purpose tool rather than a feature-rich platform
- you lack the hardware for local inference and prefer cloud APIs

## Facets
- artifact type: application
- maturity: active
- function: rag, llm-inference, chatbot, chat-interface, ocr, speech-recognition, tts, image-processing, search-engine, vector-database, auth, cli, ui-components
- domain: large-language-models, chatbots, artificial-intelligence, privacy, self-hosted, pdf
- platform: python, windows, self-hosted, cli
- tags: privategpt, document-qa, local-llm, llama-cpp, gradio-ui, embeddings, vector-store, openai-proxy, voice-assistant, stable-diffusion, offline-ai, retrieval-augmented-generation, natural-language-processing, linux, macos, docker, gpu

## Member repositories
- h2oai/h2ogpt (main) score 10

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:10:50.578110+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T17:15:01.949800+00:00, confidence not recorded.
  - readme: https://github.com/h2oai/h2ogpt (fetched 2026-08-28T04:10:50.578110+00:00, sha 332459235e71)
  - homepage: http://h2o.ai (fetched 2026-08-29T08:13:06.773184+00:00, sha 6b9a5ca9fced)
  - site_page: https://h2o.ai/docs (fetched 2026-08-29T08:13:06.795701+00:00, sha 411722578bc1)
  - registry_pypi: https://pypi.org/pypi/h2ogpt/json (fetched 2026-08-29T08:13:06.797403+00:00, sha 5dabc55a8fcd)
  - site_page: https://h2o.ai/platform/enterprise-h2ogpte (fetched 2026-08-29T08:13:06.782704+00:00, sha 71f7b1d062f7)
  - site_page: https://h2o.ai/platform/why-h2o (fetched 2026-08-29T08:13:06.784834+00:00, sha dbfd58bb2a72)
  - site_page: https://h2o.ai/company (fetched 2026-08-29T08:13:06.786705+00:00, sha ddd0af08be22)
  - site_page: https://h2o.ai/company/press-media?tagFilter=Press+Release (fetched 2026-08-29T08:13:06.788920+00:00, sha 6aa60f9bcf14)
  - site_page: https://h2o.ai/partner-network/find-a-partner (fetched 2026-08-29T08:13:06.792572+00:00, sha 9d1a4050938e)
- Data as of 2026-08-30T08:39:29.467469+00:00.