NVIDIA/ChatRTX

Health v2 · maintenance only

Flags: no_releases archived no_license

Adoption not part of the score

3121 stars · 430 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

ChatRTX is a Windows demo application for building personalized RAG chatbots on local RTX GPUs using TensorRT-LLM, NVIDIA NIM, and LlamaIndex. It lets users query their own documents (text, PDF, DOCX, images) with LLMs and supports voice input via Whisper or Riva Parakeet.

Use cases

• chat with my own documents locally on windows
• build a rag chatbot on an rtx gpu
• query pdfs and notes with a local llm
• run tensorrt-llm inference on personal files
• voice-query a local ai assistant
• search images and docs with clip and llm

When to choose

• you want a reference implementation of RAG on Windows with TensorRT-LLM
• you have a supported NVIDIA RTX GPU and want fully local, private document Q&A
• you want to study how to integrate NIM, LlamaIndex, and FAISS into a chatbot pipeline

When to avoid

• you need a maintained or production-ready product - the project was deprecated in January 2026
• you don't have a compatible NVIDIA RTX GPU
• you need Linux, macOS, or cloud deployment
• you want multi-user or server-side RAG rather than a local demo

Facets

application · maturity abandoned

rag llm-inference chatbot speech-recognition search-engine large-language-models chatbots artificial-intelligence windows windows python tensorrt-llm nvidia-nim llamaindex faiss local-llm deprecated rtx voice-input demo-app retrieval-augmented-generation gpu desktop

Member repositories

For agents

markdown · JSON · MCP: product_card(name="NVIDIA/ChatRTX")