aws-samples/aws-genai-llm-chatbot

Health v2 · maintenance only

Adoption not part of the score

1400 stars · 436 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A modular, production-ready AWS solution for deploying a multi-LLM, multi-RAG powered chatbot using AWS CDK. It supports Amazon Bedrock, SageMaker, and external providers (Anthropic, OpenAI, HuggingFace, Meta, AI21, Cohere, Mistral) with a React web UI, workspaces for document indexing, and multiple vector database backends.

Use cases

• deploy a chatbot with RAG on AWS
• compare responses from multiple LLMs side by side
• index company documents for semantic search and retrieval
• experiment with Amazon Bedrock models in my own account
• build domain-specific chatbots with role-based access control
• run multimodal LLMs that answer questions about images
• set up a self-hosted ChatGPT alternative on AWS

When to choose

• you want a full-stack, production-ready RAG chatbot deployed on AWS with IaC
• you need to evaluate or serve multiple LLM providers (Bedrock, SageMaker, OpenAI, HuggingFace) behind one interface
• you require enterprise features like user roles, audit logging, and multiple vector store options (OpenSearch, Aurora pgvector, Kendra)
• you want a ready-made React UI plus API for chatbot interactions

When to avoid

• you need a simple local chatbot without cloud infrastructure or AWS costs
• your stack is not AWS-based (GCP, Azure, on-prem)
• you want a lightweight library to embed in an existing app rather than a deployable solution
• you cannot grant the AWS permissions required for CDK deployment of Bedrock, SageMaker, and vector stores

Facets

application · maturity active

chatbot rag llm-inference search-engine vector-database web-framework infrastructure-as-code auth self-hosted artificial-intelligence large-language-models chatbots cloud-computing web-development self-hosted cloud browser python aws-cdk amazon-bedrock sagemaker opensearch pgvector aurora kendra langchain multi-llm react-ui enterprise semantic-search huggingface claude retrieval-augmented-generation web-server typescript docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="aws-samples/aws-genai-llm-chatbot")