deep-diver/LLM-As-Chatbot

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

3319 stars · 376 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A Python application that serves open-source instruction-tuned LLMs as chatbot services via a Gradio web UI or a Discord bot. It integrates the Ping Pong library for model-agnostic conversation management and supports internet search via Serper.

Use cases

• serve open source llm as a chatbot
• run a chatgpt-like ui for local llm models
• deploy an llm discord bot
• try different instruction-tuned models without rewriting prompt code
• self-host a chatbot with internet search
• compare multiple open source llm chatbots in one app

When to choose

• you want a ready-made web or Discord interface for open-source LLMs
• you want to switch between many fine-tuned models with per-model prompt handling handled for you
• you want a quick GPU-cloud deployment via Jarvislabs or dstack

When to avoid

• you need a production-grade, scalable chat API rather than a demo/UI app
• you only want raw model inference without a chat interface
• you need a framework actively updated with the newest LLM serving stacks

Facets

application · maturity maintenance

llm-inference chatbot chat-interface web-scraping large-language-models chatbots artificial-intelligence self-hosted python cloud self-hosted gradio discord-bot open-source-llms model-zoo internet-search instruction-tuned-models docker gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="deep-diver/LLM-As-Chatbot")