camenduru/text-generation-webui-colab

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

2091 stars · 356 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A collection of Google Colab notebooks that launch the oobabooga text-generation-webui with a Gradio interface for running large language models like Vicuna, Koala, and Alpaca on free Colab GPUs. Each notebook targets a specific pre-quantized (GPTQ 4-bit) model checkpoint.

Use cases

• run a local LLM chat UI without owning a GPU
• try vicuna-13b in the browser via Colab
• test quantized GPTQ 4-bit models for free
• spin up a gradio web UI for llama models
• experiment with open-source chat models like koala and wizardlm
• host a temporary LLM chatbot in a notebook

When to choose

• you want to run open-source LLMs with zero local hardware using free Colab GPUs
• you need a quick browser-based chat UI for a specific GPTQ-quantized model
• you're prototyping with 2023-era models like Vicuna, Koala, or Alpaca

When to avoid

• you need a production or self-hosted deployment with persistent uptime
• you want the latest models or active updates - the project is in maintenance with 2023-era model support
• you prefer running models locally with your own GPU via the upstream text-generation-webui

Facets

application · maturity maintenance

llm-inference chatbot gui large-language-models artificial-intelligence chatbots python cloud colab gradio notebook gptq 4bit-quantization vicuna llama alpaca free-gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="camenduru/text-generation-webui-colab")