# camenduru/text-generation-webui-colab

A colab gradio web UI for running Large Language Models

Repository: https://github.com/camenduru/text-generation-webui-colab
Canonical: https://ross.abutalabs.com/products/text-generation-webui-colab
Language: Jupyter Notebook
License: Unlicense
License Family: permissive
Topics: colab, colab-notebook, colaboratory, gradio, llama, llm, alpaca, koala, lama, llamas, vicuna
Last push: 2023-12-22T18:52:49+00:00

## Health v2 (maintenance only)
Score: 30/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 0, release rhythm 35, longevity 88
- inputs: {"age_days": 1243, "days_push": 985, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_releases
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 2091, forks 356 (observed 2026-08-28T04:06:12.506079+00:00)

## What it is
A collection of Google Colab notebooks that launch the oobabooga text-generation-webui with a Gradio interface for running large language models like Vicuna, Koala, and Alpaca on free Colab GPUs. Each notebook targets a specific pre-quantized (GPTQ 4-bit) model checkpoint.

## Use cases
- run a local LLM chat UI without owning a GPU
- try vicuna-13b in the browser via Colab
- test quantized GPTQ 4-bit models for free
- spin up a gradio web UI for llama models
- experiment with open-source chat models like koala and wizardlm
- host a temporary LLM chatbot in a notebook

## When to choose
- you want to run open-source LLMs with zero local hardware using free Colab GPUs
- you need a quick browser-based chat UI for a specific GPTQ-quantized model
- you're prototyping with 2023-era models like Vicuna, Koala, or Alpaca

## When to avoid
- you need a production or self-hosted deployment with persistent uptime
- you want the latest models or active updates - the project is in maintenance with 2023-era model support
- you prefer running models locally with your own GPU via the upstream text-generation-webui

## Facets
- artifact type: application
- maturity: maintenance
- function: llm-inference, chatbot, gui
- domain: large-language-models, artificial-intelligence, chatbots
- platform: python, cloud
- tags: colab, gradio, notebook, gptq, 4bit-quantization, vicuna, llama, alpaca, free-gpu

## Member repositories
- camenduru/text-generation-webui-colab (main) score 30

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:06:12.506079+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T02:55:32.545743+00:00, confidence not recorded.
  - readme: https://github.com/camenduru/text-generation-webui-colab (fetched 2026-08-28T04:06:12.506079+00:00, sha 551e91b3a681)
- Data as of 2026-08-30T08:39:29.467469+00:00.