Vision-CAIR/MiniGPT-4

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

25627 stars · 2868 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Official code for MiniGPT-4 and MiniGPT-v2, vision-language models that align a frozen visual encoder with a frozen LLM (Vicuna) via a single projection layer. It enables multimodal chat capabilities like detailed image description, visual question answering, and grounded image-text generation.

Use cases

• generate detailed descriptions of images with an open-source model
• build a visual chatbot that answers questions about images
• run multimodal vision-language research experiments
• caption images using a GPT-4-like open model
• fine-tune a vision-language model on custom image-text data
• create websites or stories from handwritten drafts and images

When to choose

• you want an open-source, computationally efficient GPT-4-style multimodal model
• you need a research baseline for vision-language multi-task learning
• you want to fine-tune only a small projection layer instead of a full LLM
• you need reproducible code from a published paper with pretrained checkpoints

When to avoid

• you need a production-grade, actively maintained multimodal model
• you lack a GPU or cannot run large language models locally
• you want the latest multimodal capabilities rather than a 2023-era research model
• you need commercial licensing beyond BSD-3-Clause terms for model weights

Facets

library · maturity maintenance

machine-learning deep-learning llm-inference llm-training image-processing nlp artificial-intelligence large-language-models computer-vision deep-learning machine-learning python vision-language-model multimodal image-captioning visual-question-answering research-code vicuna gradio-demo gpu linux docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Vision-CAIR/MiniGPT-4")