zai-org/CogVLM

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

6744 stars · 451 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

CogVLM is an open-source visual language model (17B) combining a vision encoder with a pretrained language model for image understanding and multi-turn dialogue, with CogAgent (18B) extending it for high-resolution GUI agent tasks. The repo provides model checkpoints, CLI and web demo inference, OpenAI Vision-compatible serving, and finetuning code.

Use cases

• answer questions about images with a vision-language model
• generate captions for images
• build a GUI automation agent that understands screenshots
• finetune a multimodal VLM on custom data
• serve an OpenAI Vision-compatible image chat API
• run visual question answering on documents and charts

When to choose

• you need an open-source VLM for image understanding or VQA
• you want to build a GUI agent that operates from screenshots
• you need a self-hosted multimodal model with finetuning support

When to avoid

• you lack GPU hardware (multi-billion-parameter models need significant VRAM)
• you need the newest multimodal models rather than a 2024-era release
• you want a lightweight CPU-only image captioning solution

Facets

library · maturity maintenance

machine-learning deep-learning llm-inference computer-vision nlp artificial-intelligence large-language-models computer-vision python visual-language-model multimodal vlm image-understanding gui-agent cogagent pretrained-model vqa image-captioning natural-language-processing gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="zai-org/CogVLM")