cvlab-columbia/viper

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1716 stars · 131 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

ViperGPT is a research codebase that composes vision-and-language models with code generated by large language models (GPT-3.5/GPT-4) to perform visual inference and reasoning over images and videos. It provides a Python API and notebooks for generating and executing visual reasoning programs.

Use cases

• answer questions about images using LLM-generated code
• perform visual reasoning over videos
• compose pretrained vision models into pipelines via LLM prompts
• run visual question answering on image datasets
• reproduce ViperGPT paper experiments
• prototype multimodal reasoning agents

When to choose

• you want to reproduce or extend the ViperGPT paper's approach
• you need LLM-driven composition of vision models for image/video reasoning
• you're researching program synthesis for visual inference

When to avoid

• you need a production-ready, actively maintained product
• you can't run CUDA/GPU vision models locally
• you want a safe sandboxed agent framework without executing LLM-generated code
• you need extensive support for newer chat models beyond GPT-3.5/GPT-4

Facets

library · maturity maintenance

llm-inference computer-vision agent-framework prompt-engineering machine-learning artificial-intelligence computer-vision large-language-models python viper-gpt visual-reasoning code-generation research-code paper-code jupyter-notebook openai gpt-4 glip image-captioning blip depth-estimation visual-question-answering ai-agents research linux gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="cvlab-columbia/viper")