NVlabs/describe-anything

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1514 stars · 94 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Describe Anything Model (DAM) is a vision-language model that generates detailed descriptions of user-specified regions in images and videos, indicated via points, boxes, scribbles, or masks. The repository provides the model implementation, Gradio demos, SAM integration, and the DLC-Bench evaluation benchmark.

Use cases

• generate detailed captions for a specific region of an image
• describe objects in a video by annotating one frame
• caption image regions using masks from SAM
• evaluate localized captioning models with DLC-Bench
• build an app that describes clicked or boxed image areas
• run a local gradio demo for region-based image description

When to choose

• you need fine-grained, localized image or video descriptions rather than whole-image captions
• you want a research-grade vision-language model with a permissive Apache-2.0 license
• you need a benchmark for evaluating detailed localized captioning

When to avoid

• you only need simple whole-image captioning without region specification
• you lack a GPU or cannot run large multimodal models locally
• you need a production-ready hosted API rather than a research codebase

Facets

library · maturity active

machine-learning computer-vision image-processing video-processing nlp computer-vision large-language-models artificial-intelligence image-processing python windows vision-language-model region-captioning image-captioning video-captioning segmentation gradio-demo benchmark iccv-2025 multimodal video linux macos gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="NVlabs/describe-anything")