NVlabs/prismer

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1309 stars · 76 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Official PyTorch implementation of Prismer, a data- and parameter-efficient vision-language model that ensembles pre-trained task-specific experts for multi-modal reasoning. It supports pre-training and fine-tuning on image captioning and VQA benchmarks using Huggingface Accelerate.

Use cases

• generate captions for images
• answer visual questions about images
• pretrain a vision-language model on image-text datasets
• fine-tune a multimodal model with fewer training samples
• reproduce the Prismer paper results
• run a vision-language model demo

When to choose

• you need a parameter-efficient vision-language model for captioning or VQA
• you want to experiment with multi-task expert ensembles
• you are reproducing or extending the Prismer research

When to avoid

• you need a production-ready multimodal API or chatbot
• you want a maintained general-purpose VLM with broad ecosystem support
• you need text-only language modeling

Facets

library · maturity maintenance

machine-learning deep-learning nlp llm-training artificial-intelligence machine-learning computer-vision python vision-language-model multi-task-learning image-captioning vqa pytorch research-code multimodal natural-language-processing gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="NVlabs/prismer")