microsoft/X-Decoder

Health v2 · maintenance only

Adoption not part of the score

1345 stars · 161 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Official PyTorch implementation of X-Decoder, a generalized decoding model from CVPR 2023 that unifies pixel-level segmentation, image-level understanding, and text-language tasks in one vision-language model. It includes demo, training, and evaluation code with pretrained checkpoints.

Use cases

• segment objects in images with text prompts
• run referring expression segmentation
• caption images with a vision-language model
• evaluate panoptic and semantic segmentation models
• fine-tune a unified pixel-image-language decoder
• try a multimodal segmentation demo on HuggingFace

When to choose

• you need a single model handling segmentation, retrieval, and captioning
• you want official pretrained checkpoints and evaluation benchmarks
• you are reproducing CVPR 2023 vision-language research

When to avoid

• you need a lightweight production segmentation service
• you lack GPU hardware for inference or training
• you need actively maintained code with recent updates

Facets

library · maturity maintenance

machine-learning computer-vision image-processing nlp deep-learning computer-vision machine-learning image-processing deep-learning python vision-language-model segmentation image-captioning research-code cvpr-2023 multimodal natural-language-processing linux gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="microsoft/X-Decoder")