salesforce/ALBEF

Health v2 · maintenance only

Flags: no_releases archived

Adoption not part of the score

1755 stars · 220 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Official PyTorch implementation of ALBEF, a vision-and-language pre-training method that aligns image and text representations before fusing them, with momentum distillation. It supports pre-training on custom image-text datasets and fine-tuning for retrieval, VQA, NLVR2, SNLI-VE, and visual grounding tasks.

Use cases

• pre-train a vision-language model on my own image-caption dataset
• build an image-text retrieval system for MSCOCO or Flickr30k
• fine-tune a multimodal model for visual question answering
• perform visual grounding to locate image regions from text descriptions
• learn contrastive vision-language representation learning methods
• visualize which image regions correspond to words in a caption

When to choose

• you need the original ALBEF research code with released checkpoints for reproducibility
• you want to pre-train or fine-tune a vision-language model on custom image-text data
• you need strong baselines for image-text retrieval, VQA, or visual grounding research

When to avoid

• you want a maintained, production-ready multimodal library - use LAVIS instead, which now integrates ALBEF
• you need text-only or image-only models without cross-modal capabilities
• you lack GPU resources, since pre-training requires multiple A100 GPUs

Facets

library · maturity maintenance

machine-learning deep-learning nlp image-processing rag machine-learning computer-vision artificial-intelligence python vision-language contrastive-learning pre-training momentum-distillation pytorch multimodal image-text-retrieval visual-grounding vqa research-code natural-language-processing gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="salesforce/ALBEF")