google-research-datasets/wit resource

Health v2 · maintenance only

Flags: no_releases archived no_license

Adoption not part of the score

1113 stars · 47 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

WIT (Wikipedia-based Image Text) is a large multimodal multilingual dataset of 37.6 million image-text pairs with 11.5 million unique images across 108 Wikipedia languages. It is intended for pretraining and evaluating multimodal machine learning models such as vision-language models.

Use cases

• pretrain a vision-language model on image-text pairs
• find a large multilingual image captioning dataset
• train a CLIP-style multimodal model
• evaluate cross-lingual image-text retrieval
• get image-text training data covering 100+ languages
• benchmark multimodal models on real-world entities

When to choose

• you need a massive, publicly available image-text corpus for multimodal pretraining
• you need multilingual coverage across 108 languages
• you want page-level metadata and contextual information alongside image-text pairs

When to avoid

• you need a small, curated dataset for quick experiments
• you require commercial licensing beyond CC BY-SA 3.0 terms
• you need actively maintained tooling rather than a static dataset release

Facets

dataset · maturity maintenance

machine-learning nlp image-processing machine-learning computer-vision large-language-models python cross-platform multimodal multilingual image-text wikipedia pretraining vision-language dataset natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="google-research-datasets/wit")