pliang279/awesome-multimodal-ml resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

6926 stars · 900 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A curated reading list of research papers, surveys, tutorials, and datasets on multimodal machine learning, maintained by Paul Liang at CMU. It organizes resources across core areas like representation, fusion, alignment, and pretraining, plus applications spanning vision, language, speech, robotics, and healthcare.

Use cases

• find papers on multimodal fusion and alignment
• get started learning multimodal machine learning
• find datasets for vision-language research
• prepare a course or tutorial on multimodal ML
• survey recent trends in multimodal pretraining
• find reading material for a research literature review

When to choose

• you need a curated, organized entry point into multimodal ML research
• you are a student or researcher building a literature review
• you want links to tutorials, courses, and survey papers

When to avoid

• you need runnable code or a software library
• you need an exhaustive, automatically updated paper index
• you are looking for non-research practical tooling

Facets

learning-resource · maturity active

machine-learning deep-learning nlp computer-vision speech-recognition machine-learning artificial-intelligence computer-vision speech-processing tutorials awesome-lists cross-platform awesome-list reading-list multimodal-learning research-papers representation-learning natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="pliang279/awesome-multimodal-ml")