thunlp/PLMpapers resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

3359 stars · 431 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A curated reading list of must-read papers on pre-trained language models (PLMs), with a family diagram showing relationships between models like BERT, GPT, and ELMo. It also links to open PLMs released by the THUNLP group and a survey paper.

Use cases

• find must-read papers on pre-trained language models
• learn the history and evolution of BERT and GPT style models
• get an overview of PLM research for a literature review
• find a diagram of how pre-trained language models relate to each other
• prepare a presentation on transformer language models
• find survey papers on pre-trained models in NLP

When to choose

• you want a curated, organized paper list on PLMs rather than searching manually
• you need a visual map of the PLM model family for study or slides
• you are starting research or coursework on pre-trained language models

When to avoid

• you need runnable code or model implementations rather than paper references
• you need up-to-date coverage of recent LLM papers, as the list was last updated in 2022
• you want tutorials or courses rather than academic papers

Facets

learning-resource · maturity maintenance

nlp machine-learning documentation large-language-models tutorials awesome-lists cross-platform paper-list pre-trained-language-models survey reading-list transformers natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="thunlp/PLMpapers")