dkozlov/awesome-knowledge-distillation resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

3903 stars · 516 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A curated awesome-list of research papers and resources on knowledge distillation, the technique of transferring knowledge from large teacher models to smaller student models. It covers foundational and recent papers on model compression, co-training, and distillation methods.

Use cases

• find papers on knowledge distillation
• learn about model compression techniques
• research teacher-student training methods
• survey deep learning distillation literature
• find resources for shrinking neural network models
• study dark knowledge and distillation theory

When to choose

• you need a curated reading list on knowledge distillation
• you are researching model compression or compact model training
• you want links to foundational distillation papers like Hinton's

When to avoid

• you need an implementation, not a paper list
• you want beginner tutorials with code examples

Facets

learning-resource · maturity active

machine-learning deep-learning documentation machine-learning deep-learning tutorials awesome-lists cross-platform awesome-list knowledge-distillation model-compression papers teacher-student

Member repositories

For agents

markdown · JSON · MCP: product_card(name="dkozlov/awesome-knowledge-distillation")