# dkozlov/awesome-knowledge-distillation

Awesome Knowledge Distillation

Repository: https://github.com/dkozlov/awesome-knowledge-distillation
Canonical: https://ross.abutalabs.com/products/awesome-knowledge-distillation
License: Apache-2.0
License Family: permissive
Topics: knowledge-distillation, knowledge-transfer, teacher-student, co-training, distillation, distillation-model, model-distillation, knowldge-distillation, kd, model-compression, deep-learning
Last push: 2026-05-25T23:16:02+00:00

## Health v2 (maintenance only)
Score: 70/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 84, release rhythm 35, longevity 100
- inputs: {"age_days": 3473, "days_push": 100, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_releases
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 3903, forks 516 (observed 2026-08-28T04:08:28.652187+00:00)

## What it is
A curated awesome-list of research papers and resources on knowledge distillation, the technique of transferring knowledge from large teacher models to smaller student models. It covers foundational and recent papers on model compression, co-training, and distillation methods.

## Use cases
- find papers on knowledge distillation
- learn about model compression techniques
- research teacher-student training methods
- survey deep learning distillation literature
- find resources for shrinking neural network models
- study dark knowledge and distillation theory

## When to choose
- you need a curated reading list on knowledge distillation
- you are researching model compression or compact model training
- you want links to foundational distillation papers like Hinton's

## When to avoid
- you need an implementation, not a paper list
- you want beginner tutorials with code examples

## Facets
- artifact type: learning-resource
- maturity: active
- function: machine-learning, deep-learning, documentation
- domain: machine-learning, deep-learning, tutorials, awesome-lists
- platform: cross-platform
- tags: awesome-list, knowledge-distillation, model-compression, papers, teacher-student

## Member repositories
- dkozlov/awesome-knowledge-distillation (main) score 70

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:08:28.652187+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T18:25:09.440690+00:00, confidence not recorded.
  - readme: https://github.com/dkozlov/awesome-knowledge-distillation (fetched 2026-08-28T04:08:28.652187+00:00, sha 3abab927d9e3)
- Data as of 2026-08-30T08:39:29.467469+00:00.