airaria/TextBrewer

Health v2 · maintenance only

Adoption not part of the score

1708 stars · 243 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

TextBrewer is a PyTorch-based knowledge distillation toolkit for NLP models. It provides an easy-to-use framework implementing state-of-the-art distillation methods to compress models, improving inference speed and reducing memory usage with minimal performance loss.

Use cases

• distill a large BERT model into a smaller one
• compress transformer models for faster inference
• reduce memory usage of NLP models for deployment
• experiment with knowledge distillation techniques
• shrink pretrained language models for edge devices
• speed up NLP model inference

When to choose

• you need to compress large transformer models like BERT into smaller student models
• you want a ready-made distillation framework with PyTorch and HuggingFace Transformers
• you need faster inference and lower memory for NLP deployment

When to avoid

• you need distillation for computer vision or non-NLP domains
• you want actively developed tooling with frequent updates
• you need model pruning rather than distillation (consider TextPruner instead)

Facets

library · maturity maintenance

machine-learning llm-training machine-learning deep-learning python knowledge-distillation model-compression pytorch bert transformers natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="airaria/TextBrewer")