namisan/mt-dnn

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

2257 stars · 408 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A PyTorch library implementing Multi-Task Deep Neural Networks (MT-DNN) for natural language understanding, based on Microsoft research papers. It supports multi-task fine-tuning of pretrained language models like BERT, with techniques such as knowledge distillation, adversarial training (ALUM), and SMART regularization.

Use cases

• fine-tune BERT on multiple NLU tasks jointly
• train a model for GLUE benchmark tasks
• do multi-task learning for text classification and NER
• apply adversarial training to language model fine-tuning
• use knowledge distillation to improve NLU models
• implement machine reading comprehension models
• reproduce ACL/NAACL research on robust NLU fine-tuning

When to choose

• you want multi-task fine-tuning of pretrained transformers in PyTorch
• you need research-grade implementations of ALUM, SMART, or R-Drop style regularization
• you are reproducing the MT-DNN papers or GLUE-style experiments

When to avoid

• you need pretrained model checkpoints - public model hosting was discontinued
• you want a maintained production NLP toolkit - development is largely inactive
• you need support for modern Python versions - the code targets older Python 3.6 environments

Facets

library · maturity maintenance

machine-learning nlp deep-learning machine-learning deep-learning python multi-task-learning bert pytorch knowledge-distillation adversarial-training text-classification named-entity-recognition question-answering natural-language-processing linux docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="namisan/mt-dnn")