salesforce/decaNLP

Health v2 · maintenance only

Flags: no_releases archived

Adoption not part of the score

2337 stars · 459 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

decaNLP is a PyTorch research framework and benchmark for the Natural Language Decathlon, a multitask NLP challenge spanning ten tasks from question answering to semantic parsing. It casts every task as question answering and provides the Multitask Question Answering Network (MQAN) for joint, single-task, transfer, and zero-shot learning experiments.

Use cases

• train a single model on ten NLP tasks simultaneously
• run multitask question answering experiments
• benchmark models on SQuAD, IWSLT, CNN/DM, MNLI and other NLP datasets
• evaluate zero-shot transfer across NLP tasks
• adapt a question answering model to new NLP tasks
• reproduce multitask learning research results

When to choose

• you are researching multitask or transfer learning in NLP
• you want a unified question-answering formulation across many NLP tasks
• you need a benchmark harness with leaderboards for ten NLP datasets

When to avoid

• you need state-of-the-art results on modern LLM benchmarks
• you want a production NLP service rather than a research framework
• you need actively maintained tooling with recent model architectures

Facets

framework · maturity maintenance

machine-learning nlp deep-learning benchmarking deep-learning machine-learning python multitask-learning question-answering research dataset-benchmark mqan natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="salesforce/decaNLP")