salesforce/awd-lstm-lm

Health v2 · maintenance only

Flags: archived

Adoption not part of the score

1989 stars · 484 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A PyTorch toolkit for training LSTM and QRNN language models, implementing Salesforce Research's AWD-LSTM papers. It supports word-level and character-level language modeling on standard datasets like Penn Treebank and WikiText.

Use cases

• train a word-level language model on WikiText-2
• reproduce AWD-LSTM results from the paper
• train a character-level language model on enwik8
• compare LSTM vs QRNN language model performance
• apply continuous cache pointer to a finetuned language model
• learn regularized LSTM language modeling in PyTorch

When to choose

• you need to reproduce or build on the AWD-LSTM/QRNN language model papers
• you want a proven baseline for word or character-level language modeling on PTB or WikiText
• you want a faster QRNN alternative to cuDNN LSTM

When to avoid

• you need transformer-based language models or modern LLM tooling
• you require support for recent PyTorch versions (code targets PyTorch 0.4)
• you want a maintained production library rather than research code

Facets

library · maturity maintenance

machine-learning deep-learning nlp deep-learning machine-learning python lstm qrnn language-model pytorch research-code awd-lstm natural-language-processing gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="salesforce/awd-lstm-lm")