Ross ROSS = Recommend OSS · open-source software intelligence for agents

zihangdai/xlnet

XLNet: Generalized Autoregressive Pretraining for Language Understanding observed · 2026-08-28

github.com/zihangdai/xlnet · Python · Apache-2.0 (permissive) observed · 2026-08-28

Health v2 · maintenance only

32/100

  • Activity 0
  • Release rhythm 35
  • Longevity 100

Flags: no_releases

How is this computed?

round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-02. Adoption (stars, forks) is never an input.

  • gap_med: n/a
  • age_days: 2632
  • days_rel: n/a
  • days_push: 1193
  • n_releases_24m: 0

Full methodology

Adoption not part of the score

6188 stars · 1149 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

XLNet is a generalized autoregressive pretraining method for language representation learning, built on Transformer-XL. This repo provides TensorFlow code and pretrained XLNet-Base/Large models for NLP tasks like question answering, classification, and GLUE benchmarks.

Use cases

  • fine-tune a pretrained language model for question answering
  • run sentiment analysis with XLNet
  • reproduce GLUE benchmark results
  • pretrain a transformer language model on custom text
  • compare XLNet vs BERT on NLP tasks

When to choose

  • you need a strong 2019-era pretrained model with long-context handling
  • you work in TensorFlow and want XLNet checkpoints

When to avoid

  • you want actively maintained code or PyTorch/HuggingFace integration
  • you need the latest state-of-the-art LLMs

Facets

library · maturity maintenance

machine-learning nlp deep-learning deep-learning python pretrained-language-model transformer xlnet research natural-language-processing tensorflow

1 source

Member repositories

RepositoryRoleHealth v2
zihangdai/xlnetmain32

For agents

markdown · JSON · MCP: product_card(name="zihangdai/xlnet")

Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem