google-research/albert

Health v2 · maintenance only

Flags: no_releases archived

Adoption not part of the score

3278 stars · 576 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Official TensorFlow implementation and pretrained checkpoints of ALBERT, a lite version of BERT for self-supervised learning of language representations. It provides model code, training scripts, and TF-Hub models in multiple sizes and languages including Chinese.

Use cases

• fine-tune a lightweight BERT-style model on GLUE tasks
• download pretrained ALBERT checkpoints for question answering
• train a language representation model with fewer parameters
• fine-tune ALBERT on SQuAD for extractive question answering
• use Chinese pretrained language models for NLP tasks
• run a colab tutorial for GLUE fine-tuning

When to choose

• you need parameter-efficient pretrained transformer checkpoints in TensorFlow 1.x
• you want strong NLP baselines like SQuAD, MNLI, or RACE fine-tuning
• you need Chinese BERT-style pretrained models

When to avoid

• you need PyTorch or modern Hugging Face ecosystem integration
• you require active maintenance or recent TensorFlow 2.x support
• you want the latest state-of-the-art language models rather than a 2019-era architecture

Facets

library · maturity maintenance

machine-learning nlp llm-training deep-learning machine-learning deep-learning python bert language-models tensorflow pretrained-models transfer-learning google-research natural-language-processing linux gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="google-research/albert")