bojone/bert4keras

Health v2 · maintenance only

Adoption not part of the score

5415 stars · 919 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A lightweight, clean reimplementation of BERT and other transformer models (RoBERTa, ALBERT, T5, GPT, ELECTRA, NEZHA) for Keras/tf.keras. It supports loading pretrained weights, finetuning, and pretraining from scratch with TPU/multi-GPU support.

Use cases

• finetune bert on keras
• load pretrained transformer weights in keras
• pretrain a language model from scratch
• build seq2seq models with attention masks
• use chinese pretrained models like roberta or electra
• implement custom transformer models in keras

When to choose

• you want a simple, hackable keras implementation of transformers for finetuning or research
• you need to load Chinese pretrained model weights (RoBERTa-wwm, ELECTRA, NEZHA) in keras
• you prefer lightweight code over Hugging Face's larger ecosystem
• you are on legacy TensorFlow 1.x / Keras 2.x stacks

When to avoid

• you need modern PyTorch or the latest Hugging Face Transformers ecosystem
• you use recent TensorFlow 2.x features or Keras 3
• you need production-grade maintained tooling with broad community support

Facets

library · maturity maintenance

machine-learning deep-learning nlp llm-training deep-learning large-language-models python keras bert transformers pretrained-models finetuning tensorflow natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="bojone/bert4keras")