# hiyouga/ChatGLM-Efficient-Tuning

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

Repository: https://github.com/hiyouga/ChatGLM-Efficient-Tuning
Canonical: https://ross.abutalabs.com/products/chatglm-efficient-tuning
Language: Python
License: Apache-2.0
License Family: permissive
Topics: chatglm, chatgpt, fine-tuning, lora, alpaca, peft, huggingface, language-model, transformers, pytorch, rlhf, chatglm2, qlora
Archived: true
Last push: 2023-10-12T14:06:32+00:00

## Health v2 (maintenance only)
Score: 10/100 (v2, computed 2026-09-02T17:46:02.011165+00:00)
- activity 0, release rhythm 8, longevity 88
- inputs: {"age_days": 1243, "days_push": 1056, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: archived
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 3713, forks 462 (observed 2026-08-28T04:08:15.280911+00:00)

## What it is
A Python framework for parameter-efficient fine-tuning (LoRA, QLoRA, P-Tuning, RLHF) of the ChatGLM-6B and ChatGLM2-6B language models using Hugging Face PEFT and Transformers. It includes a Web UI for training and evaluation and an OpenAI-compatible demo API, but the project is no longer maintained in favor of LLaMA-Factory.

## Use cases
- fine-tune ChatGLM-6B with LoRA on custom instruction data
- run QLoRA 4-bit training on a single consumer GPU
- train ChatGLM with RLHF
- merge LoRA weights back into the base model
- serve a fine-tuned ChatGLM model behind an OpenAI-compatible API
- fine-tune a Chinese chat model without full-model training

## When to choose
- you specifically need to fine-tune ChatGLM-6B or ChatGLM2-6B and want a ready-made PEFT pipeline
- you want a historical reference implementation of LoRA/QLoRA/RLHF tuning for GLM models

## When to avoid
- you want active maintenance or support for newer models - use LLaMA-Factory instead
- you need to fine-tune non-GLM language models
- you want production-grade training infrastructure

## Facets
- artifact type: library
- maturity: abandoned
- function: llm-training, machine-learning, sdk
- domain: large-language-models, machine-learning
- platform: python
- tags: chatglm, peft, lora, qlora, fine-tuning, rlhf, huggingface, transformers, superseded-by-llama-factory, natural-language-processing, gpu, linux

## Member repositories
- hiyouga/ChatGLM-Efficient-Tuning (main) score 10

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:08:15.280911+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T18:30:52.915058+00:00, confidence not recorded.
  - readme: https://github.com/hiyouga/ChatGLM-Efficient-Tuning (fetched 2026-08-28T04:08:15.280911+00:00, sha 602163cf66e9)
- Data as of 2026-08-30T08:39:29.467469+00:00.