Xwin-LM/Xwin-LM

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1035 stars · 45 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Xwin-LM is an open-source project for LLM alignment technologies including supervised fine-tuning, reward models, reject sampling, and RLHF (PPO), built on Llama base models. It also releases fine-tuned models for general chat, math reasoning, and code generation that topped benchmarks like AlpacaEval and MATH.

Use cases

• train an LLM with RLHF and PPO
• fine-tune Llama with supervised fine-tuning
• train a reward model for alignment
• improve model math reasoning on GSM8K and MATH
• reproduce top AlpacaEval open-source chat model
• align a code generation model on HumanEval

When to choose

• you want a full alignment pipeline (SFT, RM, PPO) for Llama-based models
• you need reproducible RLHF training code with strong benchmark results
• you want proven fine-tuned checkpoints for chat, math, or code

When to avoid

• you need inference/serving rather than training
• you need a permissively licensed codebase - the repo has no license
• you need actively maintained tooling - releases have slowed since 2024

Facets

library · maturity maintenance

llm-training machine-learning deep-learning large-language-models machine-learning artificial-intelligence python rlhf alignment sft reward-model ppo llama reinforcement-learning huggingface gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Xwin-LM/Xwin-LM")