microsoft/rStar

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1425 stars · 132 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Microsoft's research repository for rStar2-Agent, a 14B math reasoning model trained with agentic reinforcement learning that autonomously uses coding tools. It includes the GRPO-RoC RL algorithm, scalable RL training infrastructure, and model inference/evaluation code.

Use cases

• train a small LLM with agentic reinforcement learning for math reasoning
• reproduce the rStar2-Agent 14B model training pipeline
• run a math reasoning model that calls Python tools to verify answers
• implement GRPO with resample-on-correct rollout strategy
• evaluate small LLMs on competition-level math benchmarks
• set up high-throughput RL rollout infrastructure on limited GPUs

When to choose

• you are researching agentic RL for LLM reasoning
• you want to train or fine-tune small models to use coding tools during reasoning
• you need a reference implementation of GRPO-RoC for tool-calling agents

When to avoid

• you need a production-ready chatbot or inference server
• you lack multi-GPU resources for RL training
• you want a general-purpose agent framework rather than a research codebase

Facets

library · maturity active

machine-learning llm-training agent-framework llm-inference large-language-models reinforcement-learning artificial-intelligence python agentic-reasoning reinforcement-learning grpo math-reasoning tool-calling research-code microsoft ai-agents gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="microsoft/rStar")