NousResearch/atropos

Health v2 · maintenance only

Flags: archived

Adoption not part of the score

1350 stars · 397 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Atropos is a Python framework from Nous Research for building reinforcement learning environments that collect and evaluate LLM trajectories. It is now archived and no longer maintained.

Use cases

• train LLMs with reinforcement learning in custom environments
• collect model trajectories for RLHF-style training
• evaluate language models across diverse task environments
• build an RL gym for language models
• generate rollouts from LLMs for fine-tuning

When to choose

• you want to study or fork an LLM RL environments framework
• you need a reference design for trajectory collection environments
• you are doing research compatible with its existing environment implementations

When to avoid

• you need maintained software with bug fixes and security patches
• you want a production RL training pipeline with active support
• you need compatibility with the latest LLM training stacks

Facets

framework · maturity abandoned

reinforcement-learning llm-training machine-learning benchmarking reinforcement-learning large-language-models machine-learning artificial-intelligence python llm-rl-gym trajectory-collection rl-environments archived nous-research linux gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="NousResearch/atropos")