eureka-research/Eureka

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

3189 stars · 300 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Eureka is a research library from NVIDIA that uses coding LLMs like GPT-4 to automatically generate reward functions for reinforcement learning via evolutionary in-context optimization. It outperforms human-engineered rewards across 29 RL environments and enables gradient-free RLHF.

Use cases

• generate reward functions for RL training automatically
• train dexterous robot manipulation skills like pen spinning
• apply LLMs to reinforcement learning reward design
• implement gradient-free RLHF with human feedback
• run evolutionary optimization over reward code with GPT-4

When to choose

• you need reward functions for IsaacGym robotics RL environments
• you want to research LLM-driven reward design or RLHF
• you lack expert reward engineering for complex manipulation tasks

When to avoid

• you need a production system rather than research code
• your RL setup is not based on IsaacGym or the bundled environments
• you cannot access GPT-4-class LLM APIs

Facets

library · maturity maintenance

machine-learning llm-inference agent-framework simulation reinforcement-learning robotics large-language-models artificial-intelligence python reward-design reinforcement-learning llm-code-generation rlhf isaacgym research-code pytorch research linux gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="eureka-research/Eureka")