openai/universe

Health v2 · maintenance only

Flags: archived

Adoption not part of the score

7494 stars · 954 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Universe is an OpenAI library that wraps games, websites, and other applications into OpenAI Gym environments so AI agents can be trained and evaluated on them via keyboard/mouse events and screen pixels. It packages programs into Docker containers and exposes over 1,000 environments, many with reward signals for reinforcement learning.

Use cases

• train reinforcement learning agents on games and browser tasks
• turn any desktop application into a Gym environment
• benchmark AI general intelligence across diverse environments
• run Atari and Flash game environments over VNC
• evaluate agents on World of Bits browser tasks

When to choose

• you need the original Universe VNC-based environments for reproducing historical research
• you want to wrap arbitrary GUI applications as Gym environments

When to avoid

• starting new reinforcement learning projects - use openai/retro instead
• you need maintained software or modern Python support
• you need Windows support or Python beyond 2.7/3.5

Facets

library · maturity abandoned

reinforcement-learning simulation machine-learning testing reinforcement-learning artificial-intelligence gaming-tools machine-learning python openai-gym vnc reinforcement-learning-environments deprecated docker-environments agent-training linux macos docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="openai/universe")