unrealcv/unrealcv

Health v2 · maintenance only

Adoption not part of the score

2219 stars · 463 forks observed · 2026-10-02

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

UnrealCV is an open-source Unreal Engine plugin that connects computer vision research to virtual worlds by exposing a command API and Python client for camera control, object manipulation, and ground-truth image capture. It supports UE4/UE5, RPC communication with PyTorch/TensorFlow, and ships with 100+ ready-made UnrealZoo environments for embodied AI.

Use cases

• generate synthetic image datasets with ground truth annotations
• train embodied AI agents in virtual environments
• test object detection models like Faster-RCNN on rendered images
• capture optical flow and depth from Unreal Engine scenes
• control Unreal Engine cameras and objects from Python
• build virtual worlds for computer vision research

When to choose

• you need photorealistic synthetic data with perfect ground truth labels
• you want to train or evaluate embodied AI agents in Unreal Engine worlds
• you need a Python API to interact with UE scenes without learning the engine
• you want ready-made virtual environments via UnrealZoo

When to avoid

• you need lightweight simulation without a game engine dependency
• your project targets engines other than Unreal Engine
• you only need simple 2D image augmentation rather than 3D rendering

Facets

plugin · maturity active

simulation computer-vision image-processing machine-learning plugin-system sdk computer-vision simulation machine-learning artificial-intelligence windows python cpp cross-platform unreal-engine synthetic-data embodied-ai ue4 ue5 virtual-worlds ground-truth-annotation mcp game-development linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="unrealcv/unrealcv")