Vchitect/VBench

Health v2 · maintenance only

Adoption not part of the score

1747 stars · 132 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

VBench is a comprehensive benchmark suite for evaluating video generative models across hierarchical evaluation dimensions, with prompt suites, sampled videos, and automatic evaluation methods. It supports text-to-video and image-to-video evaluation and aligns with human preference annotations.

Use cases

• benchmark my text-to-video model
• compare video generation models on quality dimensions
• evaluate image-to-video generation
• find a leaderboard for video generation models
• measure trustworthiness of generative video models
• get automatic metrics for generated videos

When to choose

• you need fine-grained, objective evaluation of video generative models
• you want results aligned with human preference annotations
• you need a standardized prompt suite and evaluation pipeline for reproducible comparisons

When to avoid

• you need to generate videos rather than evaluate them
• your task is image-only generation evaluation
• you need a lightweight metric without GPU-heavy pipelines

Facets

library · maturity active

benchmarking machine-learning artificial-intelligence machine-learning python text-to-video video-generation aigc benchmark-suite evaluation-kit stable-diffusion evaluation video gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Vchitect/VBench")