VideoVerse: Does Your T2V Generator Have World Model Capability to Synthesize Videos?
Abstract
The recent rapid advancement of Text-to-Video (T2V) generation technologies are engaging the trained models with more “world model” ability, making the existing benchmarks increasingly insufficient to evaluate state-of-the-art T2V models. First, current evaluation dimensions, such as per-frame aesthetic quality and temporal consistency, are no longer able to differentiate state-of-the-art T2V models. Second, event-level temporal causality—an essential property that differentiates videos from other modalities—remains largely unexplored. Third, existing benchmarks lack a systematic assessment of world knowledge, which are essential capabilities for building world models. To address these issues, we introduce VideoVerse, a comprehensive benchmark focusing on evaluating whether the current T2V model could understand complex temporal causality and world knowledge to synthesize videos. We collect representative videos across diverse domains and extract their event-level descriptions with inherent temporal causality, which are then rewritten into text-to-video prompts by independent annotators. For each prompt, we design ten evaluation dimensions covering dynamic and static properties, resulting in 300 prompts, 815 events, and 793 evaluation questions. Consequently, a human preference-aligned QA-based evaluation pipeline is developed by using modern vision-language models to systematically benchmark leading open- and closed-source T2V systems, revealing the current gap between T2V models and desired world modeling abilities.
Evolution Demos
VideoVerse Benchmark Leaderboard (Evaluated By Gemini2.5 Pro).
*Due to Sora's security review, some videos are not successfully generated. Despite this, Sora2 still achieved the SOTA performance.| Model | Overall | Dynamic | Static | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Event Following |
Camera Control |
Interaction | Mechanics | Material Properties |
Natural Constra. |
Common Sense |
Attr. Correct. |
2D Layout |
3D Depth |
||
| Open-Source Models | |||||||||||
| CogVideoX1.5 (S) | 894 | 424 | 36 | 32 | 20 | 13 | 36 | 40 | 177 | 65 | 51 |
| CogVideoX1.5 (L) | 893 | 426 | 37 | 32 | 22 | 14 | 38 | 37 | 182 | 58 | 47 |
| SkyReels-V2 (S) | 939 | 484 | 43 | 31 | 27 | 9 | 31 | 43 | 160 | 61 | 50 |
| SkyReels-V2 (L) | 968 | 511 | 37 | 36 | 26 | 12 | 36 | 35 | 168 | 61 | 46 |
| Wan2.1-14B | 969 | 496 | 43 | 29 | 26 | 10 | 35 | 45 | 167 | 67 | 51 |
| Hunyuan | 898 | 446 | 38 | 30 | 24 | 14 | 38 | 42 | 159 | 60 | 47 |
| OpenSora2.0 | 989 | 482 | 47 | 29 | 27 | 14 | 48 | 49 | 181 | 61 | 51 |
| Wan2.2-A14B | 1085 | 567 | 60 | 34 | 32 | 17 | 37 | 43 | 184 | 63 | 48 |
| Closed-Source Models | |||||||||||
| Minimax-Hailuo | 1203 | 623 | 75 | 38 | 30 | 22 | 54 | 52 | 187 | 68 | 54 |
| Veo-3 | 1292 | 680 | 76 | 43 | 40 | 21 | 67 | 57 | 187 | 67 | 54 |
| Sora2* | 1299 | 689 | 72 | 51 | 42 | 21 | 64 | 63 | 177 | 66 | 54 |
Sub-question evaluation for Interaction, Mechanics and Material Properties in VideoVerse Benchmark Leaderboard (Evaluated By Gemini2.5 Pro).
| Model | Overall Sub-Check | Interaction Sub-Check | Mechanics Sub-Check | Material Properties Sub-Check |
|---|---|---|---|---|
| Open-Source Models | ||||
| CogVideoX1.5 (S) | 47.48% | 50.87% | 43.23% | 49.48% |
| CogVideoX1.5 (L) | 52.16% | 55.22% | 48.47% | 53.61% |
| SkyReels-V2 (S) | 53.96% | 57.39% | 58.52% | 35.05% |
| SkyReels-V2 (L) | 57.25% | 55.22% | 60.00% | 55.67% |
| Wan2.1-14B | 53.06% | 50.87% | 55.46% | 52.58% |
| Hunyuan | 49.91% | 48.70% | 48.67% | 55.67% |
| OpenSora2.0 | 54.50% | 55.22% | 54.15% | 53.61% |
| Wan2.2-A14B | 61.69% | 62.61% | 62.88% | 56.70% |
| Closed-Source Models | ||||
| Minmax-Hailuo | 65.11% | 66.52% | 62.01% | 69.07% |
| Veo3 | 76.08% | 78.70% | 71.62% | 80.41% |
| Sora-2* | 76.26% | 77.39% | 75.11% | 76.29% |
BibTeX
@article{wang2025videoverse,
title={VideoVerse: Does Your T2V Generator Have World Model Capability to Synthesize Videos?},
author={Wang, Zeqing and Wei, Xinyu and Li, Bairui and Guo, Zhen and Zhang, Jinrui and Wei, Hongyang and Wang, Keze and Zhang, Lei},
journal={arXiv preprint arXiv:2510.08398},
year={2025}
}