Logo

VideoVerse: Does Your T2V Generator Have World Model Capability to Synthesize Videos?

Zeqing Wang1,4*, Xinyu Wei2,4*, Bairui Li2,4*, Zhen Guo2,4, Jinrui Zhang2,4, Hongyang Wei3,4, Keze Wang1†, Lei Zhang2,4†
1Sun Yat-sen University, 2Hong Kong Polytechnic University, 3Tsinghua University
4OPPO Research Institute

*Equal contribution †Corresponding Author

Abstract

The recent rapid advancement of Text-to-Video (T2V) generation technologies are engaging the trained models with more “world model” ability, making the existing benchmarks increasingly insufficient to evaluate state-of-the-art T2V models. First, current evaluation dimensions, such as per-frame aesthetic quality and temporal consistency, are no longer able to differentiate state-of-the-art T2V models. Second, event-level temporal causality—an essential property that differentiates videos from other modalities—remains largely unexplored. Third, existing benchmarks lack a systematic assessment of world knowledge, which are essential capabilities for building world models. To address these issues, we introduce VideoVerse, a comprehensive benchmark focusing on evaluating whether the current T2V model could understand complex temporal causality and world knowledge to synthesize videos. We collect representative videos across diverse domains and extract their event-level descriptions with inherent temporal causality, which are then rewritten into text-to-video prompts by independent annotators. For each prompt, we design ten evaluation dimensions covering dynamic and static properties, resulting in 300 prompts, 815 events, and 793 evaluation questions. Consequently, a human preference-aligned QA-based evaluation pipeline is developed by using modern vision-language models to systematically benchmark leading open- and closed-source T2V systems, revealing the current gap between T2V models and desired world modeling abilities.

Evolution Demos

VideoVerse Benchmark Leaderboard (Evaluated By Gemini2.5 Pro).

*Due to Sora's security review, some videos are not successfully generated. Despite this, Sora2 still achieved the SOTA performance.
Model Overall Dynamic Static
Event
Following
Camera
Control
Interaction Mechanics Material
Properties
Natural
Constra.
Common
Sense
Attr.
Correct.
2D
Layout
3D
Depth
Open-Source Models
CogVideoX1.5 (S)8944243632201336401776551
CogVideoX1.5 (L)8934263732221438371825847
SkyReels-V2 (S)939484433127931431606150
SkyReels-V2 (L)9685113736261236351686146
Wan2.1-14B9694964329261035451676751
Hunyuan8984463830241438421596047
OpenSora2.09894824729271448491816151
Wan2.2-A14B 1085 567 60 34 32 17 37 43 184 63 48
Closed-Source Models
Minimax-Hailuo 1203 623 75 38 30 22 54 52 187 68 54
Veo-3 1292 680 76 43 40 21 67 57 187 67 54
Sora2* 1299 689 72 51 42 21 64 63 177 66 54

Sub-question evaluation for Interaction, Mechanics and Material Properties in VideoVerse Benchmark Leaderboard (Evaluated By Gemini2.5 Pro).

Sub-question evaluation for Interaction, Mechanics, and Material Properties. Sora-2 maintains state-of-the-art performance, while closed-source models demonstrate superiority over open-source alternatives. Importantly, for models exhibiting similar overall scores in Tab. 1 (e.g., Hunyuan and CogVideoX1.5 (L)), the proposed fine-grained evaluation can differentiates their capabilities along these dimensions.
Model Overall Sub-Check Interaction Sub-Check Mechanics Sub-Check Material Properties Sub-Check
Open-Source Models
CogVideoX1.5 (S) 47.48% 50.87% 43.23% 49.48%
CogVideoX1.5 (L) 52.16% 55.22% 48.47% 53.61%
SkyReels-V2 (S) 53.96% 57.39% 58.52% 35.05%
SkyReels-V2 (L) 57.25% 55.22% 60.00% 55.67%
Wan2.1-14B 53.06% 50.87% 55.46% 52.58%
Hunyuan 49.91% 48.70% 48.67% 55.67%
OpenSora2.0 54.50% 55.22% 54.15% 53.61%
Wan2.2-A14B 61.69% 62.61% 62.88% 56.70%
Closed-Source Models
Minmax-Hailuo 65.11% 66.52% 62.01% 69.07%
Veo3 76.08% 78.70% 71.62% 80.41%
Sora-2* 76.26% 77.39% 75.11% 76.29%

BibTeX

@article{wang2025videoverse,
  title={VideoVerse: Does Your T2V Generator Have World Model Capability to Synthesize Videos?},
  author={Wang, Zeqing and Wei, Xinyu and Li, Bairui and Guo, Zhen and Zhang, Jinrui and Wei, Hongyang and Wang, Keze and Zhang, Lei},
  journal={arXiv preprint arXiv:2510.08398},
  year={2025}
}