Vchitect / VBench

[CVPR2024 Highlight] VBench - We Evaluate Video Generation
https://vchitect.github.io/VBench-project/
Apache License 2.0
374 stars 14 forks source link

About the size and number of frames #23

Closed BeachWang closed 1 month ago

BeachWang commented 2 months ago

Hi,

Dose Vbench have limitation on the video size and the number of frames for generated videos? What is the setting of the video size and the number of frames in your evaluation shown in Table 1 in your paper?

ziqihuangg commented 2 months ago

Hi, thanks for this question. Please see the model settings here: https://github.com/Vchitect/VBench/tree/master/sampled_videos#model-setting, and these video lengths and frame counts (several seconds) are all supported by VBench.

For very long videos (minute-level), we don't support the evaluation yet, but we are working on a new VBench edition to include this capability. Please stay tuned for the update.

ziqihuangg commented 2 months ago

For models we evaluated, please find their detailed settings here: https://github.com/Vchitect/VBench/tree/master/sampled_videos#what-are-the-details-of-the-video-generation-models

ziqihuangg commented 1 month ago

Hi, we're closing this issue as it appears your questions have been addressed. However, feel free to open a new issue or reopen this one, if you have further questions or if anything else comes up related to this issue.