Closed chenerg closed 3 months ago
Hi, thanks for your interest in our work! If the generated JSON does not contain any results, VBench may not be able to find the corresponding video possibly due to an incorrect sampling video name. The solution can be referenced in this issue.
When testing the temporal_flickering
dimension, there should be videos with corresponding formatted names in your ./demo/videos
folder. For example, with the first prompt In a still frame, a stop sign
, there should be [In a still frame, a stop sign-0.mp4
,..., In a still frame, a stop sign-4.mp4
].
Forget this issue, it's the same with my latest issue, same question and the answer is write new Vbench_full.json
for your own data.
I run the following
vbench evaluate --videos_path ./demo/videos --dimension temporal_flickering
and get the following
It seems it cannot find the videos under the directory