search

Vchitect / VBench

[CVPR2024 Highlight] VBench - We Evaluate Video Generation
https://vchitect.github.io/VBench-project/
Apache License 2.0
604 stars 29 forks source link

prompt&video #79

Open zwx211 opened 1 month ago

zwx211 commented 1 month ago

Great work, I would like to know does the name of the video have to be the same as the prompt If the prompt is exceptionally long and exceeds the maximum value of the video name how should it be executed?

NattapolChan commented 1 month ago

The vbench standard prompt in here will not exceed the maximum value of file name length. But in case you have your own prompt and that is longer than 255, you can use these commands:

  1. ... --videos_path <path/to/video.mp4> --mode=custom_input --prompt <your prompt>
  2. ... --videos_path <path/to/video_dir> --mode=custom_input --prompt_file <path/to/json file that map filenames to prompts>
zwx211 commented 1 month ago

Thank you for your reply, but I have a new problem, I tried to run it and found that there are some metrics with negative scores, like temporal_style, is this as expected and what does the negative number mean? image

ziqihuangg commented 1 month ago

Which dimension is it?