search

Vchitect / VBench

[CVPR2024 Highlight] VBench - We Evaluate Video Generation
https://vchitect.github.io/VBench-project/
Apache License 2.0
374 stars 14 forks source link

how to calculate the total score of all metircs #9

Closed xinyuxiao closed 2 months ago

xinyuxiao commented 5 months ago

thank you very much!

yinanhe commented 5 months ago

Thank you for your interest in VBench. You can refer to the calculation scheme at Get Total Score to calculate the standardized scores and weighted scores of different dimensions, obtaining quality scores and semantic scores. Then, sum them up to get the total score.

Alternatively, you can upload evaluation results for all dimensions, which will be calculated by the Leaderboard. We will add this feature directly into the code of VBench as soon as possible.

xinyuxiao commented 5 months ago

ok，thanks

jiaxiangc commented 1 week ago

Thank you for your interest in VBench. You can refer to the calculation scheme at Get Total Score to calculate the standardized scores and weighted scores of different dimensions, obtaining quality scores and semantic scores. Then, sum them up to get the total score.

Alternatively, you can upload evaluation results for all dimensions, which will be calculated by the Leaderboard. We will add this feature directly into the code of VBench as soon as possible.

Hi, do you add this feature in the code now？ Thanks