search

evalcrafter / EvalCrafter

[CVPR 2024] EvalCrafter: Benchmarking and Evaluating Large Video Generation Models
http://evalcrafter.github.io
145 stars 7 forks source link

Motion quality and Visual quality columns are swapped #8

Closed zeinsh closed 3 months ago

zeinsh commented 7 months ago

Hi! I tried to reproduce the final scores in your benchmark using eval_from_metrics.py starting from raw metrics.

I noticed that you swapped the numbers in motion quality and visual quality in https://evalcrafter.github.io and https://huggingface.co/spaces/AILab-CVC/EvalCrafter.

Am I correct?

Yaofang-Liu commented 7 months ago

Yes, you're correct. It's our mistake. Many thanks for pointing out the problem! We will fix this right away.