VQAssessment / FAST-VQA-and-FasterVQA

[ECCV2022, TPAMI2023] FAST-VQA, and its extended version FasterVQA.
https://www.ecva.net/papers/eccv_2022/papers_ECCV/html/1225_ECCV_2022_paper.php
Other
248 stars 25 forks source link

Why the output scores are weird like [-0.05591499]? #7

Closed Mmmmmmmag closed 2 years ago

Mmmmmmmag commented 2 years ago

Hi, I downloaded the fast_vqa_v0_3.pth and A001.mp4 as the input video, then ran the inference.py and fast_vqa_model.py, but with both of them the output scores are weird like [-0.05591499], so that cannot compute srocc with label score, for example, [80.232]. Is there anything wrong did I do...?

teowu commented 2 years ago

Hi, to compute SRCC/PLCC, more than two videos (for better evaluation, more than 50 is recommended) are needed.

Please try to add A002.mp4 or use the full LIVE-VQC instead.

Best, Haoning