search

IIGROUP / MANIQA

[CVPRW 2022] MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment
Apache License 2.0
307 stars 36 forks source link

a question about released checkpoint #25

Closed YaoShunyu19 closed 1 year ago

YaoShunyu19 commented 1 year ago

Hi! In Table 3 of the paper, MANIQA-s achieves 0.686/0.707 on the validation set, and 0.667/0.702 on the test set. Are these two sets of results are obtained from testing the same model checkpoint? I tried to test and submit using the checkpoint and test script you released, and achieved 0.69/0.71 on the validation set but only 0.66/0.68 on the test set. So I want to know if the results are tested from the same parameters. Thanks!

TianheWu commented 1 year ago

The test sets results are obtained from the ensemble-model.

TianheWu commented 1 year ago

@YaoShunyu19 I will release other datasets checkpoints!