search

zhuhancheng / MetaIQA

126 stars 27 forks source link

Is the code for evaluation on synthetically distorted database available? #7

Open KevinTsaiii opened 4 years ago

KevinTsaiii commented 4 years ago

Hi Hancheng,

Thanks your great idea!

I'm trying to reproduce your amazing work but found that the code for the leave-one-distortion-out cross validation on TID2013 and KADID10K (Table 2 of the paper) are not included in this GitHub. I have several questions about the implementation details. How was the fine-tuning done for this experiment? How were the SROCCs reported on the paper selected? Are they the highest SROCCs among the training epochs? Or are they chosen at a fixed epoch?

I would appreciate it greatly if you can release the code. Thank you!

SSL92 commented 4 years ago

Same questions for me either, hope to see the reply! ; )

zhuhancheng commented 4 years ago

In this experiment, there is no need to fine-tune the model during testing.

The SROCCs reported in the Table 2 are the results of about 50 epochs model training.

SSL92 commented 4 years ago

I'm also wondering in the leave-one-distortion-out cross validation, is the model trained on both TID2013 and KADID10K databases, or trained on each database individually?

zhuhancheng commented 4 years ago

@SSL92

The model is trained on TID2013 or KADID10K database individually.

Danbinabo commented 3 years ago

What is the best score of sp for model validation?

xinruzhi commented 1 year ago

Hi Hancheng,

Thanks your great idea!

I'm trying to reproduce your amazing work but found that the code for the leave-one-distortion-out cross validation on TID2013 and KADID10K (Table 2 of the paper) are not included in this GitHub. I have several questions about the implementation details. How was the fine-tuning done for this experiment? How were the SROCCs reported on the paper selected? Are they the highest SROCCs among the training epochs? Or are they chosen at a fixed epoch?

I would appreciate it greatly if you can release the code. Thank you!

Hello, KevinTsaiii I wonder if your problem has been solved? If there is any result, can you share your thinking? thank you very much