Cannot reproduce the best result

yanxinzju / CSS-VQA

Counterfactual Samples Synthesizing for Robust VQA

76 stars 18 forks source link

Cannot reproduce the best result #5

Closed NLOuYang closed 4 years ago

NLOuYang commented 4 years ago

I followed all the Readme and use the default hyperparameters, which should give me the best results. However, I can only get about 52(yes/no:82, num:50 , other:31) on the test set, which is far lower than the reported results. Can you give me some advice on how to fix the gap? Thx!

yanxinzju commented 4 years ago

This is very confusing, please make sure your model and parameters are set correctly