search

yuweijiang / HGL-pytorch

Code for the model "Heterogeneous Graph Learning for Visual Commonsense Reasoning (NeurlPS 2019)"
MIT License
46 stars 13 forks source link

Issue of the pre-trained checkpoints #5

Closed yekeren closed 4 years ago

yekeren commented 4 years ago

Dear author, thanks for sharing your work. I tried to reproduce your results on the validation set. However, the checkpoint you provided ([https://drive.google.com/drive/folders/1ux9YG3sRmUVvsCt1nHwlB5Egw43NDsK1?usp=sharing]) only achieves 63.7 accuracies on the validation set, which is the same as the original R2C model. I wonder if you mistakingly uploaded wrong checkpoint files.

Answer acc: 0.637 Rationale acc: 0.705 Joint acc: 0.452

yekeren commented 4 years ago

My bad. I made a stupid mistake.

Answer acc: 0.691 Rationale acc: 0.705 Joint acc: 0.490