search

airsplay / lxmert

PyTorch code for EMNLP 2019 paper "LXMERT: Learning Cross-Modality Encoder Representations from Transformers".
MIT License
923 stars 157 forks source link

validation score of VQA #106

Closed Yucheng-Han closed 3 years ago

Yucheng-Han commented 3 years ago

I downloaded the pre-trained model, and fine-tuned the VQA tasks. But I found while fine-tuning, the validation scores of VQA decreases in the first 4 epochs. Is this normal? I think it is hard to believe that the validation scores decrease but test scores increase...

Yucheng-Han commented 3 years ago

I am using PyTorch 1.7, and I would check whether PyTorch version is the cause. But if so, I think maybe the mask has something to do with the results.

Yucheng-Han commented 3 years ago

seems to be my own reason