Question about Temperature Parameter

salesforce / ALBEF

Code for ALBEF: a new vision-language pre-training method

BSD 3-Clause "New" or "Revised" License

1.57k stars 199 forks source link

Question about Temperature Parameter #97

Open m2man opened 2 years ago

m2man commented 2 years ago

Thank you for your research and the code. I just have 1 small question. What is the value of the temperature parameter after fine-tuning on the Flickr30k dataset? I am retraining the model but the value of this parameter keeps decreasing.