search

salesforce / ALBEF

Code for ALBEF: a new vision-language pre-training method
BSD 3-Clause "New" or "Revised" License
1.45k stars 193 forks source link

ITC & ITM & MLM weight distribution #130

Open HWH-2000 opened 11 months ago

HWH-2000 commented 11 months ago

Hi, I noticed that the weight ratio of these three losses is 1:1:1, is this the most appropriate ratio?

Thanks!