search

salesforce / ALBEF

Code for ALBEF: a new vision-language pre-training method
BSD 3-Clause "New" or "Revised" License
1.57k stars 199 forks source link

ITC & ITM & MLM weight distribution #130

Open HWH-2000 opened 1 year ago

HWH-2000 commented 1 year ago

Hi, I noticed that the weight ratio of these three losses is 1:1:1, is this the most appropriate ratio?

Thanks!