search

salesforce / ALBEF

Code for ALBEF: a new vision-language pre-training method
BSD 3-Clause "New" or "Revised" License
1.45k stars 193 forks source link

Momentum parameter #114

Closed upccpu closed 1 year ago

upccpu commented 1 year ago

Hey, i have a question. If we set the momentum parameter to 0.0, will it fail to converge like moco.

LiJunnan1992 commented 1 year ago

It will negatively impact the result, but I cannot tell the exact magnitude of the impact.

upccpu commented 1 year ago

@LiJunnan1992 Thanks for the the reply！