beichenzbc / Long-CLIP

[ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"
Apache License 2.0
620 stars 30 forks source link

the effect of different values of 'alpha' in loss #39

Closed YiguoHe closed 2 months ago

YiguoHe commented 3 months ago

Hello! The pseudo-code of your fine-tuning process shows that 'the total loss =loss fine + alpha * loss_coarse'. Have you ever studied the effect of different values of this 'alpha' parameter? thank you! Best wishes!

beichenzbc commented 3 months ago

We made some ablations on alpha. The result is similar for alpha=0.1 or alpha=0.2.

YiguoHe commented 3 months ago

We made some ablations on alpha. The result is similar for alpha=0.1 or alpha=0.2.

Thank you very much!