illuin-tech / colpali

The code used to train and run inference with the ColPali architecture.
https://huggingface.co/vidore
MIT License
1.21k stars 106 forks source link

Use of temperature param #148

Closed rishabhm12 closed 9 hours ago

rishabhm12 commented 4 days ago

Hey folks, Have we tested the use of temperature param? I don't see it in the loss function nor in the colbert's official implementation.

rishabhm12 commented 12 hours ago

@tonywu71 @Jonathan-Adly

tonywu71 commented 9 hours ago

Hi @rishabhm12, the temperature parameter wasn't tested as part of our paper, and I haven't experimented with it so far.