search

cfoster0 / CLAP

Contrastive Language-Audio Pretraining
BSD 3-Clause "New" or "Revised" License
87 stars 4 forks source link

Learned temperature should clip #28

Open cfoster0 opened 3 years ago

cfoster0 commented 3 years ago

As in the CLIP paper, we should clip the contrastive loss temperature so that the logits are not scaled by more than 100. Should be relatively easy.