search

samedii / perceptor

Modular image generation library
Other
5 stars 1 forks source link

spherical loss for blip #25

Closed nikky4D closed 2 years ago

nikky4D commented 2 years ago

I noticed the use of the spherical loss in the BLIP files. What is the gain you get from this loss?

samedii commented 2 years ago

I haven't seen any obvious improvements from using spherical loss but it seems to be consensus to replace cosine similarity with spherical loss when doing CLIP guiding. I tried both and they behave very similarly.