search

lucmos / relreps

Relative representations can be leveraged to enable solving tasks regarding "latent communication": from zero-shot model stitching to latent space comparison between diverse settings.
https://openreview.net/forum?id=SrC-nwieGJ
MIT License
45 stars 5 forks source link

Question about model stitching #23

Open jihwanp opened 2 months ago

jihwanp commented 2 months ago

Hi, thanks for providing such a wonderful work.

I have a question about the mechanism of stitching models with relative represenation. When performing model stitching, if similarity vectors are created, are they normalized (with l2 norm) and communicated, or are they just connected?

Thanks