Word embedding and sentence embedding

[xiachenrui]

Hi, thanks for your great work !

Could you please tell me if there are some relationship between sentence embedding and word embedding ?

For example, if it is meaningful to use sentence embedding add/minus word embedding? (This is feasible in the text-image embedding space)

Best!

[gaotianyu1350]

Hi,

In some sentence embedding model (for example, average of Glove word embeddings), there is a straightforward connection between sentence and word embeddings. However, in our case where sentence embeddings are from a transformer model output, we expect them to be different.

[xiachenrui]

Thanks for your reply 😁