search

jxmorris12 / vec2text

utilities for decoding deep representations (like sentence embeddings) back to text
Other
673 stars 75 forks source link

LLAMA-2 inversion models #41

Open mihirp1998 opened 5 months ago

mihirp1998 commented 5 months ago

Hi Jack,

Thanks for the great work. Do u guys plan to release the inversion models that were trained to invert LLAMA-2 7b embeddings?

It would be very helpful for me, if you could.

jxmorris12 commented 5 months ago

That would be great! Although there are many different types of embeddings one could extract from LLAMA with different places and pooling strategies, all which have potentially different bases. What are you using these for?