jxmorris12 / vec2text

utilities for decoding deep representations (like sentence embeddings) back to text
Other
673 stars 75 forks source link

Support other embeddings #48

Open robvanvolt opened 4 months ago

robvanvolt commented 4 months ago

You say: "Currently we only support models for inverting OpenAI text-embedding-ada-002 embeddings but are hoping to add more soon. (We can provide the GTR inverters used in the paper upon request.)".

I want to use a different embeddings model (in my case, BAAI/bge-m3 - using 1024 dimensions) - does the training procedure work the same?

Or would I need to adjust it / use different base models?

And could you share your code for training step 0?