Fix T5 model embedding generation

weaviate / t2v-transformers-models

This is the repo for the container that holds the models for the text2vec-transformers module

BSD 3-Clause "New" or "Revised" License

39 stars 27 forks source link

Fix T5 model embedding generation #67

Closed antas-marcin closed 10 months ago

antas-marcin commented 11 months ago

This PR adds support for SentenceTransformer library for embeddings generation.

This PR also fixes a bug which resulted in T5 models generating embeddings with different dimensions then actually this model was able to generate. This bug was fixed by introducing SentenceTransformer library for embeddings generation instead of the original implementation.