koaning / embetter

just a bunch of useful embeddings
https://koaning.github.io/embetter/
MIT License
469 stars 15 forks source link

Add `TextPrefixer` #91

Open koaning opened 9 months ago

koaning commented 9 months ago

Some components may benefit from prefixing the text that goes in.

https://www.sbert.net/examples/training/matryoshka/README.html#inference

Not 100% sure if it's best to have a component for that or if we'd rather add this functionality to the sentence encoder directly.