Do we support late interaction models like ColBERT? Or Sparse models like BM25?

StarlightSearch / EmbedAnything

A minimalist yet highly performant, lightweight, lightning fast, multisource, multimodal and local embedding solution, built in rust.

Apache License 2.0

308 stars 25 forks source link

Do we support late interaction models like ColBERT? Or Sparse models like BM25? #90

Open S1LV3RJ1NX opened 2 weeks ago

akshayballal95 commented 2 weeks ago

ColBert is in the works and will be added soon.Current model that is late interaction based is ColPali.

For Sparse models you can use the Splade models as shown in the readme. These models will give you sparse vectors which you can then use for BM25 search.