Use base model or sentence transformer

bclavie / RAGatouille

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

Apache License 2.0

2.45k stars 173 forks source link

Use base model or sentence transformer #225

Open achibb opened 1 week ago

achibb commented 1 week ago

Hi there I wanted to Train a Colbert however I was wondering whether I should use a sentence transformers model or only a pre trained one.

Also, is it possible to train with matryoshka embeddings?