How can I use "all_mpnet_base_v2" model for colbert indexing and searching?

stanford-futuredata / ColBERT

ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)

MIT License

2.67k stars 355 forks source link

How can I use "all_mpnet_base_v2" model for colbert indexing and searching? #315

Open ravi-kumar-1010 opened 4 months ago

ravi-kumar-1010 commented 4 months ago

I've used "raphaelsty/neural-cherche-colbert" model for reranking of results and the results are good. But it is slow , an Index made using this model would be a perfect solution.

Also if anyone could please help me in using all_mpnet_base_v2 transformer model as the base model for colbert indexing instead of bert_base_uncased, all_mpnet_base_v2 is just too good , it should be the default choice when making index and retrieving results.

Thanks