FlagOpen / FlagEmbedding

Retrieval and Retrieval-augmented LLMs
MIT License
6.63k stars 476 forks source link

compute colbert score in batch #956

Open davidbetancur8 opened 1 month ago

davidbetancur8 commented 1 month ago

Is it possible to compute the colbert score for the m3 model for more than one pair at the time? currently seems very inneficient

davidbetancur8 commented 1 month ago

Also looks there is a difference between the colbert_score in https://github.com/FlagOpen/FlagEmbedding/blob/master/FlagEmbedding/BGE_M3/modeling.py and in https://github.com/FlagOpen/FlagEmbedding/blob/master/FlagEmbedding/bge_m3.py