search

FlagOpen / FlagEmbedding

Retrieval and Retrieval-augmented LLMs
MIT License
6.58k stars 468 forks source link

something is wrong with hard neg mine #779

Open QuangTQV opened 3 months ago

QuangTQV commented 3 months ago

I tried hard neg mining, but when running on 2 different gpu's (namely t4 and a100), t4 only took a few seconds while a100 took 20 minutes, and their hard neg results were also completely different.

staoxiao commented 3 months ago

I think this error is caused by faiss. You can use faiss on CPU instead of GPU

QuangTQV commented 3 months ago

I think this error is caused by faiss. You can use faiss on CPU instead of GPU

My data has 7000 queries and 17 keys, how long should it take to mine hard negatives (because I still don't know if running in 10s or running in 20 minutes is wrong)