search

FlagOpen / FlagEmbedding

Retrieval and Retrieval-augmented LLMs
MIT License
7.25k stars 526 forks source link

How to mine hard neg for reranker? #784

Open QuangTQV opened 5 months ago

QuangTQV commented 5 months ago

I just saw the script that mine the hard negative for the bi encoder

staoxiao commented 5 months ago

@Lahaina936 , the script of negative mining: https://github.com/FlagOpen/FlagEmbedding/tree/master/examples/finetune#hard-negatives can be used for both the embedding model and reranker model.