Open NikitaKlichko opened 3 months ago
Some models, such as amberoad/bert-multilingual-passage-reranking-msmarco
, provide scores in pairs: <not-relevant-score, relevant-score>. However, the current HuggingFaceCrossEncoder
does not account for this pair of scores. To address this, I have created a pull request that modifies the encoder to consider only the relevant score.
Please refer to this comment for more details.
Thanks for fix
@NikitaKlichko please keep the issue opened until PR is merged.
Checked other resources
Example Code
Error Message and Stack Trace (if applicable)
Description
Incorrect passing of scores for sorting. The classifier returns logits for the dissimilarity and similarity between the query and the document. You need to add an exception and take the middle value if the model produces two scores, otherwise leave it as isю This is a bug?
System Info
System Information
Package Information