search

usnistgov / trec_eval

Evaluation software used in the Text Retrieval Conference
232 stars 49 forks source link

Relevance level ignored when computing NDCG #35

Closed AmenRa closed 1 year ago

AmenRa commented 1 year ago

Hi,

I have noticed that the relevance level parameter -l<num> is ignored when computing NDCG.

Is this behavior intended?

Thank you,

Elias

isoboroff commented 1 year ago

Yes, although it should get documented. NDCG by default uses the relevance level as the gain value, and you can also set gains on the command line.