recommenders / rival

RiVal recommender system evaluation toolkit
rival.recommenders.net
Apache License 2.0
150 stars 40 forks source link

Precision values are not consistent with those from other ranking metrics #130

Open abellogin opened 6 years ago

abellogin commented 6 years ago

Some ranking metrics like MAP or Recall call to getNumberOfRelevantItems() method, returning 0 when a user does not have any relevant item (below a specified threshold). Whenever a 0 is returned, that user is ignored.

Since Precision does not use this method, the number of users considered when averaging each metric might be different.