JULIELab / trec-pm

Support code and resources for participation at the TREC Precision Medicine Track (TREC-PM)
http://trec-cds.appspot.com
MIT License
9 stars 2 forks source link

RankLib may not like unjudged documents #60

Closed michelole closed 5 years ago

michelole commented 5 years ago

Since #24 , we now have a single DocumentList that might contain -1 relevance assessments. However, getQrelDocuments used to access the traditional qrels, which don't exist anymore.

Either (a) add a method to convert the inner DocumentList to traditional qrels and call it before getQrelDocuments; or (b) add back getSampleQrelDocuments, make it return the full list and return the behavior of getQrelDocuments (probably by converting using (a)).