capreolus-ir / capreolus

A toolkit for end-to-end neural ad hoc retrieval
https://capreolus.ai
Apache License 2.0
95 stars 32 forks source link

Antique #61

Closed crystina-z closed 4 years ago

crystina-z commented 4 years ago
  1. support different relevance level for different metric at evaluation stage
  2. add relevance level for training data preparation
  3. add drmmtks reranker (reference here), which is used in antique

TODO:

  1. configurable relevance level for dev evaluation?