New benchmarks and searcher fit refactor

capreolus-ir / capreolus

A toolkit for end-to-end neural ad hoc retrieval

https://capreolus.ai

Apache License 2.0

95 stars 32 forks source link

New benchmarks and searcher fit refactor #135

Closed andrewyates closed 3 years ago

andrewyates commented 3 years ago

ir_datasets support
New benchmarks and supporting collections: GOV2, CDS, Genomics
Robust04 description benchmark
Searcher fit refactor
add Benchmark as extractor dependency
load Anserini topics from tsv
TrecRun
PARADE configs with increased passages for robust04 titles and descriptions

lgtm-com[bot] commented 3 years ago

This pull request introduces 18 alerts when merging 8173f8b28237b49ddd643aaa1f4cda26b9e25bdb into f6dd66d021e4f7ce0765c545fe3726cf54331a57 - view on LGTM.com

new alerts:

12 for Conflicting attributes in base classes
6 for Unused import

lgtm-com[bot] commented 3 years ago

This pull request introduces 12 alerts when merging 6754e9eab928454bb0efa00b78e077a612f3308f into f6dd66d021e4f7ce0765c545fe3726cf54331a57 - view on LGTM.com

new alerts:

12 for Conflicting attributes in base classes