search

osirrc / jig

Jig for the Open-Source IR Replicability Challenge (OSIRRC)
13 stars 3 forks source link

Make topic and qrels parameter consistent #56

Closed lintool closed 5 years ago

lintool commented 5 years ago

Currently, we have:

python run.py search \
    --repo osirrc2019/anserini \
    --tag latest \
    --collection [name] \
    --topic [topic_file_name] \
    --output /path/to/output \
    --qrels $(pwd)/qrels/[qrels]

The inconsistency between --topic (which assumes a file name under topics/) and --qrels (which can be any arbitrary path) is annoying. Can we change both to paths, so that:

python run.py search \
    --repo osirrc2019/anserini \
    --tag latest \
    --collection [name] \
    --topic /path/to/topics \
    --output /path/to/output \
    --qrels /path/to/qrels
ryan-clancy commented 5 years ago

This change was merged into dev and is part of the current PR (https://github.com/osirrc2019/jig/pull/57), going to close this one.