Collection and topic examples

osirrc / jig

Jig for the Open-Source IR Replicability Challenge (OSIRRC)

13 stars 3 forks source link

Collection and topic examples #40

Closed hscells closed 5 years ago

hscells commented 5 years ago

Can you please provide some documentation or examples of the file formats for the collections, and file formats for the topics? And will there be any arguments to the jig which specify the input file format of the collection/topics?

Thanks

ryan-clancy commented 5 years ago

The file formats are dependent on the collection, which right now are core17, core18, and robust04. These are in trecweb, trectext, or json format, here are some resources I was able to dig up:

core18
trectext / trecweb (see "Example Formats for input data files")
Java - trectext
Java - trecweb

topics: https://github.com/castorini/Anserini/tree/master/src/main/resources/topics-and-qrels

In terms of arguments, that's being tracked in https://github.com/osirrc2019/jig/issues/24.