search

osirrc / jig

Jig for the Open-Source IR Replicability Challenge (OSIRRC)
13 stars 3 forks source link

interact hook should take collections/topics/qrels flags #114

Open cmacdonald opened 5 years ago

cmacdonald commented 5 years ago

If I want to repeat a run in my interact hook, its a bit difficult as the topics/qrels arent mounted. Similarly with which collections are in use.

arjenpdevries commented 5 years ago

I agree it would be good if interact mode would mount topics and qrels directories.

Maybe we need an environment variable for the information about collections that were created? (E.g., store the JSON version of the parameters?)

chriskamphuis commented 5 years ago

It could be useful if they are already mounted during the prepare step, then they are available for both search and interact. Saving the image after the search step would also solve this issue, but then the interact can only use the topics/qrels after search.

cmacdonald commented 5 years ago

@Chriskamphuis I think the idea of the images by @r-clancy is that they can handle multiple collections in the same container image. hence why they are not mounted once in prepare?

chriskamphuis commented 5 years ago

@cmacdonald Sure, we also support indexing multiple collection in one container. But in a similar fashion it also could be possible to support multiple topic/qrel files right? But I agree that if it is necessary to specify the files multiple times it is less elegant than your solution.