JULIELab / trec-pm

Support code and resources for participation at the TREC Precision Medicine Track (TREC-PM)
http://trec-cds.appspot.com
MIT License
9 stars 2 forks source link

Experiment Registry #29

Closed michelole closed 5 years ago

michelole commented 5 years ago

tl;dr: Experiments should be reusable.

Currently, submitted ("production-ready") experiments are described only in a main method on either PubmedExperimenter or ClinicalTrialsExperiments. However, there's a need to reuse them in other places, e.g. KeywordExperimenter, BoostExperimenter, GoogleSheetsSyncer, and even TrecPM1718Lit*Crossval.

We could at least move the experiment builder calls to a static class and reuse them. In the future, we could move this description to a JSON file (see also https://github.com/bst-mug/trec-2017-precision-medicine/issues/53).