search

bst-mug / trec-2017-precision-medicine

imi_mug support code and resources from our participation at the TREC 2017 Precision Medicine Track
https://trec.nist.gov/pubs/trec26/trec2017.html
MIT License
7 stars 2 forks source link

Fixing tests #150

Closed michelole closed 7 years ago

michelole commented 7 years ago

@plopezgarcia It seems the Lexigram API is providing different results for (at least) this test case. Is there any versioned endpoint that we can access so that our TREC results are reproducible (even with outdated, possibly wrong, synonym expansion)?

plopezgarcia commented 7 years ago

@michelole the API is versioned, we always used v1: https://github.com/bst-mug/trec2017/blob/master/src/main/java/at/medunigraz/imi/bst/lexigram/GraphUtils.java#L72

As far as I know nothing has changed in the Lexigram API.

Can you describe exactly what's the problem you are having? I can't find any.

Note that the test that you have overwritten has a different input string, so results cannot be compared.