monarch-initiative / pheval

A framework for empirical evaluation of phenotype matching and prioritisation
https://monarch-initiative.github.io/pheval/
Apache License 2.0
12 stars 1 forks source link

Iterate over corpus directory and check for corresponding results when benchmarking #331

Closed yaseminbridges closed 4 months ago

yaseminbridges commented 4 months ago

Currently in the benchmarking process, the results present in the PhEval processed results directory are iterated and the corresponding phenopacket is found this way - this should be swapped as some tools fail on cases and so no output is produced. This allows fair analysis as then we can assess based on the tool's capability on a whole corpus instead on those that it could run out of that corpus