comic / evalutils

evalutils helps users create extensions for grand-challenge.org

https://grand-challenge.org

MIT License

23 stars 9 forks source link

Test suite for algorithm containers #310

Closed kiranvaidhya closed 1 month ago

kiranvaidhya commented 3 years ago

When ./test.sh is called, the following error is encountered often:

Could not load expected_output.json using <evalutils.io.SimpleITKLoader object at 0x7f70508d6310>.

This suggests that evalutils is reading all the files from the automatically-generated test/ folder. expected_output.json should be ignored from the test/ folder, and there should be a way to build an automatic test suite.

jmsmkn commented 3 years ago

260

IshanMohanty commented 2 years ago

I'm facing the same problem while executing the test.sh script. This is for the MIDOG challenge 2022. Link to the MIDOG reference docker i refered: MIDOG_2022

jmsmkn commented 1 month ago

Templating will be removed from this repo as that has moved to https://github.com/DIAGNijmegen/rse-grand-challenge-forge.