FG-AI4H-TG-Symptom / fgai4h-tg-symptom-assessment-mmvb-backend

A backend of a minimal minimal viable benchmark designed and developed by the members of the sub-group (topic group) “Symptom assessment”, which is the part of the ITU focus group “Artificial Intelligence for Health”
6 stars 4 forks source link

Run health checks inside benchmark #85

Open neopostmodern opened 4 years ago

neopostmodern commented 4 years ago

a health check should be performed with all AI implementations before a case is sent out in the future some sort of optional semi-interactive logic should be added, such that benchmark administrators can decide whether to pause, abort or continue (without the failing AI implementation) the benchmarking session