nf-core / deepmodeloptim

Stochastic Testing and Input Manipulation for Unbiased Learning Systems
https://nf-co.re/deepmodeloptim
MIT License
23 stars 9 forks source link

[feat] report robustness metric for the models #101

Closed suzannejin closed 6 months ago

suzannejin commented 7 months ago

Hypothesis: a model is robust if it works overally good with differently transformed data.

Problem: some datasets might be very similar, so one model might be averagely good because of the fact that it works well on those very similar datasets.