alan-turing-institute / autoemulate

emulate simulations easily
MIT License
18 stars 3 forks source link

validate with held-out set after hyperparameter search #118

Closed mastoffel closed 9 months ago

mastoffel commented 9 months ago

After hyperparameter search, the default results metric for model selection should be prediction on a held-out dataset, rather than average cv-score.