NLeSC / mcfly

A deep learning tool for time series classification and regression
Apache License 2.0
363 stars 82 forks source link

Adapt defaults for evaluation metrics #306

Closed maltelueken closed 1 year ago

maltelueken commented 1 year ago

Currently, the default metric is 'accuracy' which is only appropriate for classification. We should also add a default for regression, i.e., 'mean_squared_error'.

Note that the kNN model only evaluates on accuracy (or mean squared error), the user cannot supply a custom metric here.

cwmeijer commented 1 year ago

Disable KNN model comparison if the metric is not MSE or accuracy. (without a warning as not to confuse users about knns they didn't ask for)