alexpghayes / modelling-in-r

an initial attempt to describe a grammar of modelling for r
https://alexpghayes.github.io/modelling-in-r/
3 stars 0 forks source link

Score method?? #20

Closed alexpghayes closed 6 years ago

alexpghayes commented 6 years ago

Scikit-Learn provides the score method to quickly assess the performance of a model on new data.

Is this a worthwhile thing to provide or too much from Python land and foreign?

Could extract a performance metric from the calibration object and use that to get consistent behavior.

alexpghayes commented 6 years ago

In retrospect, maybe this is broom::glance?

For a single model, it makes sense for broom::glance to return a single row of metrics. For a model family, would it be okay to return multiple rows, one for each set of hyperparameters?

alexpghayes commented 6 years ago

Moving to main text