mlr-org / mlr3

mlr3: Machine Learning in R - next generation
https://mlr3.mlr-org.com
GNU Lesser General Public License v3.0
906 stars 84 forks source link

Measure's check_prerequisites is ignored when calling `$score()` on a ResampleResult #1000

Open sebffischer opened 5 months ago

sebffischer commented 5 months ago

Maybe a misunderstanding from my side, but shouldn't I get a warning in the code below, as the regr.debug learner does not have the "selected_features" property?

library(mlr3)

rr = resample(tsk("mtcars"), lrn("regr.debug"), rsmp("holdout"), store_models = TRUE)
#> INFO  [17:13:24.525] [mlr3] Applying learner 'regr.debug' on task 'mtcars' (iter 1/1)
measure = msr("selected_features")
# is default anyway
measure$check_prerequisites = "warn"

rr$score(measure)
#>    task_id learner_id resampling_id iteration selected_features
#>     <char>     <char>        <char>     <int>             <num>
#> 1:  mtcars regr.debug       holdout         1                NA
#> Hidden columns: task, learner, resampling, prediction

Created on 2024-02-01 with reprex v2.0.2