mlr-org / mlr3

mlr3: Machine Learning in R - next generation
https://mlr3.mlr-org.com
GNU Lesser General Public License v3.0
927 stars 86 forks source link

Resampling hash function should take hash of the task into account #932

Closed sebffischer closed 1 week ago

sebffischer commented 1 year ago

It can happen that custom resamplings have exactly the same instance but are instantiated on different tasks. I would still expect these resamplings to have a different hash.

This case actually happened to me (OpenML task splits seem to be deterministic, i.e. when tasks with the same number of observations are uploaded, the same task split is generated).