Closed berndbischl closed 4 years ago
Should be done now: I added a few more lines to only select the last few benchmark results of the size mu of the previous stage. To verify I used your assert from above. Commit: https://github.com/mlr-org/mlr3hyperband/commit/e3c75ff751b08e95a2a8359a205b68bf93e1b426
If i add the assert in this code, we see that produced indices are complety wrong
the problem is here
the indices are computed on the complete historical archive not the active_configs!
unfortunately this happens: R produces rows of NAs, for the "too large indices", then we later filter out the NAs with transpose from paradox. (we end up with an empty list, which runs the learner then in ints defaults)
how do we test against this: we actually should only solve this issue https://github.com/mlr-org/mlr3tuning/issues/228
then we would see it automatically