Add archive access methods

mlr-org / mlr3tuning

Hyperparameter optimization package of the mlr3 ecosystem

https://mlr3tuning.mlr-org.com/

GNU Lesser General Public License v3.0

53 stars 5 forks source link

Add archive access methods #271

Closed be-marc closed 3 years ago

be-marc commented 4 years ago

Query BenchmarkResult with ArchiveTuning methods via i-th evaluation or uhash
Retrieve inner tuning result of nested resampling with inner_tuning_results function.

mllg commented 3 years ago

Two points to consider w.r.t inner_tuning_result():

would get_inner_tuning_result() or extract_tuning_extract() (something that starts with a verb) be a better name?
Should this be a S3 generic with methods for ResampleResult and BenchmarkResult?

be-marc commented 3 years ago

would get_inner_tuning_result() or extract_tuning_extract() (something that starts with a verb) be a better name?

Yes and without the word tuning since nested resampling can be also used for feature selection. extract_inner_result()? But maybe it will be easier to just implement another function in mlr3fselect.

be-marc commented 3 years ago

Should this be a S3 generic with methods for ResampleResult and BenchmarkResult?

In case of a BenchmarkResult the function would return a data.table with an extra column indicating the experiment?