search

DE0CH / irace-tuning3

0 stars 0 forks source link

Check correctness of our call to EPM #1

Open DE0CH opened 1 year ago

DE0CH commented 1 year ago

Continue of https://github.com/DE0CH/irace-tuning/issues/8.

DE0CH commented 1 year ago

for runtime scenarios, check if EPM function returns log-transformation or the original values: it does but most of the time is smaller than the correct value. Need to make more plots of other runs to see if the pattern continues.

for runtime scenarios, check if EPM function return PAR10 or the original values for timeout runs: not sure yet. Line 130 of surrogate_model.py might be the clue https://github.com/DE0CH/irace-tuning3/blob/847d30d485618539ea483cf8a012912b70eed3db/epm/epm/surrogates/surrogate_model.py#L130. Need to check what it actual means

DE0CH commented 1 year ago

This code might be wrong, but it is guarded by an if statement that is not reached for our use cases