DE0CH / irace-tuning3

0 stars 0 forks source link

bound behaviour for irace's target-runner #5

Open DE0CH opened 10 months ago

DE0CH commented 10 months ago

Current Logic

check the [bound] in irace's target-runner. If the surrogate predicts larger than bound, return bound + 1, else return the surrogate prediction

For context, irace's target-runner command line args

<id.configuration> <id.instance> <seed> <instance> [bound] <configuration>

Future Task

A better solution would be to check if "prediction>=bound" and "status=timeout" (the surrogate returns some extra info, I think we looked into it previously). This is to avoid cases where the prediction is exactly as bound, i.e., cplex solves the instance within exactly [bound] time, but I think it's unlikely, so we may be able to skip that.

This is not needed for now, we can just skip it and add it in later if needed.

ndangtt commented 8 months ago

@DE0CH: based on Manuel's reply: https://github.com/MLopez-Ibanez/irace/issues/66#issuecomment-1976648118

we should return bound + 0.1 in the target-runner (for both fields: solution quality and runtime) if the surrogate returns timeout.