Open DE0CH opened 10 months ago
@DE0CH: based on Manuel's reply: https://github.com/MLopez-Ibanez/irace/issues/66#issuecomment-1976648118
we should return bound + 0.1
in the target-runner (for both fields: solution quality and runtime) if the surrogate returns timeout.
Current Logic
check the
[bound]
in irace's target-runner. If the surrogate predicts larger than bound, return bound + 1, else return the surrogate predictionFor context, irace's target-runner command line args
Future Task
A better solution would be to check if "prediction>=bound" and "status=timeout" (the surrogate returns some extra info, I think we looked into it previously). This is to avoid cases where the prediction is exactly as bound, i.e., cplex solves the instance within exactly [bound] time, but I think it's unlikely, so we may be able to skip that.
This is not needed for now, we can just skip it and add it in later if needed.