search

automl / ConfigSpace

Domain specific language for configuration spaces in Python/Cython. Useful for hyperparameter optimization and algorithm configuration.
https://automl.github.io/ConfigSpace/
Other
193 stars 89 forks source link

Hyperparameter floating point precision in configuration search space #11

Open mfeurer opened 7 years ago

mfeurer commented 7 years ago

@hmendozap raised this issue in the auto-sklearn issue tracker:

When adding a UniformFloat or Constant hyperparameter to the configuration space of any component, the string conversion to the 'parameter configuration space file' has only 10 decimal digits precision that mismatches the native float precision (53 bits) when running auto-sklearn and setting the hyperparameter for a component.

I believe this is specific to the pcs writer of SMAC. @mlindauer is this a critical issue that we should fix?

mlindauer commented 7 years ago

So, this concerns only using SMAC2?

I would expect that in most cases 10 digits should be more than enough.

mfeurer commented 7 years ago

I assume it'll also concern SMAC3 since the io module is more or less the same. Nevertheless, I also don't see any practical implications of this. Shall I close it for now?

mlindauer commented 7 years ago

I think it would not hurt to fix this at some point, but it is not crucial.