automl / DACBench

A benchmark library for Dynamic Algorithm Configuration.
https://automl.github.io/DACBench/
Apache License 2.0
27 stars 14 forks source link

Unified Way of Serializing Spaces and Samples from Spaces #107

Open maximilianreimer opened 2 years ago

maximilianreimer commented 2 years ago

Currently gym.Spaces as well as the sample drawn from them are serialized to JSON in different ways producing duplicated code and incompatible formats at a different places of the program.

Known serialization code locations:

Related to #91 and #80

maximilianreimer commented 2 years ago

Serialization of Dict Spaces done by AbstractBenchmark does not work properly. See falling tests in https://github.com/automl/DACBench/tree/container_draft/tests/benchmarks

Should be replace by serialization from dacbench.container.container_utils.Encoderanddacbench.container.container_utils.Decoder` and code should be move somewhere else.

The way of storing spaces will change which requires conversion of existing serialized benchmark configs. We should provide a small script that takes care of this.

Summary:

TheEimer commented 2 years ago

We should implement #80 before we tackle this