search

numbbo / coco

Numerical Black-Box Optimization Benchmarking Framework
https://numbbo.github.io/coco
Other
263 stars 88 forks source link

[Feature request] Add 2020 bbob as well as 2019 bbob-mixint data to ppdata-archive #2013

Closed brockho closed 2 years ago

brockho commented 3 years ago

We should prepare and put online the postprocessed data from the continuous submissions in 2020 as well as from the 2019 bbob-mixint paper here: https://numbbo.github.io/ppdata-archive/

brockho commented 3 years ago

While starting to look into the data archive again, I realized that the SNES data set of 2012 has 40-D data only for f1 till f11. This causes an error in particular when calling the bestalg.extractBestAlgorithms(...). Shall I remove this incomplete 40-D data from the official data set because? FYI, the originally submitted data has already this "missing" data for f12-f24.

nikohansen commented 2 years ago

@ttusar , you could submit the data from the 2019 paper here with the data submission label?

ttusar commented 2 years ago

The data is already in the archive, but it needs to be added to the websites (data archive and ppdata archive).

nikohansen commented 2 years ago

Re. SNES 2012 data: If the 40-D data can be removed cleanly, it sounds like a good option.

brockho commented 2 years ago

The 2019--2021 datasets are now postprocessed and available in the ppdata archive. Because the SNES 2012 data has been cleaned up as well in the meantime, I close this issue.