search

numbbo / coco

Numerical Black-Box Optimization Benchmarking Framework
https://numbbo.github.io/coco
Other
262 stars 87 forks source link

The constrained post-processing needs to have a standard test #2107

Open nikohansen opened 2 years ago

nikohansen commented 2 years ago

The call

./do.py test-postprocessing

must also do tests with data from the constrained testbed. It should be small data sets that a quick to process.

brockho commented 2 years ago

For now, I added a test with the only (large) bbob-constrained data set to the nightly test.

nikohansen commented 2 years ago

The test fails with

/usr/local/lib/python2.7/dist-packages/cocopp-2.6.1.18-py2.7.egg/cocopp/archiving.py:740: UserWarning: "constrained/2022/RandomSearch-5" seems not to be an existing file or match any archived data
  'match any archived data' % name)

I don't think it is enough to have a simple run of the post-processing only in the nightly test.

brockho commented 2 years ago

I see - we either have to do an cocopp.archives.update_all() on the Jenkins machines or remove the corresponding .cocopp folder. I will take care of that.

DONE