search

numbbo / coco

Numerical Black-Box Optimization Benchmarking Framework
https://numbbo.github.io/coco
Other
261 stars 86 forks source link

Running experiments on Bbob noisy test suite #2264

Closed Yash-Pisat closed 7 months ago

Yash-Pisat commented 7 months ago

I am running experiments on Bbob noisy test suite. It says the it still operates on the old coco versions. Do I need to execute all the codes on python 2.6? or older version.

Also is it possible to compare the noisy test suites results with the bbob test suite result?

nikohansen commented 7 months ago

There exists a version which should work under Python 3 too:

import cma
import cma.bbobbenchmarks as bbob

help(bbob.F101)

class F101(_FSphere, BBOBGaussFunction)
 |  F101(iinstance=0, zerox=False, zerof=False, param=None, **kwargs)
 |  
 |  Sphere with moderate Gauss noise
[...]

I don't have a usage example to run the entire benchmark from there at my fingertips (you need to loop over the desired functions and over the desired instances for each function). I'd expect that the logged data work with the cocopp module.

I don't see though how it would make sense to compare results from these two different test suites.

Yash-Pisat commented 7 months ago

@nikohansen I tried to processe the log data using cocopp module and it worked. Thankyou for the quick response.