numbbo / coco

Numerical Black-Box Optimization Benchmarking Framework
https://numbbo.github.io/coco
Other
264 stars 91 forks source link

(Minor) Warning when post-processing 2009 data #1552

Closed nikohansen closed 4 years ago

nikohansen commented 7 years ago

There is a RuntimeWarning from post-processing some of our 2009 data for which I wonder whether we should address this in some way or another?

[15:38:57] coco$ python -m cocopp /Users/hansen/svn/coco/BBOB/data-archive/data/gecco-bbob-1-24/2009/rawdata/*AMA*tgz

Post-processing (2+)
  Data consistent according to consistency_check() in pproc.DataSet
  using: /Users/hansen/svn/coco/BBOB/data-archive/data/gecco-bbob-1-24/2009/rawdata/AMALGAM_bosman_noiseless.tgz
  Data consistent according to consistency_check() in pproc.DataSet
  using: /Users/hansen/svn/coco/BBOB/data-archive/data/gecco-bbob-1-24/2009/rawdata/iAMALGAM_bosman_noiseless.tgz
  Will generate output data in folder ppdata/AMALG_iAMAL
    this might take several minutes.
ECDF runlength ratio graphs...
cocopp/comp2/pprldistr2.py:146: RuntimeWarning: invalid value encountered in divide
  x.append((tmp1/tmp0).flatten())  # inf/inf results in nan
  done (Tue Sep 12 15:40:21 2017).
ECDF runlength graphs...

There may be a small chance that it is related to #1466

brockho commented 4 years ago

With the current version (development branch), I don't see this warning showing up anymore with the above algorithms:

C:\Users\dimo\Desktop>python -m cocopp bbob/.*AMAL
Post-processing (1)
  Using:
    C:\Users\dimo\.cocopp\data-archives\coco.gforge.inria.fr\data-archive\bbob\2009\AMALGAM_bosman_noiseless.tgz
    C:\Users\dimo\.cocopp\data-archives\coco.gforge.inria.fr\data-archive\bbob\2009\iAMALGAM_bosman_noiseless.tgz

Post-processing (2+)
  loading data...
  Data consistent according to consistency_check() in pproc.DataSet
  using: C:\Users\dimo\.cocopp\data-archives\coco.gforge.inria.fr\data-archive\bbob\2009\AMALGAM_bosman_noiseless.tgz
  Data consistent according to consistency_check() in pproc.DataSet
  using: C:\Users\dimo\.cocopp\data-archives\coco.gforge.inria.fr\data-archive\bbob\2009\iAMALGAM_bosman_noiseless.tgz
  Will generate output data in folder ppdata\AMALG_iAMAL
    this might take several minutes.
ECDF runlength ratio graphs...
  done (Mon Jun 15 09:45:38 2020).
ECDF runlength graphs...
  done (Mon Jun 15 09:45:43 2020).
ECDF graphs per noise group...
Loading best algorithm data from refalgs/best2009-bbob.tar.gz ...
    archive extracted to folder c:\users\dimo\anaconda3\lib\site-packages\cocopp-2.3.3.67-py3.7.egg\cocopp\refalgs\.extracted_best2009-bbob ...
  Data consistent according to consistency_check() in pproc.DataSet
  using: c:\users\dimo\anaconda3\lib\site-packages\cocopp-2.3.3.67-py3.7.egg\cocopp\refalgs/best2009-bbob.tar.gz
  done (Mon Jun 15 09:45:45 2020).
  done (Mon Jun 15 09:45:52 2020).
ECDF graphs per function group...
[...]

Looks like, this issue can be closed.

brockho commented 4 years ago

Fixed in a recent comment by @nikohansen.