esa / pagmo2

A C++ platform to perform parallel computations of optimisation tasks (global and local) via the asynchronous generalized island model.
https://esa.github.io/pagmo2/
GNU General Public License v3.0
804 stars 159 forks source link

More MO optimization performance metrics #345

Open Sceki opened 4 years ago

Sceki commented 4 years ago

It would be useful to have some more performance metrics for MO optimization.

For instance, some that are often used in MO papers are:

These two can used only when the true Pareto optimal front is known (as it is the case for many test-suites such as zdt, dtlz, etc.). The aforementioned two metrics are described in: Deb, K.: Multi-Objective Optimization using Evolutionary Algorithms, John Wiley & Sons, Chichester, UK (2001).

CoolRunning commented 4 years ago

These metrics are a bit outdated, but I would propose to implement some of the quality indicators from:

Coello Coello and Falcon-Cardona,: Convergence and Diversity Analysis of Indicator-based Multi-Objective Evolutionary Algorithms, in GECCO 2019.

MLopez-Ibanez commented 4 years ago

These metrics are a bit outdated, but I would propose to implement some of the quality indicators from: Coello Coello and Falcon-Cardona,: Convergence and Diversity Analysis of Indicator-based Multi-Objective Evolutionary Algorithms, in GECCO 2019.

Yes, those metrics are Pareto-compliant. Please don't add metrics that are not Pareto-compliant. Proper performance assessment for MO optimization is explained in these works:

Notable advances in metrics since those papers were published are:

You can find implementations (in C) of IGD+ and Average Hausdorff in https://mlopez-ibanez.github.io/eaf/