hsbang09 / iFEED_experiment_result_analysis_2019

1 stars 1 forks source link

Capability to compute IGD from design synthesis task data #3

Closed hsbang09 closed 4 years ago

hsbang09 commented 5 years ago

Compute IGD using the design synthesis task data. IGD is originally used to compute the distance from a set of solutions to the Pareto front. For our case, however, we need to compute IGD between a set of solutions and the target solutions (instead of the Pareto front). Some modifications may need to be made in the way IGD is calculated.

_subject.design_synthesis_task_data['designsevaluated'] has "outputs" key and the corresponding output values. These values should be used to calculate the distance to the target designs.

References: Reference Point Specification in Inverted Generational Distance for Triangular Linear Pareto Front.pdf igd.pdf

hsbang09 commented 5 years ago

Dataset containing the target designs: target_selection.zip

The second column is the target label, and the last two columns are the output values (science and cost). Target designs are the ones whose target label is equal to 1.

hsbang09 commented 4 years ago

Let's first try equation (2) of paper by Ishibuchi et al. (2018) to compute IGD.

Try using all target solutions as reference points