search

heal-research / HeuristicLab

HeuristicLab - An environment for heuristic and evolutionary optimization
https://dev.heuristiclab.com
GNU General Public License v3.0
32 stars 15 forks source link

User-defined Evaluators for Symbolic Data Analysis Problems #2993

Open HeuristicLab-Trac-Bot opened 5 years ago

HeuristicLab-Trac-Bot commented 5 years ago

Issue migrated from trac ticket # 2993

milestone: HeuristicLab 3.3.x Backlog | component: Problems.DataAnalysis.Symbolic | priority: medium

2019-03-11 13:32:33: @foolnotion created the issue

The idea behind a user-defined evaluator is to provide a more flexible way of combining different objective measures in data analysis problems.

For example, multi-objective regression problems currently support combinations of two objectives (R2 + length, R2 + complexity, R2 + diversity, etc.), where each combination is implemented as a separate evaluator class. This becomes cumbersome or even infeasible when more/different combinations of objectives are desired.

A user-defined evaluator maintains a collection of basic evaluators (R2, length, etc.) which it then executes sequentially, returning either an aggregate value (ie., weighted sum) in the single-objective case or an array of quality values in the multi-objective case.

More complex evaluation could then be easily achieved by nesting user-defined evaluators.

HeuristicLab-Trac-Bot commented 5 years ago

2019-03-15 12:40:30: @foolnotion commented

r16687: Initial implementation of user-defined evaluators as separate plugin.