heal-research / HeuristicLab

HeuristicLab - An environment for heuristic and evolutionary optimization
https://dev.heuristiclab.com
GNU General Public License v3.0
38 stars 16 forks source link

Create an expert system optimizer #2457

Open HeuristicLab-Trac-Bot opened 9 years ago

HeuristicLab-Trac-Bot commented 9 years ago

Issue migrated from trac ticket # 2457

milestone: HeuristicLab 3.3.x Backlog | component: Optimization | priority: medium

2015-08-11 09:43:37: @abeham created the issue


A prototype of an expert-system-like optimizer should be implemented that makes algorithm instance suggestions based on FLA information and performance data from an OKB.

This will build on the developments in #2431.

HeuristicLab-Trac-Bot commented 9 years ago

2015-08-11 09:45:00: @abeham edited the issue description

HeuristicLab-Trac-Bot commented 9 years ago

2015-08-11 09:45:06: @abeham changed status from new to accepted

HeuristicLab-Trac-Bot commented 9 years ago

2015-08-11 09:49:05: @abeham commented


r12842:

  • Added plugins
  • Worked on properties of the optimizer
HeuristicLab-Trac-Bot commented 9 years ago

2015-08-12 10:29:27: @abeham commented


r12847: Added view

HeuristicLab-Trac-Bot commented 9 years ago

2015-08-13 16:05:15: @abeham commented


r12860: worked on expert system

HeuristicLab-Trac-Bot commented 9 years ago

2015-09-19 21:21:20: @abeham commented


r12957: Worked on expert system

  • using newly created ERT helper class
HeuristicLab-Trac-Bot commented 8 years ago

2015-12-16 17:05:27: @abeham commented


r13475: updated from trunk, worked on okb connection for downloading knowledge base

HeuristicLab-Trac-Bot commented 8 years ago

2015-12-18 12:42:19: @abeham commented


r13485:

  • fixed bugs in iterated sampling view
  • worked on download runs from okb feature
HeuristicLab-Trac-Bot commented 8 years ago

2016-01-19 08:49:31: @abeham commented


r13551: Added characteristic calculator for qap and adapted expert system view

HeuristicLab-Trac-Bot commented 8 years ago

2016-01-21 11:15:32: @abeham commented


r13561:

  • added two types of problem instance mappings: PCA and MDS
HeuristicLab-Trac-Bot commented 8 years ago

2016-01-22 16:21:32: @abeham commented


r13564:

  • Fixed bugs in IteratedAlgorithm
HeuristicLab-Trac-Bot commented 8 years ago

2016-01-26 09:00:29: @abeham commented


r13568: added code to auto-sync stopping criterion with embedded algorithm in iterated algorithms

HeuristicLab-Trac-Bot commented 8 years ago

2016-01-26 11:23:47: @abeham commented


r13569: fixed bugs in iterated algorithm, fixed bug in expert system view

HeuristicLab-Trac-Bot commented 8 years ago

2016-02-02 14:11:01: @abeham commented


r13583:

  • Added stripped-down version of FLA branch
  • Added appropriate calculators
  • Fixed detecting maximization in RLD view
HeuristicLab-Trac-Bot commented 8 years ago

2016-02-07 23:12:58: @abeham commented


r13593:

  • Changed ICharacteristicCalculator interface
  • Updated OKB Problem view
HeuristicLab-Trac-Bot commented 8 years ago

2016-02-07 23:14:42: @abeham commented


r13594: Adapted branch to trunk changes

HeuristicLab-Trac-Bot commented 8 years ago

2016-02-08 14:49:54: @abeham commented


r13601:

  • Added merge info
HeuristicLab-Trac-Bot commented 8 years ago

2016-03-03 15:54:59: @abeham commented


r13649: fixed bugs in suggestions

HeuristicLab-Trac-Bot commented 8 years ago

2016-03-07 21:29:29: @abeham commented


r13663: worked on expert system

HeuristicLab-Trac-Bot commented 8 years ago

2016-03-08 15:33:50: @abeham commented


r13667: worked on expert system, created new application, merged trunk change of r13666

HeuristicLab-Trac-Bot commented 8 years ago

2016-03-08 17:51:54: @abeham commented


r13668: Worked on expert system

HeuristicLab-Trac-Bot commented 8 years ago

2016-03-14 11:51:24: @abeham commented


r13694: branched permutation encoding

HeuristicLab-Trac-Bot commented 8 years ago

2016-03-15 17:09:16: @abeham commented


r13706: Added pre-existing solution creator for permutation and respective interface

HeuristicLab-Trac-Bot commented 8 years ago

2016-03-17 00:29:47: @abeham commented


r13713: worked on seeding algorithm instances

HeuristicLab-Trac-Bot commented 8 years ago

2016-03-18 16:15:24: @abeham commented


r13718: worked on expert system

HeuristicLab-Trac-Bot commented 8 years ago

2016-03-19 22:36:05: @abeham commented


r13720: worked on expert-system

HeuristicLab-Trac-Bot commented 8 years ago

2016-03-23 22:51:35: @abeham commented


r13722:

  • Renamed remaining files from ExpertSystem to KnowledgeCenter
  • Added ability to scatter plot to display a regression line
  • Allowed to execute multiple instances at once and displaying either only final result or tracking result
  • Split runs in seeded runs and instance runs
HeuristicLab-Trac-Bot commented 8 years ago

2016-04-06 12:00:37: @abeham commented


r13743: adding relational SOM projection for solution network visualization

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-07 14:14:09: @abeham commented


r13744: added best-n scopes solution analyzer

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-07 14:28:02: @abeham commented


r13745: added line annotations to the network visu to highlight close solutions

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-07 15:26:56: @abeham commented


r13748: Added toolbar, fixed some bugs

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-08 14:25:13: @abeham commented


r13750: Added SOM projection for problem instances, fixed a bug (learningRadius was not used)

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-08 14:25:13: @abeham

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-11 17:35:03: @abeham commented


r13751: worked on problem instance mapping

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-12 13:28:42: @abeham commented


r13752:

  • improved mapping of problem instances by normalization (z-score) and handling of missing values (median)
  • enabled to select the characteristics that should be included in the mapping
  • improved speed of OKB download by calling service methods in parallel
HeuristicLab-Trac-Bot commented 8 years ago

2016-04-13 16:25:34: @abeham commented


r13757:

  • worked on problem instance mapping
  • started working on improved suggestion algorithm
HeuristicLab-Trac-Bot commented 8 years ago

2016-04-14 01:20:20: @abeham commented


r13759: worked on suggestion algorithm

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-15 09:37:38: @abeham commented


r13767: fixed cross-thread exception

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-19 12:41:12: @abeham commented


r13774: worked on recommendation algorithms

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-24 10:04:21: @abeham commented


r13787: worked on performance modeling

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-25 12:56:34: @abeham commented


r13791: working on recommendation algorithms

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-25 13:00:09: @abeham commented


r13792: merged changes from trunk

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-26 00:02:20: @abeham commented


r13794: worked on recommendation algorithms (x-validation)

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-26 13:07:42: @abeham commented


r13797: worked on testing recommendation algorithms through x-validation

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-27 16:22:24: @abeham commented


r13803:

  • changed expected runtime calculation
    • now outputs positive infinity instead of nan when no run was successful
    • now filters outliers in successful and unsuccessful runs by using two standard deviations of the mean of successful runs as lower bound
    • this change allows having unsuccessful runs in the database with low evaluations / runtime (e.g. due to being aborted early or from an experiment where the max budget was lower)
  • worked on recommendation algorithms
    • implemented several performance measures (absolute error, absolute log error, ndcp, kendall's tau) to evaluate the ranking
HeuristicLab-Trac-Bot commented 8 years ago

2016-04-27 16:43:23: @abeham commented


r13804: removed algorithm instances that do not appear in any run

HeuristicLab-Trac-Bot commented 8 years ago

2016-04-28 13:09:10: @abeham commented


r13809: added file system based cache of runs

HeuristicLab-Trac-Bot commented 8 years ago

2016-05-30 00:04:11: @abeham commented


r13861: added directed walk for qap

HeuristicLab-Trac-Bot commented 8 years ago

2016-06-07 16:30:31: @abeham commented


r13878: added standardization of features for recommendation and using log10 of the expected runtime for clustering

HeuristicLab-Trac-Bot commented 8 years ago

2016-06-17 23:12:12: @abeham commented


r13920: added repetitions to LocalAnalysis and computing average