heal-research / HeuristicLab

HeuristicLab - An environment for heuristic and evolutionary optimization
https://dev.heuristiclab.com
GNU General Public License v3.0
39 stars 16 forks source link

Sliding Window GP #1837

Open HeuristicLab-Trac-Bot opened 12 years ago

HeuristicLab-Trac-Bot commented 12 years ago

Issue migrated from trac ticket # 1837

milestone: HeuristicLab 3.3.x Backlog | component: Problems.DataAnalysis.Symbolic | priority: high

2012-04-20 20:14:32: @mkommend created the issue


For various data analysis tasks it would be beneficial to have a sliding window modeling approach similar to the implementation in HL 2.0. Instead of implementing this as an algorithm, it can be implemented as analyzers that shift the window over the training partition and thus all other features of HL 3.3 can be used.

HeuristicLab-Trac-Bot commented 12 years ago

2012-05-15 10:14:53: @mkommend changed status from new to accepted

HeuristicLab-Trac-Bot commented 12 years ago

2012-05-15 10:18:11: @mkommend commented


r7818: Created folder for sliding window GP in branches directory.

HeuristicLab-Trac-Bot commented 12 years ago

2012-05-15 10:22:47: @mkommend commented


r7819: Corrected location of accidentally create folder sliding window GP.

HeuristicLab-Trac-Bot commented 12 years ago

2012-05-15 10:30:19: @mkommend commented


r7820: Added HL.Problems.DataAnalysis.Symbolic to sliding window GP branch.

HeuristicLab-Trac-Bot commented 12 years ago

2012-05-16 13:38:42: @mkommend commented


r7837: Branched HL.Problems.DataAnalysis.Symbolic.Views for sliding window GP.

HeuristicLab-Trac-Bot commented 12 years ago

2012-05-18 13:04:53: @mkommend commented


r7845: Added prototype for sliding window GP.

HeuristicLab-Trac-Bot commented 12 years ago

2012-05-21 10:30:55: @mkommend commented


r7850: Added view for sliding window GP and updated analyzer.

HeuristicLab-Trac-Bot commented 12 years ago

2012-07-24 10:26:58: @mkommend changed milestone from HeuristicLab 3.3.x Backlog to HeuristicLab 3.3.8

HeuristicLab-Trac-Bot commented 12 years ago

2012-10-02 12:05:34: @mkommend changed milestone from HeuristicLab 3.3.8 to HeuristicLab 3.3.x Backlog

HeuristicLab-Trac-Bot commented 11 years ago

2012-12-13 10:42:18: @mkommend commented


r9047: Committed local changes in sliding window GP branch.

HeuristicLab-Trac-Bot commented 11 years ago

2013-01-08 15:36:41: @mkommend commented


r9126: Updated sliding window GP branch with trunk changes.

HeuristicLab-Trac-Bot commented 11 years ago

2013-01-11 13:04:40: @mkommend commented


r9145: Improved Sliding Window Analyzers to work with user defined algorithms.

HeuristicLab-Trac-Bot commented 11 years ago

2013-01-15 13:19:55: @mkommend commented


r9162: Refactored sliding window analyzers and updated the provided algorithm.

HeuristicLab-Trac-Bot commented 11 years ago

2013-01-15 13:26:09: @mkommend commented


r9163: Merged trunk changes into branch.

HeuristicLab-Trac-Bot commented 11 years ago

2013-01-15 13:57:10: @mkommend commented


r9164: Added validation to sliding window algorithms.

HeuristicLab-Trac-Bot commented 11 years ago

2013-01-15 14:22:16: @mkommend commented


r9165: Corrected selection pressure base sliding window analyzer and added new sample algorithms.

HeuristicLab-Trac-Bot commented 11 years ago

2013-01-16 10:17:58: @mkommend changed status from accepted to reviewing

HeuristicLab-Trac-Bot commented 11 years ago

2013-01-16 10:17:58: @mkommend changed owner from @mkommend to @gkronber

HeuristicLab-Trac-Bot commented 11 years ago

2013-01-16 10:17:58: @mkommend changed milestone from HeuristicLab 3.3.x Backlog to HeuristicLab 3.3.8

HeuristicLab-Trac-Bot commented 11 years ago

2013-01-16 10:17:58: @mkommend commented


The only modified classes which must be reviewed are in an extra folder SlidingWindow in HL.Problems.DataAnalysis.Symbolic and the SlidingWindowDataView. To ease the testing and to have some kind of template for further algorithms, three samples are provided in the folder of the solution.

HeuristicLab-Trac-Bot commented 11 years ago

2013-03-31 14:00:10: @gkronber commented


Observations:

  • for a users it is surprising the the GA stops before the max. number of generations is reached (this happens because the algorithm seemingly stops when the sliding window is empty?).
  • large number of parameters makes it unnecessarily complicated to configure the sliding window behavior (e.g. are "generation interval start" and "initial sliding window" really useful?)
  • icon of "sliding window data" result does not indicate that there is a line chart view available
  • I think it is sufficient to only have the "sliding window data" result in the results collection. The "Sliding Window" result should be removed.
  • "Sliding Window Visualizer" is an unconventional name for an analyzer (should be discussed)
  • Why is there an algorithm parameter that allows to set parameters for the "sliding window" (only "generational sliding window analyzer" is allowed) and an additional analyzer where I can set the same parameters? What happens if I use the "offspring selection sliding window analyzer" instead?

I have not yet looked at the source in detail.

HeuristicLab-Trac-Bot commented 11 years ago

2013-03-31 14:08:12: @gkronber changed status from reviewing to assigned

HeuristicLab-Trac-Bot commented 11 years ago

2013-03-31 14:08:12: @gkronber changed owner from @gkronber to @mkommend

HeuristicLab-Trac-Bot commented 11 years ago

2013-03-31 14:08:12: @gkronber commented


Let's discuss an easier way of setting sliding window parameters.

HeuristicLab-Trac-Bot commented 11 years ago

2013-05-02 15:19:06: @mkommend changed milestone from HeuristicLab 3.3.8 to HeuristicLab 3.3.x Backlog

HeuristicLab-Trac-Bot commented 11 years ago

2013-07-16 13:51:42: @mkommend commented


r9707: Adapted sliding window analyzer to reevaluate all individuals if the sliding window gets moved.

HeuristicLab-Trac-Bot commented 11 years ago

2013-07-16 14:05:25: @mkommend commented


r9708: Merged trunk changes into sliding window gp branch.

HeuristicLab-Trac-Bot commented 11 years ago

2013-07-22 18:13:58: @gkronber commented


Please accept this ticket.

HeuristicLab-Trac-Bot commented 11 years ago

2013-07-31 10:47:55: @mkommend changed status from assigned to accepted

HeuristicLab-Trac-Bot commented 11 years ago

2013-08-07 17:00:26: @foolnotion commented


r9870: Merged trunk changes and fixed sliding window visualization.

HeuristicLab-Trac-Bot commented 10 years ago

2014-01-22 11:27:58: @mkommend commented


r10364: Merged trunk changes.

HeuristicLab-Trac-Bot commented 10 years ago

2014-01-22 15:00:59: @foolnotion commented


r10373: Merged trunk changes.

HeuristicLab-Trac-Bot commented 10 years ago

2014-01-26 01:44:20: @foolnotion commented


r10396: Introduced the SlidingWindowBestSolutionsCollectionView which shows how well each individual sliding window solution performs on the other portions of the training data.

HeuristicLab-Trac-Bot commented 10 years ago

2014-01-26 03:20:10: @foolnotion commented


r10397: Fixed PreBuildEvent.cmd.

HeuristicLab-Trac-Bot commented 10 years ago

2014-01-26 03:59:43: @foolnotion commented


r10398: Added private members with the [Storable] attribute for the SlidingWindowBestSolutionsCollection ProblemData and Interpreter properties. Added item attributes to SlidingWindowBestSolutionsCollection.

HeuristicLab-Trac-Bot commented 10 years ago

2014-01-27 14:14:58: @foolnotion commented


r10402: Added missing license information headers. Added storable constructors and changed properties in SlidingWindowBestSolutionsCollection to return IEnumerables instead of Lists.

HeuristicLab-Trac-Bot commented 10 years ago

2014-01-27 20:12:03: @foolnotion commented


r10403: Added SlidingWindowQualitiesAnalyzer.

HeuristicLab-Trac-Bot commented 10 years ago

2014-01-28 19:13:10: @foolnotion commented


r10413: Modified the SlidingWindowBestSolutionsCollection to use a dictionary for sliding window positions mapped to best solutions, because the last sliding window position before the algorithm reached its stop was not registered correctly.

HeuristicLab-Trac-Bot commented 10 years ago

2014-01-29 12:32:44: @foolnotion commented


r10419: Removed resource file from the HeuristicLab.Problems.DataAnalysis.Symbolic.Views project.

HeuristicLab-Trac-Bot commented 10 years ago

2014-01-29 13:07:47: @foolnotion commented


r10420: Removed auto-generated files from repository.

HeuristicLab-Trac-Bot commented 10 years ago

2014-03-31 13:20:35: @mkommend commented


r10678: Removed copy of plugins, which were added anew, in sliding window branch.

HeuristicLab-Trac-Bot commented 10 years ago

2014-03-31 13:24:21: @mkommend commented


r10679: Added DataAnalysis.Symbolic.Classification to the sliding window branch.

HeuristicLab-Trac-Bot commented 10 years ago

2014-03-31 13:27:32: @mkommend commented


r10680: Added DataAnalysis.Symbolic.Regression to the sliding window branch.

HeuristicLab-Trac-Bot commented 10 years ago

2014-03-31 13:39:10: @mkommend commented


r10681: Corrected project files and merged trunk changes to the sliding window branch.

HeuristicLab-Trac-Bot commented 10 years ago

2014-03-31 17:03:42: @mkommend commented


r10682: Corrected output directories in sliding window branch.

HeuristicLab-Trac-Bot commented 10 years ago

2014-03-31 17:03:58: @mkommend commented


r10683: updated template files for sliding window GP.

HeuristicLab-Trac-Bot commented 10 years ago

2014-03-31 17:17:37: @mkommend commented


r10684: Added quality analyzer in template files for sliding window GP.

HeuristicLab-Trac-Bot commented 10 years ago

2014-04-01 10:07:12: @foolnotion commented


r10686: Added SlidingWindowBestSolutionsCollectionHeatMapView.

HeuristicLab-Trac-Bot commented 10 years ago

2014-04-01 11:24:34: @foolnotion commented


r10687: Added missing designer file.

HeuristicLab-Trac-Bot commented 10 years ago

2014-04-01 11:28:03: @mkommend commented


r10688: Added missing license headers to designer files for sliding window visualization.