search

heal-research / HeuristicLab

HeuristicLab - An environment for heuristic and evolutionary optimization
https://dev.heuristiclab.com
GNU General Public License v3.0
39 stars 16 forks source link

Implement views for statistical hypothesis testing #2031

Closed HeuristicLab-Trac-Bot closed 9 years ago

HeuristicLab-Trac-Bot commented 11 years ago

Issue migrated from trac ticket # 2031

milestone: HeuristicLab 3.3.11 | component: Analysis | priority: medium | resolution: done

2013-04-10 12:28:55: @Shabbafru created the issue

Besides using the charts of the RunCollectionView for analyzing runs there should also be the option to do statistical significance testing. Therefore new RunCollection views should be implemented that offer this functionality.

~~TODO: Check http://powerandsamplesize.com for a better way to do sample size estimation. ~~

HeuristicLab-Trac-Bot commented 9 years ago

2014-12-22 09:49:11: @Shabbafru commented

r11715 made it possible to set axis in boxplot view and enabled functionality in statistical tests view for showing data in the box plot

HeuristicLab-Trac-Bot commented 9 years ago

2014-12-22 15:57:00: @Shabbafru commented

r11717 fixed layout of statistical test view

HeuristicLab-Trac-Bot commented 9 years ago

2014-12-23 13:55:42: @Shabbafru commented

r11725 added statistical views project to project dependencies for HeuristicLab-3.3

HeuristicLab-Trac-Bot commented 9 years ago

2014-12-23 14:28:29: @Shabbafru changed status from assigned to reviewing

HeuristicLab-Trac-Bot commented 9 years ago

2014-12-23 14:28:29: @Shabbafru changed owner from @Shabbafru to @mkommend

HeuristicLab-Trac-Bot commented 9 years ago

2015-01-14 16:37:03: @Shabbafru commented

r11757 added svn:ignore properties for statistics.views

HeuristicLab-Trac-Bot commented 9 years ago

2015-01-14 16:37:24: @Shabbafru edited the issue description

HeuristicLab-Trac-Bot commented 9 years ago

2015-01-28 20:19:28: @Shabbafru commented

r11837

  • fixed a problem where an exception was thrown when the same progress bar was removed multiple times
  • remove data points from histogram before adding new ones
HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 13:12:50: @mkommend commented

Review started at r11703 (trunk integration).

Review comments:

  • Why are the views in an separate plugin, but the other classes in HL.Analysis.
    • I just found that we can't put them into Analysis.Views because of a dependency on the Optimization.Views plugin. Optimization.Views also has a reference on Analysis.Views, so we would get a cyclic dependency. And I don't want to put the views into Optimization.Views because of the alglib dependency. So I will leave this for now in an own plugin.
  • EnumberableStatistics should be located in HL.Common
    • Not possible due to alglib reference.
  • ConfidenceIntervals iterates 4x over the values !!!
  • BonferroniHolm uses elementAt extensively. A list or an array would be more appropriate instead of IEnumerable.
  • Move fittings to an extra subfolder.
  • I don't like the name fitting at all.
  • SampleSizeDetermination does not use the passed confidence for interval calculation
  • I don't understand the difference between the two methods for sample size estimation and when to use which
HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 13:12:50: @Shabbafru

HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 13:12:50: @Shabbafru

HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 13:12:50: @Shabbafru

HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 13:57:01: @Shabbafru changed status from reviewing to assigned

HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 13:57:01: @Shabbafru changed owner from @mkommend to @Shabbafru

HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 13:57:53: @Shabbafru commented

Also:

  • fix name handling of DataRow
  • rename linear fitting into slope and intercept
  • improve IFitting interface
HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 16:09:49: @Shabbafru changed status from assigned to reviewing

HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 16:09:49: @Shabbafru changed owner from @Shabbafru to @mkommend

HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 16:09:49: @Shabbafru commented

r11914 implemented review comments

HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 16:23:48: @mkommend changed status from reviewing to readytorelease

HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 16:23:48: @mkommend changed owner from @mkommend to @Shabbafru

HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 17:30:04: @Shabbafru changed status from readytorelease to closed

HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 17:30:04: @Shabbafru removed resolution

HeuristicLab-Trac-Bot commented 9 years ago

2015-02-05 17:30:04: @Shabbafru commented

r11919: merged revisions 11703,11704,11705,11706,11715,11717,11725,11757,11837,11914 into stable