heal-research / HeuristicLab

HeuristicLab - An environment for heuristic and evolutionary optimization
https://dev.heuristiclab.com
GNU General Public License v3.0
39 stars 16 forks source link

Model Comparison for Classification #1998

Closed HeuristicLab-Trac-Bot closed 9 years ago

HeuristicLab-Trac-Bot commented 11 years ago

Issue migrated from trac ticket # 1998

milestone: HeuristicLab 3.3.13 | component: Algorithms.DataAnalysis | priority: high | resolution: done

2012-12-17 17:09:17: @t-h-e created the issue


Similar to Regression, it shall be possible to easily create simple models for classification, which a classification model has to exceed to be accepted as good model.

0R, 1R and LDA classifiers will be created to compare them to the hopefully better classification model.

HeuristicLab-Trac-Bot commented 9 years ago

2015-10-29 20:39:26: @gkronber

HeuristicLab-Trac-Bot commented 9 years ago

2015-10-29 20:39:26: @gkronber

HeuristicLab-Trac-Bot commented 9 years ago

2015-10-29 20:39:26: @gkronber

HeuristicLab-Trac-Bot commented 9 years ago

2015-10-29 20:39:26: @gkronber

HeuristicLab-Trac-Bot commented 9 years ago

2015-10-29 20:39:26: @gkronber

HeuristicLab-Trac-Bot commented 9 years ago

2015-10-29 20:41:43: @gkronber commented


r13092: removed creatable attribute from OneR and ZeroR

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-02 21:39:45: @gkronber commented


r13097: reverse merge of 13089 (reused the ConstantRegressionModel as ConstantClassificationModel (OK?))

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-02 21:55:13: @gkronber commented


r13098:

  • introduced new class ConstantModel (to merge ConstantRegressionModel, ConstantClassificationModel and ConstantTimeSeriesModel)
  • fixed copyright statements
  • tried to unify naming
  • added F1 score and Matthews correlation to classification results collection
HeuristicLab-Trac-Bot commented 9 years ago

2015-11-02 21:55:13: @gkronber

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-02 22:00:26: @gkronber commented


r13099: fixed strings (the person is called Matthews)

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-02 22:33:13: @gkronber commented


r13100: merged changes from the branch to trunk (btw. this branch was difficult to merge back to trunk because of it's specific structure)

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-02 22:38:13: @gkronber commented


r13101: bug fixes (typo, duplicate result item)

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-03 06:52:20: @gkronber changed status from accepted to reviewing

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-03 06:52:20: @gkronber changed owner from @gkronber to @mkommend

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-03 06:52:20: @gkronber commented


r13102:

  • changed namespace and name of view
  • calculate f1 score only for solutions for binary classification problems
HeuristicLab-Trac-Bot commented 9 years ago

2015-11-03 07:12:37: @gkronber commented


r13103: code simplification of ConfusionMatrixCalculator

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-03 08:19:20: @gkronber commented


r13104: fixed a problem in Classification/ClassificationSolutionComparisonView

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-09 10:27:44: @gkronber commented


Relevant new changes:

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-10 15:17:54: @mkommend changed status from reviewing to assigned

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-10 15:17:54: @mkommend changed owner from @mkommend to @gkronber

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-10 15:17:54: @mkommend commented


Reviewed and briefly tested all relevant changes (mostly the model comparison view, ZeroR and OneR algorithm and the new classification performance metrics). Thank you for reviewing and finishing the implementation.

The only review comment I have is to put the ConstantModel outside of the Regression folder, because it is not limited to regression anymore.

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-13 21:13:15: @gkronber commented


r13154: moved ConstantModel class out of the Regression folder

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-13 21:13:21: @gkronber changed status from assigned to reviewing

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-13 21:14:33: @gkronber commented


r13155 (not migrated): terminated the old feature branch for model comparison

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-13 21:21:02: @gkronber changed status from reviewing to readytorelease

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-13 21:21:09: @gkronber changed status from readytorelease to closed

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-13 21:21:09: @gkronber removed resolution

HeuristicLab-Trac-Bot commented 9 years ago

2015-11-13 21:21:09: @gkronber commented


r13156: merged r13100 to r13104 and r13154 from trunk to stable