search

heal-research / HeuristicLab

HeuristicLab - An environment for heuristic and evolutionary optimization
https://dev.heuristiclab.com
GNU General Public License v3.0
34 stars 16 forks source link

If the random seed is specified for a cross-validation then the same seed is used for each fold #1665

Open HeuristicLab-Trac-Bot opened 12 years ago

HeuristicLab-Trac-Bot commented 12 years ago

Issue migrated from trac ticket # 1665

milestone: HeuristicLab 4.x Backlog | component: Algorithms.DataAnalysis | priority: high

2011-10-25 19:08:23: @gkronber created the issue

HeuristicLab-Trac-Bot commented 12 years ago

2011-10-25 19:08:34: @gkronber changed status from new to accepted

HeuristicLab-Trac-Bot commented 12 years ago

2011-10-25 19:47:46: @gkronber changed priority from highest to medium

HeuristicLab-Trac-Bot commented 12 years ago

2011-10-25 19:47:46: @gkronber changed status from accepted to readytorelease

HeuristicLab-Trac-Bot commented 12 years ago

2011-10-25 19:47:46: @gkronber changed milestone from HeuristicLab 3.3.6 to HeuristicLab 3.3.x Backlog

HeuristicLab-Trac-Bot commented 12 years ago

2011-10-25 19:47:46: @gkronber changed owner from gkronber to mkommend

HeuristicLab-Trac-Bot commented 12 years ago

2011-10-25 19:47:46: @gkronber changed title from Cross-validation does not initialize the random seed randomly to If the random seed is specified for a cross-validation then the same seed is used for each fold

HeuristicLab-Trac-Bot commented 12 years ago

2011-10-25 19:47:46: @gkronber commented

When debugging this it has become clear that actually the seed is initialized correctly but the parameter value stored in the cross-validation run is not updated. This is only to be expected because a separate instance of the algorithm is created and executed for each fold. So for each fold a different random seed is used.

I'm renaming this ticket because we do not have a way to set the random seed for the CV run explicitly. Either the random seed is initialized randomly or the same seed is used for each fold. This is a different problem than the one for which the ticket has been created initially and it has a lower priority.

HeuristicLab-Trac-Bot commented 12 years ago

2011-10-25 19:54:27: @gkronber commented

Not yet 100% sure if the random seed is updated for each fold. Please investigate this.

HeuristicLab-Trac-Bot commented 12 years ago

2011-12-02 09:25:51: @mkommend changed status from readytorelease to assigned

HeuristicLab-Trac-Bot commented 12 years ago

2012-09-06 10:17:31: @gkronber changed owner from mkommend to gkronber

HeuristicLab-Trac-Bot commented 6 years ago

2018-02-08 14:36:17: @gkronber changed priority from medium to high

HeuristicLab-Trac-Bot commented 6 years ago

2018-02-08 14:36:17: @gkronber changed milestone from HeuristicLab 3.3.x Backlog to HeuristicLab 4.x Backlog