`folds_file` does not get used for `evaluate` or `predict` tasks

EducationalTestingService / skll

SciKit-Learn Laboratory (SKLL) makes it easy to run machine learning experiments.

http://skll.readthedocs.org

Other

551 stars 67 forks source link

`folds_file` does not get used for `evaluate` or `predict` tasks #536

Closed desilinguist closed 5 years ago

desilinguist commented 5 years ago

Right now, we only allow grid_search_folds to be read in from a specified folds_file if the task is 'train' (see here).

This means that the correct behavior is not exhibited for the evaluate or predict tasks which does not make sense since in terms of grid-search, these tasks are basically the same as the train task.

desilinguist commented 5 years ago

Addressed by #538