Waikato / moa

MOA is an open source framework for Big Data stream mining. It includes a collection of machine learning algorithms (classification, regression, clustering, outlier detection, concept drift detection and recommender systems) and tools for evaluation.
http://moa.cms.waikato.ac.nz/
GNU General Public License v3.0
609 stars 353 forks source link

PrequentialCV code logic correction #205

Closed michaelchiucw closed 4 years ago

michaelchiucw commented 4 years ago

I have just read the original paper proposing PrequentialCV. I found the code here does not seem to follow the paper. For k-fold distributed cross-validation, it should be Test only one. Meanwhile, k-fold distributed split validation should be Test all except one. Also, the original code fragment tested all classifier copies despite the validation methodology chosen. This also does not follow the original paper.