Centre-IRM-INT / GT-MVPA-nilearn

GT MVPA nilearn from Marseille
3 stars 3 forks source link

Leave-1-out or Leave-2-out ? #12

Open JeanLucAnton opened 3 years ago

JeanLucAnton commented 3 years ago

Sylvain: without a lot of data, the measured classification rates are not well estimated (high variance). By multiplying the measurement points and calculating the average of the accuracy maps, a better estimate of the average is obtained. So better performance measurement with leave 2 out and more statistical power. But obviously it is a compromise between a well trained classifier and a well estimated performance measure.