rasbt / mlxtend

A library of extension and helper modules for Python's data analysis and machine learning libraries.
https://rasbt.github.io/mlxtend/
Other
4.89k stars 863 forks source link

Stratified permutation / bootstrap tests #806

Open kaz94 opened 3 years ago

kaz94 commented 3 years ago

When it's important: Classification problem, when function is a desired classification metric. When applying to highly imbalanced problem, simple permutation will not preserve desired class ratios.

rasbt commented 3 years ago

Thanks for the suggestion, having a stratified bootstrap option could indeed be useful.