how about comparing their MCC?

PatWalters / comparing_classifiers

Some ideas on methods for comparing classification models

MIT License

10 stars 1 forks source link

how about comparing their MCC? #1

Closed UnixJunkie closed 4 years ago

UnixJunkie commented 4 years ago

If you really compare their classification (not ranking) power.

UnixJunkie commented 4 years ago

For example, iterate 50 times with molecules list randomization each time, train on 80%, test on the 20% left out test set. Then compare the distributions of their MCCs.

PatWalters commented 4 years ago

Yes, you can do that. Need to use a non-parametric method like Wilcoxon. In this case, I was focused on AUC. I have a blog post coming shortly that explains.

UnixJunkie commented 4 years ago

Ok, keep up with the super interesting chemoinformatics blog!