which measure should we use to compare the final result? auc, mmce or ?

slds-lmu / paper_2019_multiobjective_rfms

High Dimensional Restrictive Federated Model Selection with multi-objective Bayesian Optimization over shifted distributions

https://github.com/smilesun/tex_2018_intellisys2019_fmoboms

2 stars 0 forks source link

which measure should we use to compare the final result? auc, mmce or ? #12

Open smilesun opened 5 years ago

smilesun commented 5 years ago

we are currently using brier score to tune (since brier score varies smoothly, so no matrix inversion error ) but the final result is on mmce. is this ok?