search

gzerveas / mvts_transformer

Multivariate Time Series Transformer, public version
MIT License
770 stars 172 forks source link

have you computed the EER? #35

Closed numanzafar closed 1 year ago

numanzafar commented 1 year ago

Thank you for your complete code with the detailed description. After completing the Training, have you computed/ calculated the Equal Error Rate using the classification dataset by using the pre-trained model?

gzerveas commented 1 year ago

No, I haven't, because the goal of the evaluation was to compare with other state-of-the-art methods, and this metric is not typically reported. But I also don't understand how it is applicable here - the Equal Error Rate can be used only in cases of binary classification. At any rate, you have access to the prediction scores, so you can certainly use e.g. sklearn to get the AUROC, EER, etc.