How about significant tests ?

songyouwei / ABSA-PyTorch

Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。

MIT License

2.02k stars 526 forks source link

Closed GeneZC closed 5 years ago

GeneZC commented 5 years ago

I am confused how to do significant tests with difference metrics, e.g. accuracy and macro-f1.

GeneZC commented 5 years ago

A method could be doing paired t-test with acc and f1 output by 10-fold cross validation