search

Wentao-Xu / HIST

The source code and data of the paper "HIST: A Graph-based Framework for Stock Trend Forecasting via Mining Concept-Oriented Shared Information".
241 stars 68 forks source link

What does Precision@N mean? #7

Closed BoruiXu closed 2 years ago

BoruiXu commented 2 years ago

Dear author:

Thanks for your work! I read your paper but I have some questions about the evaluation metrics. I am confused about Precision@N. According to Appendix A.2., “The Precision@N is the proportion of top N predictions on each day with the positive label.” I don't understand what that means, maybe sometimes almost all stocks have negative labels, in addition I find the recall metrics are not satisfactory.

Looking forward to your reply!

Wentao-Xu commented 2 years ago

Hi, the top N predictions are the N stocks with the largest prediction scores on each day (we sort the stocks on each day according to their prediction scores), and Precision@N is the proportion of top N predictions on each day with the positive label.

Wentao-Xu commented 2 years ago

Yes, if all the labels of the top N prediction are positive, then the Precision@N is 1. In the stock investment, since we do not know the stock future trends, we will invest the top N stocks with the largest prediction scores and hope that those N stocks would gain more positive returns.

BoruiXu commented 2 years ago

Thanks a lot!