What is the meaning of the window metrics?

layer6ai-labs / xpool

https://layer6ai-labs.github.io/xpool/

110 stars 9 forks source link

What is the meaning of the window metrics? #10

Closed fake-warrior8 closed 2 years ago

fake-warrior8 commented 2 years ago

Hi, I saw the current best/current best window average metrics in the log, so what does the window metrics mean and which metrics did you use in your paper?

NoelVouitsis commented 2 years ago

We only used window average as a more stable metric for us to track performance when experimenting with new ideas. We do not use window scores in the paper.