All those metrics of leaderboard based on week are the same when selecting the same season

THU-KEG / KoLA

[ICLR24] The open-source repo of THU-KEG's KoLA benchmark.

https://arxiv.org/abs/2306.09296

50 stars 0 forks source link

All those metrics of leaderboard based on week are the same when selecting the same season #3

Closed zhimin-z closed 6 months ago

zhimin-z commented 9 months ago

That indicates the redundancy of the existing leaderboard, maybe it is recommended to conduct the evaluation not that frequently? @HLGreener @Bakser @yujifan0326 @shijx12

xurh20 commented 6 months ago

We no longer support week level query(and test) and currently you can only access model score data of different seasons