Some problem with GrailQA submission

dki-lab / GrailQA

Apache License 2.0

102 stars 17 forks source link

Some problem with GrailQA submission #5

Closed BitcoinNLPer closed 3 years ago

BitcoinNLPer commented 3 years ago

Hello,

I have observed that the prediction results submitted by GrailQA on the test dataset need to be manually reviewed and wait for a week at the latest, which is a bit inconvenient for the iteration of the experiment. Can you provide real-time feedback and evaluation of the test dataset on Codalab as like dev dataset ?

Best

entslscheia commented 3 years ago

Hi,

It's to some extent part of the nature of Codalab leaderboard. On my side it's actually just one click thing. Please just email me (gu.826@osu.edu) every time you made a submission. I am normally very responsive and will get back to you very soon.

Best, Yu

BitcoinNLPer commented 3 years ago

Thank you for your meticulous reply, the email has been sent to you, please check it.

Best