mrqa / MRQA-Shared-Task-2019

Resources for the MRQA 2019 Shared Task
https://mrqa.github.io
MIT License
292 stars 31 forks source link

What is the default value of timeout of the post request in predict_server? #13

Closed LegendaryDan closed 5 years ago

LegendaryDan commented 5 years ago

Is there any default value of timeout of the post request in predict_server.py?

Thanks.

robinjia commented 5 years ago

Hi,

There is no explicit timeout value. We ask that your model averages < 1 second per question across the out-of-domain examples (9633 total).

robinjia commented 5 years ago

Sorry, forgot to mention this is on our evaluation server, which will have one Titan Xp GPU.