Closed LegendaryDan closed 5 years ago
Hi,
There is no explicit timeout value. We ask that your model averages < 1 second per question across the out-of-domain examples (9633 total).
Sorry, forgot to mention this is on our evaluation server, which will have one Titan Xp GPU.
Is there any default value of timeout of the post request in predict_server.py?
Thanks.