search

Computer-Vision-in-the-Wild / Elevater_Toolkit_IC

Toolkit for Elevater Benchmark
MIT License
64 stars 17 forks source link

EvalAI taking too long #15

Closed nibtehaz closed 8 months ago

nibtehaz commented 8 months ago

Hi, first of all thank you for developing such a wonderful benchmark for zero-shot learning assessment.

I have submit some predictions to EvalAI, and it has been running for more than 1 hour. Is the evaluation system working properly?

Thanks.

haotian-liu commented 8 months ago

The eval server is up and running now. Your submission is evaluated, and please let us know if you experiment issues with future submissions. Thanks.

nibtehaz commented 8 months ago

Thank you for solving the issue so quickly.

nibtehaz commented 8 months ago

Hi @haotian-liu , I have another question. Are the test accuracy reported at the end of the log files same as the value obtained from EvalAI? Thank you.

haotian-liu commented 8 months ago

They should be the same.

nibtehaz commented 8 months ago

Thanks for the clarification.