mcordts / cityscapesScripts

README and scripts for the Cityscapes Dataset
MIT License
2.19k stars 608 forks source link

why always pending when i test in website #77

Closed forrestsz closed 5 years ago

forrestsz commented 5 years ago

Does anyone have a situation like me? After i submit, I have been waiting "pending", whether the result of my submission is wrong or the problem of the website. Thank!

chengyangfu commented 5 years ago

I also have the same situation. If the format is correct, does anyone know how long the evaluation takes? If the format is wrong, does the evaluation server send out some error messages? BTW, I saw it needs to wait around 48 hours now for the pixel-level semantic labeling. Is this normal? L

forrestsz commented 5 years ago

I also have the same situation. If the format is correct, does anyone know how long the evaluation takes? If the format is wrong, does the evaluation server send out some error messages? BTW, I saw it needs to wait around 48 hours now for the pixel-level semantic labeling. Is this normal? L

Hi, i think you should try to check the format if right again, last time i find it is my unicode format wrong, we should submit “unit-8” but i submit "unit-16" and the evaluation server didn't give any information about it, after i update, i give the result a few minute. hoping to help you :)

mcordts commented 5 years ago

Unfortunately, the server does not send notifications if the evaluation failed. If an evaluation status is "pending" for longer than 12 hours, it's best to reach out to us via email. The 48 hour limit is on purpose in order to achieve fairness between results and to prevent overfitting by too many test set evaluations. If you try to circumvent this by using multiple email addresses you and possibly your email domain will be blocked from registering, accessing the data, and submitting.

chengyangfu commented 5 years ago

Hi, Thanks for the reply! I found out I save the image in 'int-16" format and it causes the problem for evaluation. After fixing it, the evaluation goes well.