iarai / NeurIPS2022-traffic4cast

Code accompanying our NeurIPS 2022 traffic4cast challenge
Apache License 2.0
72 stars 20 forks source link

Unable to make submissions #19

Closed vishalmhjn closed 1 year ago

vishalmhjn commented 1 year ago

I am faced with uploading being stuck at 100%. I tried different browsers, etc., but the issue remains. The zipped filesize for the core competition is around 600 MB, which I hope should not be a problem. Please see the screenshot.

Thanks for your support.

Screen Shot 2022-09-09 at 6 40 16 PM
chenkins commented 1 year ago

@vishalmhjn Sorry to hear. I've just checked an upload with large file, working fine for me (if I leave out a submission name, a pop-up with an error message is displayed). Can you try clearing the browser cache? That has worked in the past for us. If that does not help, you can have a look at the Network tab in the Developer tools of your browser to check the upload request there.

vishalmhjn commented 1 year ago

I tried after clearing the cookies and cache. Below are a few screenshots from the Network tab. It seems no data is being transferred. I hope this could help to track the problem. Preview:

Screen Shot 2022-09-09 at 8 06 57 PM Screen Shot 2022-09-09 at 8 04 34 PM
moritz9 commented 1 year ago

Hi @vishalmhjn also just verified with a 750MB file that the submission is working. The call to admin-ajax.php should return with HTTP code 200 even if your submission fails or you're not logged in. Are you behind a proxy or a VPN which might affecting your internet traffic?

vishalmhjn commented 1 year ago

No, I am not using either.

chenkins commented 1 year ago

@vishalmhjn Hm.

  1. When logged in, do you still see a button Join the Competition on https://www.iarai.ac.at/traffic4cast/challenge/? If yes, please click and accept the terms and conditions image

  2. Do you have the same problem when uploading an empty or a a zip with just one file in it or even a non-zip?

vishalmhjn commented 1 year ago

Thanks again for your support. As suggested, I tested it with a dummy zip file, and it worked. Then I also tested it with a manually compressed submission file, and it works fine now. Since I was using the official code below for creating the zipped files, I found that compression using the following is not actually compressing it, leading to the submission failure. https://github.com/iarai/NeurIPS2022-traffic4cast/blob/5b8c66817e0dda6c204552835b5978c0facc6853/t4c22/evaluation/create_submission.py#L151
If this is indeed the case with not just me, maybe the compression method in above code could be changed. I think this issue can be closed now.

chenkins commented 1 year ago

@vishalmhjn thanks for your answer! As the .parquet files are already compressed, we did not add compression when zipping in the first place. I've just re-tested the zip file and upload creation using create_submission.py. Which browser/OS do you use? Your browser might send a non-accepted MIME type in the request, see e.g. https://stackoverflow.com/questions/856013/mime-type-for-zip-file-in-google-chrome Could you check the MIME type in your browser for the failing submission? In my browser (ff on Linux), it looks as follows for a "stored-only" submission: image If that's the culprit, we can then add the compression while the zipfile lines as suggested by you above and add the MIME type to word press as well as fix. Thanks for your collaboration!

chenkins commented 1 year ago

20

vishalmhjn commented 1 year ago

Thanks again. I remember facing this issue on OSX (safari) and Ubuntu (ff, gc). With the DEFLATED compression, this is not a problem on my system anymore.

here is the screenshot for MIME type, which looks fine:

Screen Shot 2022-09-16 at 12 57 16 PM
chenkins commented 1 year ago

@vishalmhjn thanks for the update and inputs.