search

maproulette / maproulette3

MapRoulette, the micro-tasking tool for OpenStreetMap
https://maproulette.org
MIT License
127 stars 34 forks source link

Only 400 tasks showing up out of 5601 line upload #701

Closed typicalTYLER closed 5 years ago

typicalTYLER commented 5 years ago

I uploaded this file: https://gist.github.com/typicalTYLER/4b1c71cee219b566cf5d670a88a5aee5 as a geoJSON defining a challenge, and only 400 tasks showed up after 2 hours. I'll check back again in the morning and delete this issue if it shows all the tasks. Here's the challenge https://maproulette.org/admin/project/3749/challenge/4013

typicalTYLER commented 5 years ago

Still only 400 are showing up after 11 hours.

nrotstan commented 5 years ago

Hi @typicalTYLER, it looks like we have a bug where the upload progress isn't being displayed properly for line-by-line geojson uploads, but your file does upload properly in my tests and creates all the tasks if the upload isn't interrupted. My guess is that you inadvertently interrupted the upload since no progress was displayed. Once interrupted, no more tasks will be created.

I'd give it another try and, just to be safe, wait 5 mins after clicking "Finish" when creating the challenge before trying to see how many tasks were created. I'll take a look at fixing the progress display bug.

Let me know if you still have trouble, and thanks for the report!

typicalTYLER commented 5 years ago

Thanks! Rebuilding and uploading the file again seemed to work. I think maybe the whole system was overloaded at the time as I was experimenting with other large overpass queries and making tasks based off of them. Thanks for your help!

Follow up q: Do I need to rebuild tasks for the priority rules I set up afterward to take effect?

typicalTYLER commented 5 years ago

Also I'm still having trouble uploading geojson files every once in a while, it'll hang at 0 tasks uploaded for a really long time, and then eventually I'll click out of the window, and then an hour or so later my task will only have 130 or so tasks remaining and I'll have to rebuild again. And now whenever I try to access the task I get a 504 error.

Update: it's working again! I think maybe when there's a large difference between task sets (I change the algorithm that generates them to make them all a little different) and it has to delete all the non-matches maybe it bogs down the system.

Another update: It's not working again, after starting a rebuild with an uploaded geoJSON it hangs at 0 tasks uploaded for >1 hour (and when I check the challenge admin page in another tab it has 100 tasks remaining in addition to the ones that have been already completed. (Which is much smaller than the ~4100 line file). And now when I kill and retry after 1.5 hours it works immediately.

nrotstan commented 5 years ago

@typicalTYLER the fix for upload progress not displaying was deployed to maproulette.org on Wednesday, which should help with the issue you experienced.