geodesymiami / insarmaps

3 stars 0 forks source link

server responded with code: 500 error due to too large file? #61

Closed falkamelung closed 2 years ago

falkamelung commented 2 years ago

Hi @stackTom The other unresolved item is the maximum file size we can ingest. For a large file I got the error below. And now I always get this error and can't ingest anymore. Did some permissions get messed up? It would be good if the script could return more information on the reason for the error and how to fix (rebooting does not help).

Other occasional errors I get are pycurl.error: (26, '') and most often due to running out of Memory (RAM) as described here

cd /data/SARA_MIAPLPY/GalerasSenTD142
json_mbtiles2insarmaps.py -u insaradmin -p Insar123 --host insarmaps.miami.edu -P rsmastest -U rsmas\@gmail.com --json_folder JSON --mbtiles_file JSON/${h5file%.*}.mbtiles
Uploading json chunks...
Clearing old dataset, if it is there
Creating index on S1_IW123_142_0591_0596_20150624_20220530
Inserted chunk_6.json to db
Inserted chunk_7.json to db
Inserted chunk_3.json to db
Inserted chunk_4.json to db
Inserted chunk_1.json to db
Inserted chunk_11.json to db
Inserted chunk_2.json to db
Inserted chunk_9.json to db
Inserted chunk_13.json to db
Inserted chunk_8.json to db
Inserted chunk_12.json to db
Inserted chunk_10.json to db
Inserted chunk_5.json to db
Uploading mbtiles...
The server responded with code: 500
stackTom commented 2 years ago

I am seeing this issue now too. Do you know how to fix it. Don't think it's file size issue. Seems to just be a bug. No idea what causes it.

I am trying to upload a distributed scatter so the tippecanoe developer can see the issue and help me. But I keep getting this error.

I wish I could log into the insar server so I could not only try to upload the file but also see why we get this error. But I still have no access.

falkamelung commented 2 years ago

We can do chrome remote

stackTom commented 2 years ago

Sure. I am ready if you are. Email or text me the ID when you're ready.

stackTom commented 2 years ago

I think this is fixed. Please reopen if still have issues. Script returns better error messages now. Please pull to see them.