search

mansueto-institute / cloudtile

Converting geospatial file formats to vectortile files
GNU General Public License v3.0
2 stars 2 forks source link

ECS unexpected I/O failure #29

Closed nmarchio closed 1 year ago

nmarchio commented 1 year ago

When running the single-step conversion on a 7.2 GB GeoParquet file using the following cloudtile convert single-step --ecs africa_geodata.parquet 9 14

we get the below error:

image
manmartgarc commented 1 year ago

I think it was running out of ephemeral storage, not memory. I upped the storage value from 20GB to 50GB, running the task here for you to check, it hasn't failed in about an hour or so.

Working on a PR to add both cpu and storage (memory is already exposed) override settings for running the ECS task for more flexibility.