search

duckdb / duckdb_spatial

MIT License
483 stars 37 forks source link

Kernel crash when ingesting multiple shapefiles in a for loop #151

Open giswqs opened 1 year ago

giswqs commented 1 year ago

What's the recommended way to ingest all shapefiles under a directory into the database, creating a new table for each shapefile. The Jupyter notebook kernel crashes when trying to ingest multiple files in a for loop, but it works fine if ingesting them one by one.

Sample dataset: nyc_data.zip

image

giswqs commented 1 year ago

It works fine after converting all shapefiles to GeoJSON format. Not sure if there is bug with the shapefile reader.

image

Maxxen commented 1 year ago

Hello! Thanks for raising this issue (and providing the data!). I suspect this is a problem with our filesystem layer but I'm going to look into it.