search

mapbox / mbtiles-extracts

Extract parts of MBTiles into separate files using a GeoJSON with polygons.
ISC License
51 stars 14 forks source link

mbtiles-extracts fails on large geojson files #18

Open pozzos opened 4 years ago

pozzos commented 4 years ago

On running mbtiles-extracts on a planet sized mbtiles files, and a geojson file with 30000 cities, I get the below output. I tried rewriting that function to produce log output when name was null, and I got a stream of null entries. However, on splitting up the geojson into multiple smaller files (30 cities each) everything seems to be working fine. I tried giving node 16Gb of RAM, but that didn't fix it either...any ideas?

$ npm-do mbtiles-extracts osm-planet.mbtiles cities.geojson NAME tiles processed: 16638447/home/seb/Documents/map/planet/nodemodules/mbtiles-extracts/index.js:162 return name.toLowerCase().replace(/ /g, '') + '.mbtiles'; ^

TypeError: Cannot read property 'toLowerCase' of null at toFileName (/home/seb/Documents/map/planet/node_modules/mbtiles-extracts/index.js:162:17) at /home/seb/Documents/map/planet/node_modules/mbtiles-extracts/index.js:64:37 at Array.forEach () at Stream.onData (/home/seb/Documents/map/planet/node_modules/mbtiles-extracts/index.js:63:24) at Stream.emit (events.js:321:20) at drain (/home/seb/Documents/map/planet/node_modules/through/index.js:36:16) at Stream.stream.queue.stream.push (/home/seb/Documents/map/planet/node_modules/through/index.js:45:5) at emit (/home/seb/Documents/map/planet/node_modules/split/index.js:37:14) at next (/home/seb/Documents/map/planet/node_modules/split/index.js:49:7) at Stream. (/home/seb/Documents/map/planet/node_modules/split/index.js:54:5)