smnorris / terraincache

Download, cache, merge mapzen terrain-tiles
MIT License
2 stars 0 forks source link

too many open files #2

Closed smnorris closed 4 years ago

smnorris commented 5 years ago

When merging, rasterio is subject to the OS's "limit on open file descriptors" https://github.com/mapbox/rasterio/issues/1636

On my OS (Mac 14.6 - Mojave), the limit is only 256!

$ launchctl limit maxfiles
    maxfiles    256            unlimited

This is far to little for merging terrain-tiles over a moderate area. Building the raster in pieces could work but maybe creating a vrt as the intermediate step would work better.