Chicago / buildings

A project to create a simple interface for visualizing building data.
https://github.com/Chicago/buildings/wiki
MIT License
5 stars 1 forks source link

Memory problem with build-json.R #26

Closed nicklucius closed 6 years ago

nicklucius commented 6 years ago

When creating building.json, some OS's run out of memory (Windows, Linux) and crash the R Session. It seems likely to be a problem with the geospatial libraries and/or their dependencies, and the OS is not reusing memory that should be reopened each time the loop is run (once for each census tract).

Since build-json.R writes a json file to disk for each census tract, the processing can be chunked into a few batch runs, with the R session terminated and restarted (reclaiming memory from the OS).

nicklucius commented 6 years ago

The problem is solved for creating the .json files for all the buildings. Ready to close.