Urban-Analytics-Technology-Platform / poppusher

https://popgetter.readthedocs.io/en/latest/
Apache License 2.0
7 stars 1 forks source link

Revise extraction of catalog in Scotland #135

Open sgreenbury opened 4 months ago

sgreenbury commented 4 months ago

Currently (#58) the catalog is constructed through extraction of a zip to a cache directory, with census tables subsequently read from the cache_dir.

Instead the zipfile/extracted files and/or the extracted files should be handled into census tables either:

This enables functionality on a cluster rather than single machine.