search

kinverarity1 / python-sa-gwdata

Python package for the Groundwater Data section of the DEW WaterConnect website
https://python-sa-gwdata.readthedocs.io/en/latest/index.html
MIT License
3 stars 0 forks source link

Local data cache, starting with drillhole layer from the spatial data downloads page (WIP) #31

Closed kinverarity1 closed 11 months ago

kinverarity1 commented 1 year ago

This PR will implement a local data cache folder.

Initially it will just be a straight download of the drillholes statewide layer from the Spatial Data downloads page on WaterConnect. This will be done on user request transparently. It will serve to make validation of well identifiers and providing summary views/lookups much quicker and easier.

Update: cache demo notebook: https://gist.github.com/kinverarity1/a93ff5a275840dc7eb466fee37449dd9#file-gds_cache_pr31-ipynb

Later the cache might be expanded to cover bulk data downloads in specific areas. Not sure how unwieldy statewide caches might be.

kinverarity1 commented 1 year ago

Note to self - suggested dh layer column remappings

dh_layer_col_remappings.csv