search

NewGraphEnvironment / dff-2022

Building digital field forms and processing data collected using R, postgresql, QGIS and other tools
Creative Commons Zero v1.0 Universal
0 stars 3 forks source link

script from lidarbc to cloud #74

Open NewGraphEnvironment opened 1 year ago

NewGraphEnvironment commented 1 year ago

The Cloud Optimized Geotiff (cog) storage on AWS is neato and there are ways to use Lambda that you just download the files like the lidar (using wget probably) straight to your bucket and a function converts it from tiff to cog. https://aws.amazon.com/blogs/storage/automatically-convert-satellite-imagery-to-cloud-optimized-geotiffs-for-hosting-in-amazon-s3/

NewGraphEnvironment commented 1 year ago

hmmm.

https://github.com/bcgov/bcmaps/issues/99

https://github.com/smnorris/bcdata/issues/107

NewGraphEnvironment commented 1 year ago

Well. Better late than never. No need to download or rio cogeo create or upload anything using the Q Data Source Manager and the HTTP cloud Propocol. We can link directly to the https://nrs.objectstore.gov.bc.ca/gdwuts hostedcogs and keep things light.

Good to have in our pocket though in case we want to add the odd file offline. rio cogeo create with the defaults really reduces the storage size which makes them closer to reasonable for carrying around on a phone too.

https://github.com/bcgov/bcmaps/issues/99 has some really slick scripts for grabbing files based on Area of Interest (AOI) which will likely come in handy. Will leave open because grabbing the odd file will still be happening.

image