opera-adt / DSWX-SAR

Dynamic Surface Water Extent from Synthetic Aperture Radar
Apache License 2.0
9 stars 6 forks source link

Add support for GDAL raster files in AWS S3 #48

Closed seongsujeong closed 6 months ago

seongsujeong commented 6 months ago

This PR adds support to use the ancillary data located in AWS S3 bucket. GDAL can access them with the prefix /vsis3, provided that the permission & credential to the corresponding S3 bucket is properly set. This branch has been updated in line with the scale-up processing on AWS, but I think it would be better to merge this branch to the main sooner than later so that we can avoid too much deviation.

Another issue that this PR covers is the importing constants in absolute path. Looks like that change is similar as in duplication with #43. I appreciate the information provided by @cmarshak, and glad to see that we've come up with the similar solution. The change in my branch has committed in 11/28/2023, which I think is before that PR.