search

pangeo-data / cog-best-practices

Best practices with cloud-optimized-geotiffs (COGs)
BSD 3-Clause "New" or "Revised" License
77 stars 9 forks source link

requester pays on a dask gateway cluster? #12

Open rsignell-usgs opened 2 years ago

rsignell-usgs commented 2 years ago

Does anyone have a working example of using requester_pays=True on a dask gateway cluster?

The requester pays notebook works, but doesn't really use a gateway cluster. The cell at the end purports to show how to pass the env to the dask workers, but the env is not a dict -- I don't think it works?

rsignell-usgs commented 1 year ago

I eventually figured this out, and I didn't need to use the rasterio Env object. Here's a notebook showing a Dask Gateway cluster running on Qhub, accessing requester-pays Landsat data, extending the Landsat example from the Element84 Geo-Notebooks repo

rsignell-usgs commented 1 year ago

cc @scottyhq !