gjoseph92 / stackstac

Turn a STAC catalog into a dask-based xarray
https://stackstac.readthedocs.io
MIT License
238 stars 49 forks source link

Stackstac on AWS EC2 #153

Closed vitusbenson closed 2 years ago

vitusbenson commented 2 years ago

Hi @gjoseph92 ,

in the Readme there is this line: https://github.com/gjoseph92/stackstac/blob/0dff7cf1fd1e68e421f03fde5db32302bed12f7b/README.md?plain=1#L93

I am trying to figure out how to best use stackstac in an AWS instance, for example for reading Sentinel 2 COGs. I realize the pystac_client gives only http: urls and not the s3:. Was wondering if gdal_env solves that or if I would have to manually fiddle with the stac items.

I am aware of the great work you do with coiled, however due to billing issues it is not an option for this project - that is why I am trying to do this directly in AWS. The idea is run an instance that is in the same region as the data and thus get high read speed. Unfortunately I currently just see an increase of 2x compared to running locally, which confuses me.

Do you have any tips?