search

ngageoint / sarpy

A basic Python library to demonstrate reading, writing, display, and simple processing of complex SAR data using the NGA SICD standard.
MIT License
243 stars 81 forks source link

Support for S3 bucket #523

Open effeminati opened 2 weeks ago

effeminati commented 2 weeks ago

I would like to process data directly on the cloud without the need to download data to the local filesystem. I tried, but I was not able to open remote files with Sarpy.

Do you foresee extending the interface to do this?

Sarpy is a valuable library capable of opening and standardizing data from many different SAR sensors. Making it able to work on the cloud would make a significant difference.

pressler-vsc commented 2 weeks ago

Yes! As you point out, only a very limited subset of interfaces (e.g.) are architected in a way that is compatible with something like smart-open.

There is currently an effort underway to modernize SarPy, and standardizing I/O in a way that enables working with large remote files is a key goal.

naething commented 22 hours ago

For the file types that are currently supported you can see an example of how to do so here:

https://sarpy.readthedocs.io/en/latest/examples/first_example.html#opening-remote-file