search

pangeo-forge / staged-recipes

A place to submit pangeo-forge recipes before they become fully fledged pangeo-forge feedstocks
https://pangeo-forge.readthedocs.io/en/latest/
Apache License 2.0
39 stars 63 forks source link

Example use-case for Landsat data on AWS #7

Open tjcrone opened 4 years ago

tjcrone commented 4 years ago

Here is an example notebook showing a version of problem we are working to solve:

https://github.com/ldeo-glaciology/REMAWaterRouting/blob/b473a510bc57901119a85f3ba15051016984a943/landsat8_load.ipynb

Includes command-line magic for wget, instructions to manually download data from another external website, downloading zipped shape files and calculating intersections with image bounding boxes, downloading a list of images on S3 and the use of Beautiful Soup, some image processing with Numpy, and some other things as well.

This is a great example of toil, because although it appears to be working for the author, I was not able to get it to work. I think if Pangeo-forge can solve this type of use case scenario, we would be doing fantastic!

rabernat commented 3 years ago

Tim, it would be very helpful if you could put this issue in the same format as the others, following the issue template. Thanks!

This is a pretty complex case. To move forward, we will need to translate it into a specific list of enhancement-request as issues in pangeo-forge.

rabernat commented 3 years ago

The image processing is possibly related to https://github.com/pangeo-forge/pangeo-forge/issues/48.