search

nasa / EMIT-Data-Resources

This repository provides guides, short how-tos, and tutorials to help users access and work with data from the Earth Surface Mineral Dust Source Investigation (EMIT) mission.
Apache License 2.0
138 stars 81 forks source link

Change Download Method used for EMIT granules #42

Closed ebolch closed 1 year ago

ebolch commented 1 year ago

There was a memory issue for large files/long lists of files for the methods used in our notebooks. Switched from using an fsspec https session to a requests https session and improved the code to write to disk in smaller chunks.

ebolch commented 1 year ago

diff is so large because I removed cell outputs