search

NIEHS / beethoven

BEETHOVEN is: Building an Extensible, rEproducible, Test-driven, Harmonized, Open-source, Versioned, ENsemble model for air quality
https://niehs.github.io/beethoven/
Other
4 stars 0 forks source link

Branched download targets error #349

Open sigmafelix opened 2 months ago

sigmafelix commented 2 months ago

When I use my laptop, branched download targets do not save actual files to the specified directories even though a curl/wget prompt reported the download was complete.

sigmafelix commented 1 month ago

As an external validation, I tested set_args_download and actual download sessions on my personal laptop in the external network. Download speed from NASA servers often drops to <100KB/s but most of the time I saw 2.5MB/s on average with a decent ethernet connection. Parallel downloading as implemented in modisfast is a viable option, but this is obviously of amadeus level update. Honestly, I prefer to use modisfast since it uses OpenDAP to download the space-time cube only with necessary layers to reduce bandwidth usage. I will look at this option along with updating set_args_download.