I have to download GFS or ERA data once again when I interrupt the process?

schism-dev / pyschism

Python interface for handling the SCHISM model.

https://schism-dev.github.io/schism/master/getting-started/pre-processing-with-pyschism/overview.html

Apache License 2.0

23 stars 18 forks source link

I have to download GFS or ERA data once again when I interrupt the process? #125

Open lj-cug opened 3 months ago

lj-cug commented 3 months ago

When I interrupted the forcing data processing, the GFS or ERA-5 data have to been downloaded once again, the historic downloaded data cannot be read? The downloading elapsed time sometimes is long. Li Jian

SorooshMani-NOAA commented 3 months ago

I'm just a pyschism user, so I don't know the full details of the implementation; my understanding is that there's no caching mechanism for partially downloaded meteorological forcing files. At least ERA5 doesn't seem to have it. GFS has 3 different implementations, but I still think they don't have that functionality

cuill commented 2 months ago

The downloaded data was saved to a temporary folder created by tempfile.TemporaryDirectory(). After generating sflux files, this folder will be deleted.

Downloading ERA5 has been slow in the last couple months because they are in a transition to a new API which caused the longer queueing time.