search

EUREC4A-UK / lagtraj

Python trajectory code for Lagrangian simulations
MIT License
11 stars 9 forks source link

Download multiple days from CDS api #10

Open leifdenby opened 4 years ago

leifdenby commented 4 years ago

@sjboeing suggested this might speed up downloading. We might also hit a ceiling on max number of requests if we don't do this I think, no?

sjboeing commented 4 years ago

I think we might indeed run into issues if we try to download the domain for a whole month: so far I have downloaded up to 4 days (a typical trajectory) without trouble. The drawback of downloading multiple days and then splitting is that in some cases the data will become too big for online conversion to netcdf (though downloading grib and converting offline would still be possible), so if this is done it should probably be optional. Another intermediate solution is to limit the number of requests that are submitted, and then wait for these to download before proceeding.