search

COVID-Weather / covid-environmental-factors

Analysis of COVID19 infection rates and their environmental conditions
GNU General Public License v3.0
4 stars 2 forks source link

Improves ERA5 download script #13

Closed glwagner closed 4 years ago

glwagner commented 4 years ago

The request is running...

(base) ~/Projects/covid-environmental-factors/scripts$ python download_era5_temperature_dewpoint_pressure.py 
2020-03-27 07:57:28,215 INFO Welcome to the CDS
2020-03-27 07:57:28,215 INFO Sending request to https://cds.climate.copernicus.eu/api/v2/resources/reanalysis-era5-single-levels
2020-03-27 07:57:28,670 INFO Request is queued
2020-03-27 07:57:29,761 INFO Request is running

But that's all I got so far.

@hdrake (or others) let me know if this works for you. Happy to fix it up more too.

hdrake commented 4 years ago

But that's all I got so far.

Did it go through?

glwagner commented 4 years ago

Did it go through?

Yes!

Any reason we're sampling every two hours? Just to make the data request half as big? Are we sure we want to effectively get rid of half of the dataset?

Yes, the purpose of reduced sampling is to reduce the size of the data request. I'm happy to to back to sampling every hour. We can split the requests up by month.

Earlier I had trouble writing a loop over the requests, but that's a bad excuse for not breaking the requests up :-/

Let me know what you think, happy to make changes.

glwagner commented 4 years ago

By the way, should we move these scripts into the /data folder? We will probably have lots of scripts, not all of them related to downloading data.

glwagner commented 4 years ago

@hdrake ok, I split the downloads by month and ask for hourly data. I'm not sure if my python skills failed me but I was forced to copy/paste the requests. Anyways, I guess it works for now.

hdrake commented 4 years ago

This is great, thanks Greg!