search

technologiestiftung / flusshygiene

WIP Monorepo for the project Flusshygiene and all the modules that are actually used
https://badestellen.berlin.de
MIT License
4 stars 1 forks source link

Understanding Rain Data Timing #294

Open hsonne opened 4 years ago

hsonne commented 4 years ago

When are RADOLAN rain data (files) available where? I just did the following test in R:

> Sys.time()
[1] "2020-05-18 12:43:49 CEST"

> today <- Sys.Date()
> find_file <- function(x) basename(fhpredict:::get_radolan_urls_for_days(today, time = x))

> find_file("0050")
"raa01-sf_10000-2005180050-dwd---bin" 

[...]

> find_file("0750")
"raa01-sf_10000-2005180750-dwd---bin" 

> find_file("0850")
character(0)

At 12:50 CEST all files between "0050" and "0750" are available on the AWS server but the file "0850" is not (yet). The file names refer to UTC, i.e. the last availble file "0750" relates to 09:50 CEST.

ff6347 commented 4 years ago

The process is run every 6h 5am, 11am, 5pm, 11pm. I actually don't know how long it takes for the DWD to process their data. I think we already had an issue where we discussed the data.

ff6347 commented 4 years ago

Here we go https://github.com/technologiestiftung/flusshygiene/issues/278#issuecomment-619975133

ff6347 commented 4 years ago

Based on timestamps the data needs 2.5h to arrive on the DWD ftp.