psteinb / covid19-curve-your-city

Extrapolation der COVID19 Fallzahlen
BSD 3-Clause "New" or "Revised" License
9 stars 5 forks source link

github actions zero out Dresden data #35

Closed psteinb closed 3 years ago

psteinb commented 3 years ago

@vv01f I see that the automated script that pulls the data for Dresden apparently zeros out all columns except diagnosed. Compare 6cd762d5e346c6a77367fe8dfc2ff879d875cc66 and 6419daa46f4c2eb8621c15a291f3652b6c35910b. The diff for the latter is intriguing! it changed all rows dating back to Mar 12. This might be due to changes on dresden.de. I am not sure. Could you please have a look?

vv01f commented 3 years ago

some nasty change indeed, that was supposed to be a feature to have the later corrections of earlier numbers included instead of just the last line added. now it seems they drop data (supposedly for "optimizing" storage or just out of bad practice) on arcgis.com – we do not pull anything from dresden.de. Problem is I do not see how we can have it both ways as is, I'd say either we get just last line or take in the backward corrections. Anything else could be done manually as well. Will have a look tomorrow for doing both strategies of keeping data in separate files.

psteinb commented 3 years ago

Awesome! Thanks for clarification regarding arcgis vs dresden.de. let me know of you progress. I plan to revamp this project this week and potentially work on the fit.

vv01f commented 3 years ago

pr ready, recently "lost" data back in place

psteinb commented 3 years ago

This is great news. Thanks for investing time in this.

On 11/5/20 11:07 PM, Wolf wrote:

pr ready, recently "lost" data back in place