henriquemor / covid19-Brazil-timeseries

Data collection to analyze the dissemination of COVID-19 through Brazilian states. Contributions are welcome.
Creative Commons Zero v1.0 Universal
44 stars 12 forks source link

Stability of CSV files #4

Closed owahltinez closed 4 years ago

owahltinez commented 4 years ago

Hi @elhenrico, first of all thanks so much for this -- awesome work! I am now using your CSV files to add region-level data to my Open COVID-19 project.

I am currently pulling the CSV files from the GitHub Raw cache (like this one) and I wanted to understand how stable these files are, whether you are likely to change the name, location, format, etc. In case of any changes, how can I be notified so I can update my scripts appropriately?

henriquemor commented 4 years ago

You did an amazing job on your project!

I am keeping the name and structure of the files constant precisely for this case. Would changing something or adding an additional column help you?

Usually I update the data daily according to the last daily update from our Ministry.

I will let you know on any possible breaking changes.

owahltinez commented 4 years ago

Thanks for the kind words :)

The format of the files looks very clean to me, I wouldn't suggest changing it. Adding more columns would be a breaking change for my scripts, since I'm assuming columns are dates except for the first two.

Are you updating the data manually, or are you using some form of automation?

henriquemor commented 4 years ago

Manually with the help of some tools to make it faster.

As the government has shown itself inconsistent in the disclosure of the data, often changing it or going offline without notice, I found the manual approach better for now.

There are others automating it, but last week many were lacking days of data due to this instability.

henriquemor commented 3 years ago

@owahltinez As you asked me to contact you regarding breaking changes, I decided to change the date format from 23/2 to 23/02/2021 Happy new year

owahltinez commented 3 years ago

Thank you for the heads up @elhenrico!