globaldothealth / list

Repository for Global.health: a data science initiative to enable rapid sharing of trusted and open public health data to advance the response to infectious diseases.
MIT License
39 stars 8 forks source link

Automated reporting of UUID stability #1905

Open abhidg opened 3 years ago

abhidg commented 3 years ago

We need automated reports of UUID stability for datasets with UUIDs. If we don’t have stable UUIDs then we shouldn’t use them to upsert cases such as in #1904.

We save the source CSVs in S3 so it is possible to compare against history.

abhidg commented 3 years ago

Prioritizing ingestion with provided UUIDs at the moment. Once we get all ingestions running smoothly, we can take a look at automated reporting.