Open nish-kishore opened 2 months ago
The purpose of this new function is to append new data to the local dataset with the same structure as what is returned by get_all_polio_data()
. Need to figure out the best way to handle deduplication and caching the metadata
A wrapper around
get_all_polio_data()
which takes in a single parameter:local_dataset
.The function can be called
update_polio_data
and will download thesmall
polio dataset and merge in each dataset into thelocal_dataset
while also guaranteeing deduplication and any other data errors. It will then return this new merged dataset. Maybe we can also cache the metadata somewhere and have it check against that before it performs an update?