To plot a first timeseries, I download timeseries-tidy-small.csv, which takes a long time (a minute or more) since the file is large. This file has dates in it for each location.
One day later, I'd like to be able to use the timeseries I downloaded the previous day, then just download the much smaller latest.csv for the one extra day. But I can't, because neither latest.csv nor latest.json have information on when the data was updated for each location, so there's no way to know whether latest.csv represents a new day, or a date that's already covered in timeseries-tidy-small.csv. I can't go by the modified-date of latest.csv on the web server, because it seems that it's constantly being updated, even though each location is probably only updated once per day.
Could timeseries-tidy-small.csv include one more field, date, that corresponded to the date field in timeseries-tidy-small.csv? Or is there some other way (that doesn't require downloading the full timeseries file) to find out the last update time for a given location?
To plot a first timeseries, I download timeseries-tidy-small.csv, which takes a long time (a minute or more) since the file is large. This file has dates in it for each location.
One day later, I'd like to be able to use the timeseries I downloaded the previous day, then just download the much smaller latest.csv for the one extra day. But I can't, because neither latest.csv nor latest.json have information on when the data was updated for each location, so there's no way to know whether latest.csv represents a new day, or a date that's already covered in timeseries-tidy-small.csv. I can't go by the modified-date of latest.csv on the web server, because it seems that it's constantly being updated, even though each location is probably only updated once per day.
Could timeseries-tidy-small.csv include one more field, date, that corresponded to the date field in timeseries-tidy-small.csv? Or is there some other way (that doesn't require downloading the full timeseries file) to find out the last update time for a given location?
Thanks -- covidatlas/li is a great resource!