AtlasOfLivingAustralia / data-management

Data management issue tracking
7 stars 0 forks source link

Fix the lastCheckedDate and dataCurrencyDate in Collectory #803

Open peggynewman opened 2 years ago

peggynewman commented 2 years ago

The Collectory has 2 dates per data resource that are full of errors for most datasets. For example, the iNaturalist DR, which is updated weekly, in the collectory says:

This resource was last checked for updated data on 17 Jun 2021. The most recent data was published on 17 Jun 2021.

This is not true.

This issue is to work out how to update these dates from a job running in production, and possibly update the text in collectory to say something more meaningful. We don't "check" for resources like GBIF does, so the statement is redundant. We should probably be using firstLoadedDate and/or lastLoadedDate and/or the most recent eventDate to give a better picture of the currency of the dataset to users.

djtfmartin commented 2 years ago

This could be done via a small jenkins script with API call to the collectory to update the timestamp when the job has ran successfully.