search

GSA / ckanext-geodatagov

data.gov extension
Other
35 stars 39 forks source link

Tracking update weekly #259

Closed Jin-Sun-tts closed 1 year ago

Jin-Sun-tts commented 1 year ago

Pull Request

Related to change tracking update from nightly job to weekly#4345

About

change tracking update from nightly job to weekly

PR TASKS

As we change to weekly update, see when we last have data for and get data from 9 days before then in case new data is available.

FuhuXia commented 1 year ago

hmmm... just realized we are not using today's date if not start_date is given. We actually find the latest update date from the record and do 2 days prior to that. With this logic, no need to change anything.

Changing from 2 to 9 will create 7 days of work with no (not much) benefits.