Implement a job purging policy

hotosm / old-export-tool

Version 1 of the Export Tool is suspended - please see V3 https://github.com/hotosm/osm-export-tool

16 stars 18 forks source link

Implement a job purging policy #70

Closed dodobas closed 10 years ago

dodobas commented 10 years ago

for every 'deleted' job introduce a 30 day grace period, during this grace period a job owner or an admin is able to toggle 'deleted' state, once the grace period ends, job, runs, and actual export data will be purged
for every job introduce 6 month grace period and if there are no new runs, toggle job 'deleted' state, effectively setting up execution of the first rule

severinmenard commented 10 years ago

I agree we should not keep eternally every Exports job, as many trainess are creating some that will not be sued anymore. Though there are some that are made to cover a specific location over a country (eg those you access when clicking on the markers on this umap: http://umap.openstreetmap.fr/en/map/central-african-republic_3868) and those could be maintained. Maybe create some superusers privileges for some people being able to tick a checkbox asking if the job should be maintained?

dodobas commented 10 years ago

for the second policy, I'm going to check if there are any new runs in the last 6 months, and if there are, the job would not be marked as 'deleted'

dodobas commented 10 years ago

Tasks:

[x] update script to check/set grace period on jobs without new runs in the last 6 months
[x] implement scripts as cron jobs

dodobas commented 10 years ago

cron job will execute at 01:00 every saturday