search

ACCESS-NRI / accessdev-Trac-archive

Archive accessdev Trac contents as issues
Apache License 2.0
0 stars 0 forks source link

Housekeep app needs to support arbitrary run lengths #326

Closed penguian closed 7 years ago

penguian commented 7 years ago

resolution_fixed | by mrd599@nci.org.au

In current suites app/housekeep/rose-app.conf has

prune-remote-logs-at=-P3M
prune{share/cycle}=-P3M
prune{work}=-P3M

However the rose housekeep app isn’t very smart and looks for files with a date stamp exactly 3 months earlier to the current run date. If a run is using 6 month chunks nothing matches and so nothing gets cleaned up.

Issue migrated from trac:326 at 2024-01-31 18:30:08 +1100

penguian commented 7 years ago

@martin.dix@anu.edu.au set owner to mrd599

penguian commented 7 years ago

@martin.dix@anu.edu.au commented

The intention was to keep the work and log directories from the last 3 jobs in case of some unexpected problem. Note that this is separate to the ability to restart because the necessary files for that are in the archive directory.

This can be done for any resubmission period by repeating the offset argument in a rose date calculation

   # Target date for cleanup is 3 runs previous
   TMPDATE=$(rose date -c --offset=-[RESUB] --offset=-[RESUB] --offset=-[RESUB])
   OFFSET=$(rose date -c ref $TMPDATE)

Suite change https://code.metoffice.gov.uk/trac/roses-u/changeset/46949

Note that if the resubmission period is increased during the run there will be a few directories missed in the cleanup.

penguian commented 7 years ago

@martin.dix@anu.edu.au changed status from assigned to closed

penguian commented 7 years ago

@martin.dix@anu.edu.au set resolution to fixed