cylc log files

[penguian]

resolution_fixed | by rb4844

---

The cylc log files generated from an ACCESS coupled run on Raijin get copied back to accessdev in a cylc-run job directory. However the last few time steps never seem to get transferred. Eg, for a 1 year run with 12 monthly restarts, 9 months of job details are copied over to accessdev but the last three months stay on Raijin - can this be fixed so the whole job is complete in one place?

---

Issue migrated from trac:346 at 2024-01-31 18:32:32 +1100

[penguian]

rb4844 commented

---

Actually appears its now the job.out files that are missing, the rest of the directory structure and files are there - not sure if this is consistent behaviour or not.

[penguian]

@martin.dix@anu.edu.au commented

---

By default only log files of size < 2 MB are retrieved automatically. This was ok for one month runs but probably isn't enough for 3 month or longer chunks.

In your suite.rc, try increasing the size in the NCI remote section. E.g.

[runtime]
  ...
  [[NCI]]
    ...
    [[[remote]]]
      retrieve job logs max size = 5M

[penguian]

@martin.dix@anu.edu.au changed status from new to closed

[penguian]

@martin.dix@anu.edu.au set resolution to fixed

[penguian]

@martin.dix@anu.edu.au commented

---

Still need to streamline handling of log files, but closing this ticket and continuing work in #348.