LLNL / ATS

ATS - Automated Testing System - is an open-source, Python-based tool for automating the running of tests of an application across a broad range of high performance computers.
BSD 3-Clause "New" or "Revised" License
6 stars 5 forks source link

Flux timeout marked as failure by ATS #116

Closed MishaZakharchanka closed 9 months ago

MishaZakharchanka commented 1 year ago

When a in Flux times out after being started with the "-t" option ATS marks it as a failure. Flux throws a job.exception that has a type of timeout, this information could be used in ATS to properly report timeouts.

Here is the output of a test that have timed out and currently reports FAIL: 5.035s: job.exception type=timeout severity=0 resource allocation expired flux-job: task(s) exited with exit code 142

dawson6 commented 11 months ago

Misha, do you think it would be possible to update the flux module to put the timeout tests into the TIMEOUT category rather than the FAILEd?