dawson6
commented
1 year ago BTW I tested the current behavior with the mc project, what Jason was seeing.
ATS:(level=20, np=10, etc.)
I ran ats with the option --timelimit=5s
and observed that it timed out in 5 seconds.
Then I updated the ATS line to be:
ATS:(level=20, np=10, timelimit=1, etc.)
That did not timeout in 5 seconds, but it did at the 60 second (1 minute) mark.
The per-test option of 'timelimit=1' over-rode the command line option of --timelimit=5s'
Can we get the command line option --cutoff=5s to over-ride that per-test option, so that the test is killed at 5 s.
I believe this may leave tests in the HALTED rather then TIMEOUT state, but that may be just fine.
[Yesterday 4:56 PM] Burmark, Jason ats question, in the Ares tests we sometimes set a specific time for a problem that overrides the default time. I would like to be able to set a default time that would override the specific times if the default time was larger.
[Yesterday 4:59 PM] Burmark, Jason I'm running into an issue where I run tests with special debugging stuff enabled that slows it down. Its easy to increase the default time but if a test has a specific time its not easy to override that.
[7:25 AM] Dawson, Shawn A. Alrighty, this may be a good project for Zakharchanka, Mikhail .
I ran some tests and confirmed the order of operations for the --timelimit option.
1) --timelimit on test line over-rides 2) --timelmit on command line which over-rides 3) default time limits.
[7:26 AM] Dawson, Shawn A. My understanding is that you want a command line option which will over-ride the 'per test' time limit. So if the per test --timelimit=30 (time seems to just take a single digit at this time, which is minutes) that you could over-ride it on the command line to be 1 minute or whatever. [7:27 AM] Dawson, Shawn A. I think that used to be the purpose of the (perhaps not being used at this time) --cutoff option. The help states this for --cutoff and --time [7:27 AM] Dawson, Shawn A. -t TIMELIMIT, --timelimit TIMELIMIT Set the TIMEOUT default time limit on each test. This may be over-ridden for specific tests. Jobs will TIMEOUT at this time. The value may be given as a digit followed by an s, m, or h to give the time in seconds, minutes (the default), or hours.
[7:27 AM] Dawson, Shawn A. --cutoff CUTOFF Set the HALTED halt time limit on each test. Over- rides job timelimit. All jobs will be HALTED at this time. The value may be given as a digit followed by an s, m, or h to give the time in seconds, minutes (the default), or hours. This value if given causes jobs to fail with status HALTED if they run this long and have not already timed out or finished.
[7:29 AM] Dawson, Shawn A. Seems like the --cutoff option (we could rename that perhaps, not sure if any projects are actually using it) could be repurposed to over-tide the time limits specified for each specific job. [7:29 AM] Dawson, Shawn A. Does that sound about right Burmark, Jason and Zakharchanka, Mikhail