radical-cybertools / radical.saga

A Light-Weight Access Layer for Distributed Computing Infrastructure and Reference Implementation of the SAGA Python Language Bindings.
http://radical-cybertools.github.io/saga-python/
Other
83 stars 34 forks source link

Review options for PBSPro tools (`qstat`, `qdel`, etc.) #874

Closed mtitov closed 1 year ago

mtitov commented 1 year ago

Some incorrect (or obsolete) options cause a corresponding tool to fail, and we lost ability to monitor submitted jobs

Tools for review presented in a corresponding user guide for Polaris - https://docs.alcf.anl.gov/running-jobs/job-and-queue-scheduling/

Example of error:

1681311863.724 : radical.saga.cpi     : 27952 : 139982714959616 : WARNING  : Exception caught in job monitoring thread: 
Error running qstat: qstat: conflicting options.
usage: 
qstat [-f] [-J] [-p] [-t] [-x] [-E] [-F format | -w] [-D delim] [ job_identifier... | destination... ]
qstat [-a|-i|-r|-H|-T] [-J] [-t] [-u user] [-n] [-s] [-G|-M] [-1] [-w]
    [ job_identifier... | destination... ]
qstat -Q [-f] [-F format] [-D delim] [ destination... ]
qstat -q [-G|-M] [ destination... ]
qstat -B [-f] [-F format] [-D delim] [ server_name... ]
qstat --version

another useful info from SAGA log

1681311804.920 : radical.saga.cpi     : 27952 : 139983922919168 : INFO     : Found PBS tools: 
{'pbsnodes': {'path': '/opt/pbs/bin/pbsnodes', 'version': 'pbs_version = 2022.1.1.20220926110806\n'}, 
 'qstat': {'path': '/opt/pbs/bin/qstat', 'version': 'pbs_version = 2022.1.1.20220926110806\n'}, 
 'qsub': {'path': '/opt/pbs/bin/qsub', 'version': '?'}, 
 'qdel': {'path': '/opt/pbs/bin/qdel', 'version': '?'}}