Azure server - Githubissues

Due to acquiring a subscription to Azure, we need to update ARC to allow for the usage of Azure as well as ESS like QCHEM. Please see the list below of all the changes. NOTE: Tests still need to be fixed or written for these new changes

Added 'rapidfuzz' to ARC environment
basis set dataframe for QChem
check_normal_mode_displacement - Allow for a try and except case
Adapter: Submit Script Format updated with using user provided username {un}, also convert memory to an 'int', and also provide the option of {server_nodes} if required
Adapter: Total Submit Memory adjusted to now ensure that when troubleshooting a job, it never attempts to go OVER the maximum memory of the allowed submission memory of the node/server
Adapter: SLURM Submit Memory - Using #SBATCH --mem as the parameter now as it defines the TOTAL memory of the submission
Adapter: SSH File Download - We do not expect to always download or upload certain files depending on the scheduler via SSH. This change allows for recognising if certain files will be uploaded or downloaded depending on the user's scheduler choice
Adapter: Null Bytes can appear in files, or rather more specifically, if QChem has an error, it can produce Null Bytes in the out.txt/err.txt files and thus requires a different type of reading of the file contents. This is not 100% full proof though and may need extra work
Adapters: In #390 branch, SSH had improvements but were not merged. I have brought forth an improvement from this branch were Remote Files are removed once they are download to the local computer
ARC can now recognise that IRC is also supported by QChem
common.py: Slight reworking of the trouble shooting of the scan resolution so that it once the obj.scan_res has been defined with the new rotor scan resolution, the scan res is removed from the obj.args['trsh']['scan_res'] properly
SSH: Updated decorator to use the correct connect function
SSH: If the user provides a server that is not in servers.keys() and server is also not None, then an error is raised to informat the user that they need to fix up the server keys
SSH: An error that can occur is when a submission to a scheduler includes an incorrect memory specification, then there is warning to the user that the requested memory is not supported and needs to be checked. May need to make this a ValueError instead of a logger warning
SSH: Slight adjustment to checking if there is an stdout after submission attempt
SSH: Some servers require private keys. Originally the code was incorrectly adding the private key to the SSH paramiko function. It has now been changed so that system keys are loaded and then if the user provides a private key, it is included in the connect function
SSH: Updated default arguments to get_last_modified_time
SSH: Changed the lowering of the cluster soft
SSH: Added a function to remove the directory on the remote server
SSH: Azure SLURM has an extra status called 'CF' which means configuring (for the node). This can take 10-15 mins or so before the node is online. We now ensure to caputre this. HOWEVER, a node can get stuck in 'CF' status. Now we check this via checking the current time the node has been active, splitting the time up correctly (different formats of time are possible), and then if it is above 15 minutes, we run the command scontrol show node {node_id}. If the stdout includes the phrase 'NOT_RESPONDING' then we return 'errored'
XYZ to Smiles: Warning Update to Possible Valence
Vectors: Reading Coords that are in string format using regex and putting into a tuple
Species: The original code did not functional correctly - nor was never used hence why it was passed into production. It has now been changed to properly return the actual number of heavy atoms.
[WIP] Getting the Internal Coordinates for QChem - Still not operational
submit.py & settings.py: Updated for SLURM and AZURE
Scheduler: Now imports JobError
Scheduler: Fixed adding trsh to the args
Scheduler: Added JobError exception for determining job status
Scheduler: Now removing remote jobs at the end of the scheduler - !!!MAY NEED TO SEE IF THIS HAS AN EFFECT ON NON SSH JOBS!!!
Scheduler: Getting the recent opt job name via properly checking if the opt job was considered done (This was not done before)
Scheduler: TODO - We attempt to trouble shoot a frequency we deem not okay. Yet, there is no specific troubleshoot method, so why do we do this?
Scheduler: Properly troubleshoot an job
Scheduler: Fix conformer troubleshoot if it was a TS conformer
parser: TODO - Why do we set raise error as true for normal mode displacement parsing? It has an effect on the function of raising a not implemented error even though it is implememnt
parser: Now can parse the normal mode displacement of QCHEM
parser: Now can parse the 1d scan coords of QCHEM
parser: Can now parse trajectory of QCHEM
parser: Can now parse arguments in the scan input file QCHEM
parser: NEED to fix parse_ic_info for QCHEM
QChem Adapter: Import - Pandas, ARC_PATH, rapidfuzz
QChem Adapter: Input Template now supports IRC and {trsh} args and ensures IQMOL_FCHK is false (This can be set to true BUT be aware this .fchk file can be rather large)
QChem Adapter: write_input_file - basis set is now matched via the software_input_matching function
QChem Adapter: write_input_file - QChem now supports D3 method. We should look at working with other DFT_D methods in the future. More specifically there are other types of D3 methods
QChem Adapter: write_input_file - Correctly pass in troubleshooting arguments into the input file
QChem Adapter: write_input_file - Capitalised TRUE/FALSE in UNRESTRICTED parameter
QChem Adapter: write_input_file - Removed the scan job type and moved it to another section of the input file writing
QChem Adapter: write_input_file - If scan is set, the job_type is PES_SCAN. We also set the fine to be XC_GRID 3. However, we may need to look into changing the tolerances later
QChem Adapter: write_input_file - We now write correctly the torsional scans for the input file for a scan
QChem Adapter: write_input_file - IRC is now supported, however this input file means we run two jobs from the one input file - A FREQ job and then IRC. This currently works but will need improvements when used more by users
QChem Adapter: write_input_file - Ensuring that the SCF CONVERGENCE is 10^-8 for certain job types
QChem Adapter: [NEWFUNCTION] generate_scan_angles - to support PES SCAN jobs, we have a function that will look at what the required angle we want to scan, and the step size, and then return a start and end angle between -180, 180 that will ensure we scan the require angle during the stepping
QChem Adapter: [NEWFUCNTION] software_input_matching - Since QCHEM has different formatting for basis sets, this function will try take the users format of the basis set and match it against a dataframe (which should always be updated if its missing a format). This uses the new package in the ARC environment called rapidfuzz
TrshQChem: Fixed error checking in QChem output files. It would originally mistakenly think SCF failed was the error due to what errors it would look for in the lines
TrshQChem: FlexNet Licensing Error - If the license server is not working this will cause ARC to stop
TrshQChem: Max Optimisation Cycles is probably checked for in the output file
TrshQChem: Max Iteration Cycles is identified now if there is a failure during SCF convergence
TrshMolpro: Molpro reports memory errors that need to be properly troubleshooted differently than what we did originally. Now, we will look for how much memory needs to be increased in order for molpro to run successfully. This is done through regex pattern matching. We also check for triples memory increase if required
Trsh: determine_job_log_memory_issue - Sometimes the job log can have null bytes in them, usually a QCHEM issue, and so this means we need to open the file to read differently
TrshQChem: trsh_ess_job - QCHEMs trsh has been reworked so now that it will combine troubleshoot attempts if they were attempted previously. For example, if we troubleshooted the max opt cycle but now need to turn on SYM IGNORE, it will include both of these statements in the troubleshooting input file
TrshQMolpro: trsh_ess_job - Molpro required a chnage in how we troubleshoot the memory. If we get an error for the memory it is because either the MWords per process is not enough, even though we have provided an adequate about of memory to the submit script OR the MWords per process is enough but the TOTAL MEMORY (MWords * CPUS) > Max Node Memory, therefore CORES has to be reduced.
TrshSSH:trsh_job_on_server - Fixed it as a 'with' statement so the client is closed when exiting the 'with' statement
Molpro Adapter: Molpro needs a different touch to troubleshooting its memory. Here in setting the input file memory we determine if the MWords was enough per process but the total memory was too high. If that's the case, we reduce the processes req. while maintaining the memory per process

Files	Patch %	Lines
arc/parser.py	28.46%	89 Missing and 4 partials :warning:
arc/job/trsh.py	38.93%	69 Missing and 11 partials :warning:
arc/job/adapters/qchem.py	39.04%	53 Missing and 11 partials :warning:
arc/job/ssh.py	15.68%	39 Missing and 4 partials :warning:
arc/scheduler.py	0.00%	32 Missing :warning:
arc/job/adapter.py	15.62%	27 Missing :warning:
arc/job/adapters/molpro.py	13.63%	17 Missing and 2 partials :warning:
arc/species/converter.py	13.33%	12 Missing and 1 partial :warning:
arc/species/vectors.py	14.28%	5 Missing and 1 partial :warning:
arc/level.py	42.85%	3 Missing and 1 partial :warning:
... and 3 more

ReactionMechanismGenerator / ARC

Azure server #689

Codecov Report