Slurm jobs failing and slurm controller setting nodes down automatically

[espirado]

Work around

• Re in stalled slurm on the clusters
• Created deployment scrip
• Resolved node failure issues

  cause of node failure

      - Firewall was blocking node communication 

[espirado]

Issue resolved