search

aws / aws-parallelcluster

AWS ParallelCluster is an AWS supported Open Source cluster management tool to deploy and manage HPC clusters in the AWS cloud.
https://github.com/aws/aws-parallelcluster
Apache License 2.0
828 stars 312 forks source link

Support for sending email on job events #3955

Open matteoacrossi opened 2 years ago

matteoacrossi commented 2 years ago

Slurm has variuous options for sending emails when a job changes status 

#SBATCH --mail-user=matteo@example.com
#SBATCH --mail-type=BEGIN,END,FAIL

which by default uses the system /bin/mail program. Does AWS ParallelCluster support this feature, for example using AWS SES or a custom SMTP server?

chenwany commented 2 years ago

Hi! This is currently not supported by ParallelCluster, I will pass this request to our PM. Thank you!

matteoacrossi commented 2 years ago

Thanks! By the way, for future reference, I successfully enabled the email service using Amazon SES and followed this guide for configuring sendmail to send emails through SES's SMTP (using port 587). I automated this in a post-install script, but I think it would be nice to support the email feature directly to avoid unnecessary manual steps.

lukeseawalker commented 2 years ago

Thank you Matteo, I'm marking this with the "enhancement" label and forwarding the request to the manager.

simone-pignotti commented 1 year ago

Hi, I am also very interested in this feature, and was wondering whether there's any update. Thanks!

AbhilashMathews commented 1 year ago

Following up to see the status of this update for using slurm on AWS

neilmunday commented 5 months ago

There is now a AWS HPC Recipe that includes a CloudFormation stack which will set-up and configure Slurm-Mail with AWS Parallel Cluster.

enrico-usai commented 4 months ago

Thanks @neilmunday for sharing the recipe!

neilmunday commented 1 month ago

There is now a AWS HPC blog post about the recipe and how it can be used: Implementing e-mail and SMS notifications in AWS ParallelCluster with Slurm