datacratic / StarCluster

StarCluster is a utility for creating and managing computing clusters hosted on Amazon's Elastic Compute Cloud (EC2).
http://star.mit.edu/cluster
GNU Lesser General Public License v3.0
37 stars 13 forks source link

Unable to remove security group @sc-$CLUSTERNAME after using EFS plugin #67

Open alexbw opened 7 years ago

alexbw commented 7 years ago

I've found that starcluster terminate hangs on Removing security group: @sc-$CLUSTERNAME if I use the EFS plugin. I have found that if I go to AWS Console > EFS > $EFS_MOUNT_NAME > Manage File System Access and manually remove the security group association with each availability zone, then the cluster can terminate. Any idea why?

vtadigotla commented 7 years ago

@alexbw Are you forcibly terminating the cluster (-f option to terminate)? This doesn't run the on_shutdown method of the EFS plugin, which disassociates the security group (_deauthorize_efs) from the EFS. You should be seeing a log message similar to below

2017-02-11 19:13:13,315 >>> Running plugin starcluster.plugins.efs.EFSPlugin
2017-02-11 19:13:13,767 >>> Disassociated EFS security group sg-*******
alexbw commented 7 years ago

I am using force shutdown. I won't in the future. Thanks! On Sun, Feb 12, 2017 at 2:41 PM vtadigotla notifications@github.com wrote:

@alexbw https://github.com/alexbw Are you forcibly terminating the cluster (-f option to terminate)? This doesn't run the on_shutdown method of the EFS plugin, which disassociates the security group (_deauthorize_efs) from the EFS. You should be seeing a log message similar to below

2017-02-11 19:13:13,315 >>> Running plugin starcluster.plugins.efs.EFSPlugin 2017-02-11 19:13:13,767 >>> Disassociated EFS security group sg-***

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/datacratic/StarCluster/issues/67#issuecomment-279242663, or mute the thread https://github.com/notifications/unsubscribe-auth/AAJ4jxBgBaHxSNjmRTfL22ZVFCo-UqsXks5rb2BqgaJpZM4L-lly .