search

MitocGroup / deepify

software development tool-chain that abstracts package management of cloud native web applications
https://www.deep.mg
Mozilla Public License 2.0
3 stars 0 forks source link

Deepify undeploy doesn't remove SQS resources #396

Closed eistrati closed 7 years ago

eistrati commented 7 years ago 
MitocGroup:~ eugene$ deepify undeploy -r 9d71cad5
12:00:32 GMT-0400 (EDT)  Starting undeploy for CloudWatchEvents 
12:00:32 GMT-0400 (EDT)  Starting undeploy for Lambda 
12:00:32 GMT-0400 (EDT)  Starting undeploy for APIGateway 
12:00:32 GMT-0400 (EDT)  Starting undeploy for APIGatewayPlan 
12:00:32 GMT-0400 (EDT)  Starting undeploy for APIGatewayKey 
12:00:32 GMT-0400 (EDT)  No resources to remove for APIGatewayKey 
12:00:32 GMT-0400 (EDT)  Starting undeploy for IAM 
12:00:32 GMT-0400 (EDT)  Starting undeploy for CognitoIdentity 
12:00:32 GMT-0400 (EDT)  Starting undeploy for CloudFront 
12:00:32 GMT-0400 (EDT)  No resources to remove for CloudFront 
12:00:32 GMT-0400 (EDT)  Starting undeploy for DynamoDB 
12:00:32 GMT-0400 (EDT)  Starting undeploy for S3 
12:00:32 GMT-0400 (EDT)  Starting undeploy for SQS 
12:00:32 GMT-0400 (EDT)  Starting undeploy for ElastiCache 
12:00:32 GMT-0400 (EDT)  No resources to remove for ElastiCache 
12:00:32 GMT-0400 (EDT)  Starting undeploy for ES 
12:00:32 GMT-0400 (EDT)  No resources to remove for ES 
12:00:32 GMT-0400 (EDT)  Starting undeploy for CognitoIdentityProvider 
12:00:32 GMT-0400 (EDT)  No resources to remove for CognitoIdentityProvider 
12:00:32 GMT-0400 (EDT)  Starting undeploy for CloudWatchLogs 
12:00:32 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevAsyncConfigDump359d71cad5 from CloudWatchLogs 
12:00:32 GMT-0400 (EDT)  Removing resource #DeepDevTask9d71cad5 from DynamoDB 
12:00:32 GMT-0400 (EDT)  Removing resource #https://sqs.us-east-1.amazonaws.com/722084099005/DeepDevDbol-taskQueue9d71cad5 from SQS 
12:00:32 GMT-0400 (EDT)  Removing resource #DeepDevTaskDeletecompleted12239d71cad5 from Lambda 
12:00:32 GMT-0400 (EDT)  Removing resource #us-east-1:c88fcc46-afd8-4069-9dd2-42977804a736 from CognitoIdentity 
12:00:32 GMT-0400 (EDT)  There are 1 resources removed from CognitoIdentity 
12:00:32 GMT-0400 (EDT)  There are 1 resources removed from DynamoDB 
12:00:32 GMT-0400 (EDT)  There are 1 resources removed from SQS 
12:00:32 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevDdbEventualConsistencyListenQueues359d71cad5 from CloudWatchLogs 
12:00:32 GMT-0400 (EDT)  Removing resource #DeepDevAsyncConfigDump359d71cad5 from Lambda 
12:00:33 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevTaskCreate12239d71cad5 from CloudWatchLogs 
12:00:33 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevTaskDelete12239d71cad5 from CloudWatchLogs 
12:00:33 GMT-0400 (EDT)  Removing resource #DeepDevTaskDelete12239d71cad5 from Lambda 
12:00:33 GMT-0400 (EDT)  Removing resource #7qswxebhv0 from APIGateway 
12:00:33 GMT-0400 (EDT)  There are 1 resources removed from APIGateway 
12:00:33 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevTaskDeletecompleted12239d71cad5 from CloudWatchLogs 
12:00:33 GMT-0400 (EDT)  Removing resource #DeepDevTaskRetrieve12239d71cad5 from Lambda 
12:00:33 GMT-0400 (EDT)  Removing resource #DeepDevApiExecAccess9d71cad5 from IAM 
12:00:33 GMT-0400 (EDT)  Removing resource #DeepDevAuthenticated9d71cad5 from IAM 
12:00:33 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevTaskMarkall12239d71cad5 from CloudWatchLogs 
12:00:33 GMT-0400 (EDT)  Removing resource #DeepDevReplicationStream01459d71cad5 from Lambda 
12:00:33 GMT-0400 (EDT)  Removing resource #DeepDevAsyncConfigDump359d71cad5 from CloudWatchEvents 
12:00:33 GMT-0400 (EDT)  Removing resource #DeepDevCloudfrontTrafficManager01459d71cad5 from Lambda 
12:00:33 GMT-0400 (EDT)  Removing resource #DeepDevDeepBlueGreenLambdaExec01459d71cad5 from IAM 
12:00:33 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevTaskRetrieve12239d71cad5 from CloudWatchLogs 
12:00:33 GMT-0400 (EDT)  Removing resource #DeepDevReplicationS3Backfill01459d71cad5 from Lambda 
12:00:33 GMT-0400 (EDT)  Removing resource #DeepDevDdbEventualConsistencyListenQueues359d71cad5 from CloudWatchEvents 
12:00:34 GMT-0400 (EDT)  Removing resource #DeepDevDeepRootAngular1LambdaExec359d71cad5 from IAM 
12:00:34 GMT-0400 (EDT)  There are 2 resources removed from CloudWatchEvents 
12:00:34 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevTaskUpdate12239d71cad5 from CloudWatchLogs 
12:00:34 GMT-0400 (EDT)  There are 8 resources removed from CloudWatchLogs 
12:00:34 GMT-0400 (EDT)  Removing resource #DeepDevReplicationStart01459d71cad5 from Lambda 
12:00:34 GMT-0400 (EDT)  Removing resource #DeepDevDeepTodomvcLambdaExec12239d71cad5 from IAM 
12:00:34 GMT-0400 (EDT)  Removing resource #DeepDevReplicationS3Notification01459d71cad5 from Lambda 
12:00:34 GMT-0400 (EDT)  Removing resource #DeepDevUnauthenticated9d71cad5 from IAM 
12:00:34 GMT-0400 (EDT)  There are 6 resources removed from IAM 
12:00:34 GMT-0400 (EDT)  Removing resource #DeepDevTaskUpdate12239d71cad5 from Lambda 
12:00:34 GMT-0400 (EDT)  Removing resource #DeepDevSchedulerRule359d71cad5 from Lambda 
12:00:34 GMT-0400 (EDT)  Removing resource #deep.dev.private.9d71cad5 from S3 
12:00:34 GMT-0400 (EDT)  Removing resource #rwgqjm from APIGatewayPlan 
12:00:34 GMT-0400 (EDT)  Removing resource #DeepDevCloudfrontResponseEnhancer01459d71cad5 from Lambda 
12:00:35 GMT-0400 (EDT)  There are 1 resources removed from APIGatewayPlan 
12:00:35 GMT-0400 (EDT)  Removing resource #DeepDevDdbEventualConsistencyListenQueues359d71cad5 from Lambda 
12:00:35 GMT-0400 (EDT)  Removing resource #DeepDevDdbEventualConsistencyPoolQueue359d71cad5 from Lambda 
12:00:35 GMT-0400 (EDT)  Removing resource #DeepDevTaskCreate12239d71cad5 from Lambda 
12:00:35 GMT-0400 (EDT)  Removing resource #DeepDevTaskMarkall12239d71cad5 from Lambda 
12:00:35 GMT-0400 (EDT)  There are 16 resources removed from Lambda 
12:00:36 GMT-0400 (EDT)  Removing resource #deep.dev.public.9d71cad5 from S3 
12:00:36 GMT-0400 (EDT)  There are 2 resources removed from S3 
MitocGroup:~ eugene$ deepify undeploy -r 9d71cad5
12:01:12 GMT-0400 (EDT)  Starting undeploy for CloudWatchEvents 
12:01:12 GMT-0400 (EDT)  No resources to remove for CloudWatchEvents 
12:01:12 GMT-0400 (EDT)  Starting undeploy for Lambda 
12:01:12 GMT-0400 (EDT)  No resources to remove for Lambda 
12:01:12 GMT-0400 (EDT)  Starting undeploy for APIGateway 
12:01:12 GMT-0400 (EDT)  No resources to remove for APIGateway 
12:01:12 GMT-0400 (EDT)  Starting undeploy for APIGatewayPlan 
12:01:12 GMT-0400 (EDT)  No resources to remove for APIGatewayPlan 
12:01:12 GMT-0400 (EDT)  Starting undeploy for APIGatewayKey 
12:01:12 GMT-0400 (EDT)  No resources to remove for APIGatewayKey 
12:01:12 GMT-0400 (EDT)  Starting undeploy for IAM 
12:01:12 GMT-0400 (EDT)  No resources to remove for IAM 
12:01:12 GMT-0400 (EDT)  Starting undeploy for CognitoIdentity 
12:01:12 GMT-0400 (EDT)  No resources to remove for CognitoIdentity 
12:01:12 GMT-0400 (EDT)  Starting undeploy for CloudFront 
12:01:12 GMT-0400 (EDT)  No resources to remove for CloudFront 
12:01:12 GMT-0400 (EDT)  Starting undeploy for DynamoDB 
12:01:12 GMT-0400 (EDT)  No resources to remove for DynamoDB 
12:01:12 GMT-0400 (EDT)  Starting undeploy for S3 
12:01:12 GMT-0400 (EDT)  No resources to remove for S3 
12:01:12 GMT-0400 (EDT)  Starting undeploy for SQS 
12:01:12 GMT-0400 (EDT)  Starting undeploy for ElastiCache 
12:01:12 GMT-0400 (EDT)  No resources to remove for ElastiCache 
12:01:12 GMT-0400 (EDT)  Starting undeploy for ES 
12:01:12 GMT-0400 (EDT)  No resources to remove for ES 
12:01:12 GMT-0400 (EDT)  Starting undeploy for CognitoIdentityProvider 
12:01:12 GMT-0400 (EDT)  No resources to remove for CognitoIdentityProvider 
12:01:12 GMT-0400 (EDT)  Starting undeploy for CloudWatchLogs 
12:01:12 GMT-0400 (EDT)  No resources to remove for CloudWatchLogs 
12:01:13 GMT-0400 (EDT)  Removing resource #https://sqs.us-east-1.amazonaws.com/722084099005/DeepDevDbol-taskQueue9d71cad5 from SQS 
12:01:13 GMT-0400 (EDT)  There are 1 resources removed from SQS
eistrati commented 7 years ago 
MitocGroup:~ eugene$ deepify undeploy -r 1558a2a9
11:57:10 GMT-0400 (EDT)  Starting undeploy for CloudWatchEvents 
11:57:10 GMT-0400 (EDT)  Starting undeploy for Lambda 
11:57:10 GMT-0400 (EDT)  Starting undeploy for APIGateway 
11:57:10 GMT-0400 (EDT)  Starting undeploy for APIGatewayPlan 
11:57:10 GMT-0400 (EDT)  Starting undeploy for APIGatewayKey 
11:57:10 GMT-0400 (EDT)  No resources to remove for APIGatewayKey 
11:57:10 GMT-0400 (EDT)  Starting undeploy for IAM 
11:57:10 GMT-0400 (EDT)  Starting undeploy for CognitoIdentity 
11:57:10 GMT-0400 (EDT)  Starting undeploy for CloudFront 
11:57:10 GMT-0400 (EDT)  No resources to remove for CloudFront 
11:57:10 GMT-0400 (EDT)  Starting undeploy for DynamoDB 
11:57:10 GMT-0400 (EDT)  Starting undeploy for S3 
11:57:10 GMT-0400 (EDT)  Starting undeploy for SQS 
11:57:10 GMT-0400 (EDT)  Starting undeploy for ElastiCache 
11:57:10 GMT-0400 (EDT)  No resources to remove for ElastiCache 
11:57:10 GMT-0400 (EDT)  Starting undeploy for ES 
11:57:10 GMT-0400 (EDT)  No resources to remove for ES 
11:57:10 GMT-0400 (EDT)  Starting undeploy for CognitoIdentityProvider 
11:57:10 GMT-0400 (EDT)  No resources to remove for CognitoIdentityProvider 
11:57:10 GMT-0400 (EDT)  Starting undeploy for CloudWatchLogs 
11:57:10 GMT-0400 (EDT)  Removing resource #DeepDevTask1558a2a9 from DynamoDB 
11:57:10 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevAsyncConfigDump351558a2a9 from CloudWatchLogs 
11:57:10 GMT-0400 (EDT)  Removing resource #https://sqs.us-east-1.amazonaws.com/722084099005/DeepDevDbol-taskQueue1558a2a9 from SQS 
11:57:10 GMT-0400 (EDT)  There are 1 resources removed from DynamoDB 
11:57:10 GMT-0400 (EDT)  There are 1 resources removed from SQS 
11:57:10 GMT-0400 (EDT)  Removing resource #us-east-1:5cb0072c-728f-4df0-b9f4-df7374d76c1d from CognitoIdentity 
11:57:10 GMT-0400 (EDT)  Removing resource #DeepDevTaskCreate12231558a2a9 from Lambda 
11:57:10 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevDdbEventualConsistencyListenQueues351558a2a9 from CloudWatchLogs 
11:57:10 GMT-0400 (EDT)  There are 1 resources removed from CognitoIdentity 
11:57:10 GMT-0400 (EDT)  Removing resource #DeepDevTaskDeletecompleted12231558a2a9 from Lambda 
11:57:10 GMT-0400 (EDT)  Removing resource #DeepDevAsyncConfigDump351558a2a9 from CloudWatchEvents 
11:57:10 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevReplicationS3Backfill01451558a2a9 from CloudWatchLogs 
11:57:11 GMT-0400 (EDT)  Removing resource #DeepDevDdbEventualConsistencyListenQueues351558a2a9 from CloudWatchEvents 
11:57:11 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevReplicationS3Notification01451558a2a9 from CloudWatchLogs 
11:57:11 GMT-0400 (EDT)  Removing resource #DeepDevReplicationStart01451558a2a9 from Lambda 
11:57:11 GMT-0400 (EDT)  There are 2 resources removed from CloudWatchEvents 
11:57:11 GMT-0400 (EDT)  Removing resource #duub7m866g from APIGateway 
11:57:11 GMT-0400 (EDT)  Removing resource #14ugxa from APIGatewayPlan 
11:57:11 GMT-0400 (EDT)  There are 1 resources removed from APIGateway 
11:57:11 GMT-0400 (EDT)  There are 1 resources removed from APIGatewayPlan 
11:57:11 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevReplicationStart01451558a2a9 from CloudWatchLogs 
11:57:11 GMT-0400 (EDT)  Removing resource #DeepDevCloudfrontResponseEnhancer01451558a2a9 from Lambda 
11:57:11 GMT-0400 (EDT)  Removing resource #DeepDevApiExecAccess1558a2a9 from IAM 
11:57:11 GMT-0400 (EDT)  Removing resource #DeepDevAuthenticated1558a2a9 from IAM 
11:57:11 GMT-0400 (EDT)  Removing resource #DeepDevSchedulerRule351558a2a9 from Lambda 
11:57:11 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevReplicationStream01451558a2a9 from CloudWatchLogs 
11:57:11 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevTaskCreate12231558a2a9 from CloudWatchLogs 
11:57:11 GMT-0400 (EDT)  Removing resource #DeepDevReplicationS3Backfill01451558a2a9 from Lambda 
11:57:11 GMT-0400 (EDT)  Removing resource #DeepDevDeepRootAngular1LambdaExec351558a2a9 from IAM 
11:57:11 GMT-0400 (EDT)  Removing resource #DeepDevDeepBlueGreenLambdaExec01451558a2a9 from IAM 
11:57:11 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevTaskDelete12231558a2a9 from CloudWatchLogs 
11:57:11 GMT-0400 (EDT)  Removing resource #DeepDevReplicationStream01451558a2a9 from Lambda 
11:57:11 GMT-0400 (EDT)  Removing resource #DeepDevAsyncConfigDump351558a2a9 from Lambda 
11:57:12 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevTaskDeletecompleted12231558a2a9 from CloudWatchLogs 
11:57:12 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevTaskMarkall12231558a2a9 from CloudWatchLogs 
11:57:12 GMT-0400 (EDT)  Removing resource #DeepDevReplicationS3Notification01451558a2a9 from Lambda 
11:57:12 GMT-0400 (EDT)  Removing resource #DeepDevDeepTodomvcLambdaExec12231558a2a9 from IAM 
11:57:12 GMT-0400 (EDT)  Removing resource #DeepDevTaskRetrieve12231558a2a9 from Lambda 
11:57:12 GMT-0400 (EDT)  Removing resource #deep.dev.private.1558a2a9 from S3 
11:57:12 GMT-0400 (EDT)  Removing resource #DeepDevUnauthenticated1558a2a9 from IAM 
11:57:12 GMT-0400 (EDT)  There are 6 resources removed from IAM 
11:57:12 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevTaskRetrieve12231558a2a9 from CloudWatchLogs 
11:57:12 GMT-0400 (EDT)  Removing resource #DeepDevTaskUpdate12231558a2a9 from Lambda 
11:57:12 GMT-0400 (EDT)  Removing resource #/aws/lambda/DeepDevTaskUpdate12231558a2a9 from CloudWatchLogs 
11:57:12 GMT-0400 (EDT)  There are 12 resources removed from CloudWatchLogs 
11:57:12 GMT-0400 (EDT)  Removing resource #DeepDevDdbEventualConsistencyListenQueues351558a2a9 from Lambda 
11:57:13 GMT-0400 (EDT)  Removing resource #DeepDevTaskMarkall12231558a2a9 from Lambda 
11:57:13 GMT-0400 (EDT)  Removing resource #DeepDevCloudfrontTrafficManager01451558a2a9 from Lambda 
11:57:13 GMT-0400 (EDT)  Removing resource #DeepDevDdbEventualConsistencyPoolQueue351558a2a9 from Lambda 
11:57:13 GMT-0400 (EDT)  Removing resource #deep.dev.public.1558a2a9 from S3 
11:57:13 GMT-0400 (EDT)  There are 2 resources removed from S3 
11:57:13 GMT-0400 (EDT)  Removing resource #DeepDevTaskDelete12231558a2a9 from Lambda 
11:57:13 GMT-0400 (EDT)  There are 16 resources removed from Lambda 
MitocGroup:~ eugene$ deepify undeploy -r 1558a2a9
11:57:26 GMT-0400 (EDT)  Starting undeploy for CloudWatchEvents 
11:57:26 GMT-0400 (EDT)  No resources to remove for CloudWatchEvents 
11:57:26 GMT-0400 (EDT)  Starting undeploy for Lambda 
11:57:26 GMT-0400 (EDT)  No resources to remove for Lambda 
11:57:26 GMT-0400 (EDT)  Starting undeploy for APIGateway 
11:57:26 GMT-0400 (EDT)  No resources to remove for APIGateway 
11:57:26 GMT-0400 (EDT)  Starting undeploy for APIGatewayPlan 
11:57:26 GMT-0400 (EDT)  No resources to remove for APIGatewayPlan 
11:57:26 GMT-0400 (EDT)  Starting undeploy for APIGatewayKey 
11:57:26 GMT-0400 (EDT)  No resources to remove for APIGatewayKey 
11:57:26 GMT-0400 (EDT)  Starting undeploy for IAM 
11:57:26 GMT-0400 (EDT)  No resources to remove for IAM 
11:57:26 GMT-0400 (EDT)  Starting undeploy for CognitoIdentity 
11:57:26 GMT-0400 (EDT)  No resources to remove for CognitoIdentity 
11:57:26 GMT-0400 (EDT)  Starting undeploy for CloudFront 
11:57:26 GMT-0400 (EDT)  No resources to remove for CloudFront 
11:57:26 GMT-0400 (EDT)  Starting undeploy for DynamoDB 
11:57:26 GMT-0400 (EDT)  Starting undeploy for S3 
11:57:26 GMT-0400 (EDT)  No resources to remove for S3 
11:57:26 GMT-0400 (EDT)  Starting undeploy for SQS 
11:57:26 GMT-0400 (EDT)  Starting undeploy for ElastiCache 
11:57:26 GMT-0400 (EDT)  No resources to remove for ElastiCache 
11:57:26 GMT-0400 (EDT)  Starting undeploy for ES 
11:57:26 GMT-0400 (EDT)  No resources to remove for ES 
11:57:26 GMT-0400 (EDT)  Starting undeploy for CognitoIdentityProvider 
11:57:26 GMT-0400 (EDT)  No resources to remove for CognitoIdentityProvider 
11:57:26 GMT-0400 (EDT)  Starting undeploy for CloudWatchLogs 
11:57:26 GMT-0400 (EDT)  No resources to remove for CloudWatchLogs 
11:57:26 GMT-0400 (EDT)  Removing resource #https://sqs.us-east-1.amazonaws.com/722084099005/DeepDevDbol-taskQueue1558a2a9 from SQS 
11:57:26 GMT-0400 (EDT)  There are 1 resources removed from SQS
mgoria commented 7 years ago

SQS queue is actually removed on first undeploy, but it takes some time for SQS service to propagate this change. You can check that by running deepify undeploy wait a while and run deepify list you'll see that SQS queue disappears from listing result without second undeploy. It happened to me as well while fixing some deepify undeploy / listing issues.

eistrati commented 7 years ago

Can we mark the resource somehow that subsequent deepify list or deepify deploy doesn't pick it up? Maybe rename the SQS resource if it's faster?

mgoria commented 7 years ago

I guess we can think of an workaround and implement it, but to be honest I don't think it pays off the effort.

eistrati commented 7 years ago

I'll close this for now and let's keep an eye if we see any SQS hanging resources (I haven't so far).