search

GoogleCloudPlatform / terraformer

CLI tool to generate terraform files from existing infrastructure (reverse Terraform). Infrastructure to Code
Apache License 2.0
12.65k stars 1.65k forks source link

InvalidAction: Unavailable Operation #610

Closed tcurdt closed 3 years ago

tcurdt commented 4 years ago

The import is failing with "InvalidAction" not really giving a clue what the problem could be.

% terraformer version
Terraformer v0.8.8
% terraformer import aws list | grep ses
ses
% terraformer import aws --resources=ses --regions=eu-central-1
2020/09/25 12:29:11 aws importing region eu-central-1
2020/09/25 12:29:11 aws importing... ses
2020/09/25 12:29:12 InvalidAction: Unavailable Operation
    status code: 400, request id: b4466b97-...
tcurdt commented 4 years ago 
terraformer import aws --resources=iam --regions=eu-central-1

worked just fine

tcurdt commented 4 years ago

Here is the result of trying all of aws

% terraformer import aws "--resources=*" --regions=eu-central-1
2020/09/27 16:01:58 aws importing region eu-central-1
2020/09/27 16:01:58 Attempting an import of ALL resources in aws
2020/09/27 16:01:58 aws importing... accessanalyzer
2020/09/27 16:02:06 aws importing... acm
2020/09/27 16:02:10 Refreshing state... aws_acm_certificate.tfer--x
2020/09/27 16:02:11 aws importing... alb
2020/09/27 16:02:15 Refreshing state... aws_lb_target_group.tfer--x
2020/09/27 16:02:15 Refreshing state... aws_lb_target_group_attachment.tfer--arn-x
2020/09/27 16:02:15 aws importing... api_gateway
2020/09/27 16:02:20 aws importing... appsync
2020/09/27 16:02:24 aws importing... auto_scaling
2020/09/27 16:02:28 aws importing... budgets
2020/09/27 16:02:32 Refreshing state... aws_budgets_budget.tfer--Monthly
2020/09/27 16:02:34 aws importing... cloud9
2020/09/27 16:02:38 aws importing... cloudformation
2020/09/27 16:02:42 aws importing... cloudfront
2020/09/27 16:02:47 aws importing... cloudtrail
2020/09/27 16:02:51 aws importing... cloudwatch
2020/09/27 16:02:55 aws importing... codebuild
2020/09/27 16:02:59 aws importing... codecommit
2020/09/27 16:03:04 aws importing... codedeploy
2020/09/27 16:03:08 aws importing... codepipeline
2020/09/27 16:03:12 aws importing... cognito
2020/09/27 16:03:17 aws importing... config
2020/09/27 16:03:21 aws importing... customer_gateway
2020/09/27 16:03:25 aws importing... datapipeline
2020/09/27 16:03:33 aws importing... devicefarm
2020/09/27 16:03:41 aws importing... dynamodb
2020/09/27 16:03:45 aws importing... ebs
2020/09/27 16:03:50 aws importing... ec2_instance
2020/09/27 16:03:54 aws importing... ecr
2020/09/27 16:03:58 aws importing... ecs
2020/09/27 16:04:03 aws importing... eip
2020/09/27 16:04:07 aws importing... eks
2020/09/27 16:04:11 aws importing... elastic_beanstalk
2020/09/27 16:04:16 aws importing... elasticache
2020/09/27 16:04:21 aws importing... elb
2020/09/27 16:04:25 aws importing... emr
2020/09/27 16:04:29 aws importing... eni
2020/09/27 16:04:33 aws importing... es
2020/09/27 16:04:37 aws importing... firehose
2020/09/27 16:04:42 aws importing... glue
2020/09/27 16:04:46 aws importing... iam
2020/09/27 16:04:59 Refreshing state... aws_iam_user.tfer--x
2020/09/27 16:04:59 Refreshing state... aws_iam_group_policy_attachment.tfer--cli_AmazonS3FullAccess
2020/09/27 16:04:59 Refreshing state... aws_iam_group.tfer--mail
2020/09/27 16:04:59 Refreshing state... aws_iam_group_policy_attachment.tfer--cli_AmazonPollyFullAccess
2020/09/27 16:04:59 Refreshing state... aws_iam_user_group_membership.tfer--tcurdt-002F-cli
2020/09/27 16:04:59 Refreshing state... aws_iam_user_group_membership.tfer--mailmanager-002F-mail
2020/09/27 16:04:59 Refreshing state... aws_iam_group.tfer--cli
2020/09/27 16:04:59 Refreshing state... aws_iam_group_policy_attachment.tfer--mail_AmazonSESFullAccess
2020/09/27 16:04:59 Refreshing state... aws_iam_user.tfer--x
2020/09/27 16:04:59 Refreshing state... aws_iam_group_policy_attachment.tfer--mail_AmazonSNSFullAccess
2020/09/27 16:04:59 Refreshing state... aws_iam_role.tfer--AWSServiceRoleForElasticLoadBalancing
2020/09/27 16:04:59 Refreshing state... aws_iam_policy.tfer--AWSLambdaBasicExecutionRole-x
2020/09/27 16:04:59 Refreshing state... aws_iam_user_policy_attachment.tfer--tcurdt_AdministratorAccess
2020/09/27 16:04:59 Refreshing state... aws_iam_group_policy_attachment.tfer--cli_AmazonEC2FullAccess
2020/09/27 16:04:59 Refreshing state... aws_iam_role_policy_attachment.tfer--AWSServiceRoleForElasticLoadBalancing_AWSElasticLoadBalancingServiceRolePolicy
2020/09/27 16:04:59 Refreshing state... aws_iam_role.tfer--AWSServiceRoleForGlobalAccelerator
2020/09/27 16:04:59 Refreshing state... aws_iam_role_policy_attachment.tfer--AWSServiceRoleForGlobalAccelerator_AWSGlobalAcceleratorSLRPolicy
2020/09/27 16:04:59 Refreshing state... aws_iam_role.tfer--AWSServiceRoleForSupport
2020/09/27 16:04:59 Refreshing state... aws_iam_role_policy_attachment.tfer--AWSServiceRoleForSupport_AWSSupportServiceRolePolicy
2020/09/27 16:04:59 Refreshing state... aws_iam_role.tfer--AWSServiceRoleForTrustedAdvisor
2020/09/27 16:04:59 Refreshing state... aws_iam_role_policy_attachment.tfer--AWSServiceRoleForTrustedAdvisor_AWSTrustedAdvisorServiceRolePolicy
2020/09/27 16:05:00 aws importing... igw
2020/09/27 16:05:05 Refreshing state... aws_internet_gateway.tfer--igw-002D-234cb548
2020/09/27 16:05:05 aws importing... iot
2020/09/27 16:05:09 aws importing... kinesis
2020/09/27 16:05:13 aws importing... kms
2020/09/27 16:05:17 Refreshing state... aws_kms_key.tfer--x
2020/09/27 16:05:18 Refreshing state... aws_kms_key.tfer--x
2020/09/27 16:05:18 Refreshing state... aws_kms_key.tfer--x
2020/09/27 16:05:19 Refreshing state... aws_kms_key.tfer--
2020/09/27 16:05:19 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:20 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:20 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:21 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:22 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:22 Fail read resource from provider, trying import command
2020/09/27 16:05:22 Refreshing state... aws_kms_key.tfer--x
2020/09/27 16:05:22 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-acm
2020/09/27 16:05:23 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-dynamodb
2020/09/27 16:05:23 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-ebs
2020/09/27 16:05:23 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:24 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:24 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:24 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:25 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:25 Fail read resource from provider, trying import command
2020/09/27 16:05:25 rpc error: code = Canceled desc = context canceled
2020/09/27 16:05:25 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-elasticfilesystem
2020/09/27 16:05:25 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:25 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:26 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:26 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:26 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:27 Fail read resource from provider, trying import command
2020/09/27 16:05:27 rpc error: code = Canceled desc = context canceled
2020/09/27 16:05:27 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-es
2020/09/27 16:05:27 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:27 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:27 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:28 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:28 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:28 Fail read resource from provider, trying import command
2020/09/27 16:05:28 rpc error: code = Canceled desc = context canceled
2020/09/27 16:05:28 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-glue
2020/09/27 16:05:28 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:29 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:29 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:29 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:30 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:30 Fail read resource from provider, trying import command
2020/09/27 16:05:30 rpc error: code = Canceled desc = context canceled
2020/09/27 16:05:30 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-kinesisvideo
2020/09/27 16:05:30 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:30 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:31 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:31 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:31 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:32 Fail read resource from provider, trying import command
2020/09/27 16:05:32 rpc error: code = Canceled desc = context canceled
2020/09/27 16:05:32 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-lambda
2020/09/27 16:05:32 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:32 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:32 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:33 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:33 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:33 Fail read resource from provider, trying import command
2020/09/27 16:05:33 rpc error: code = Canceled desc = context canceled
2020/09/27 16:05:33 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-rds
2020/09/27 16:05:34 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:34 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:34 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:34 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:35 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:35 Fail read resource from provider, trying import command
2020/09/27 16:05:35 rpc error: code = Canceled desc = context canceled
2020/09/27 16:05:35 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-redshift
2020/09/27 16:05:35 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:36 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:36 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:36 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:36 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:37 Fail read resource from provider, trying import command
2020/09/27 16:05:37 rpc error: code = Canceled desc = context canceled
2020/09/27 16:05:37 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-s3
2020/09/27 16:05:37 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:37 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:38 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:38 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:38 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:38 Fail read resource from provider, trying import command
2020/09/27 16:05:38 rpc error: code = Canceled desc = context canceled
2020/09/27 16:05:38 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-sns
2020/09/27 16:05:39 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:39 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:39 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:40 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:40 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:40 Fail read resource from provider, trying import command
2020/09/27 16:05:40 rpc error: code = Canceled desc = context canceled
2020/09/27 16:05:40 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-sqs
2020/09/27 16:05:40 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:41 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:41 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:41 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:42 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:42 Fail read resource from provider, trying import command
2020/09/27 16:05:42 rpc error: code = Canceled desc = context canceled
2020/09/27 16:05:42 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-ssm
2020/09/27 16:05:42 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:42 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:43 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:43 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:43 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:44 Fail read resource from provider, trying import command
2020/09/27 16:05:44 rpc error: code = Canceled desc = context canceled
2020/09/27 16:05:44 Refreshing state... aws_kms_alias.tfer--alias-002F-aws-002F-xray
2020/09/27 16:05:44 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:44 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:44 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:45 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:45 WARN: Fail read resource from provider, wait 300ms before retry
2020/09/27 16:05:45 Fail read resource from provider, trying import command
2020/09/27 16:05:45 rpc error: code = Canceled desc = context canceled
2020/09/27 16:05:45 ERROR: Unable to refresh resource tfer--alias-002F-aws-002F-ebs
2020/09/27 16:05:45 ERROR: Unable to refresh resource tfer--alias-002F-aws-002F-elasticfilesystem
2020/09/27 16:05:45 ERROR: Unable to refresh resource tfer--alias-002F-aws-002F-es
2020/09/27 16:05:45 ERROR: Unable to refresh resource tfer--alias-002F-aws-002F-glue
2020/09/27 16:05:45 ERROR: Unable to refresh resource tfer--alias-002F-aws-002F-kinesisvideo
2020/09/27 16:05:45 ERROR: Unable to refresh resource tfer--alias-002F-aws-002F-lambda
2020/09/27 16:05:45 ERROR: Unable to refresh resource tfer--alias-002F-aws-002F-rds
2020/09/27 16:05:45 ERROR: Unable to refresh resource tfer--alias-002F-aws-002F-redshift
2020/09/27 16:05:45 ERROR: Unable to refresh resource tfer--alias-002F-aws-002F-s3
2020/09/27 16:05:45 ERROR: Unable to refresh resource tfer--alias-002F-aws-002F-sns
2020/09/27 16:05:45 ERROR: Unable to refresh resource tfer--alias-002F-aws-002F-sqs
2020/09/27 16:05:45 ERROR: Unable to refresh resource tfer--alias-002F-aws-002F-ssm
2020/09/27 16:05:45 ERROR: Unable to refresh resource tfer--alias-002F-aws-002F-xray
2020/09/27 16:05:45 aws importing... lambda
2020/09/27 16:05:49 aws importing... media_package
2020/09/27 16:05:53 aws importing... media_store
2020/09/27 16:05:57 aws importing... msk
2020/09/27 16:06:01 aws importing... nacl
2020/09/27 16:06:05 Refreshing state... aws_network_acl.tfer--acl-002D-ac1f88c6
2020/09/27 16:06:05 aws importing... nat
2020/09/27 16:06:09 aws importing... organization
2020/09/27 16:06:10 AWSOrganizationsNotInUseException: Your account is not a member of an organization.
  status code: 400, request id: x

just blanked out some UUIDs.

While a lot is broken, it also seems to be missing out on SES.

tcurdt commented 3 years ago

Seems to work in the latest release.

meshuga commented 3 years ago

Thanks for raising the issue and follow-up! With tools like that it's easy to see AWS is not uniform across services in terms of quality...