Closed RahulDama closed 8 months ago
Hi @RahulDama,
The last support release for v0.11 was nearly 5 years ago, so there's not much we can do to help in this repository. I would suggest using the community forum if you have questions about upgrading. One thing to note however, always use the most recent patched versions of each release, which may have fixes for any bugs you encounter, e.g. v0.12.31, v0.13.7, etc.
Thanks!
I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues. If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.
Terraform Version
Terraform Configuration Files
Debug Output
[2024-02-28T11:24:33.202Z] + terraform0.11.15 init -backend-config=profile=default
[2024-02-28T11:24:33.202Z] Initializing modules...
[2024-02-28T11:24:33.202Z] - module.sadist
[2024-02-28T11:24:33.202Z] Getting source "../../solution"
[2024-02-28T11:24:33.202Z] - module.pii_microservice
[2024-02-28T11:24:33.202Z] Getting source "../../solution/modules/pii_microservice/pii_microservice"
[2024-02-28T11:24:33.202Z] - module.sadist.config_s3_bucket
[2024-02-28T11:24:33.202Z] Getting source "./modules/s3_bucket"
[2024-02-28T11:24:33.202Z] - module.sadist.archive_s3_bucket
[2024-02-28T11:24:33.202Z] Getting source "./modules/s3_bucket"
[2024-02-28T11:24:33.202Z] - module.sadist.masking_s3_bucket
[2024-02-28T11:24:33.202Z] Getting source "./modules/s3_bucket"
[2024-02-28T11:24:33.202Z] - module.sadist.ssm_primary_kms_key_arn
[2024-02-28T11:24:33.202Z] Getting source "./modules/ssm_params/stringlist"
[2024-02-28T11:24:33.202Z] - module.sadist.ssm_primary_kms_key_id
[2024-02-28T11:24:33.202Z] Getting source "./modules/ssm_params/stringlist"
[2024-02-28T11:24:33.202Z] - module.sadist.ssm_sqs_lz_in_arn
[2024-02-28T11:24:33.202Z] Getting source "./modules/ssm_params/stringlist"
[2024-02-28T11:24:33.202Z]
[2024-02-28T11:24:33.202Z] Initializing the backend...
[2024-02-28T11:24:33.202Z]
[2024-02-28T11:24:33.202Z] Successfully configured the backend "s3"! Terraform will automatically
[2024-02-28T11:24:33.202Z] use this backend unless the backend configuration changes.
[2024-02-28T11:24:33.503Z]
[2024-02-28T11:24:33.503Z] Initializing provider plugins...
[2024-02-28T11:24:33.503Z] - Checking for available provider plugins on https://releases.hashicorp.com/...
[2024-02-28T11:24:33.604Z] - Downloading plugin for provider "null" (1.0.0)...
[2024-02-28T11:24:33.804Z] - Downloading plugin for provider "aws" (2.45.0)...
[2024-02-28T11:24:35.607Z] - Downloading plugin for provider "template" (1.0.0)...
[2024-02-28T11:24:36.409Z]
[2024-02-28T11:24:36.409Z] Terraform has been successfully initialized!
[2024-02-28T11:24:36.409Z] + terraform0.11.15 plan -out=tfplan -var batch_job_standard_definition_path=/home/ec2-user/workspace/DataLake/TEST-build-and-deploy_corp.datalake.sadist/code/batch/job-definitions/standard.json -var sfn_standard_definition_path=/home/ec2-user/workspace/DataLake/TEST-build-and-deploy_corp.datalake.sadist/code/sfn/standard/sfn.json -var lambda_exception_handler_package_path=/home/ec2-user/workspace/DataLake/TEST-build-and-deploy_corp.datalake.sadist/code/exception-handler/standard/sadist_lambda_exception_handler.zip -var lambda_router_package_path=/home/ec2-user/workspace/DataLake/TEST-build-and-deploy_corp.datalake.sadist/code/router/sadist_router.zip -var check_glue_job_status_package_path=/home/ec2-user/workspace/DataLake/TEST-build-and-deploy_corp.datalake.sadist/code/lambda/check_glue_job_status/check_glue_job_status.zip -var deleteGlueJob_package_path=/home/ec2-user/workspace/DataLake/TEST-build-and-deploy_corp.datalake.sadist/code/lambda/deleteGlueJob/deleteGlueJob.zip -var SadistServiceNow_package_path=/home/ec2-user/workspace/DataLake/TEST-build-and-deploy_corp.datalake.sadist/code/lambda/SadistServiceNow/SadistServiceNow.zip -var step_function_definition_file=/home/ec2-user/workspace/DataLake/TEST-build-and-deploy_corp.datalake.sadist/code/pii-microservice-stepfunction/template_sadist-masking-service-glue-execution.json
[2024-02-28T11:24:38.312Z] Refreshing Terraform state in-memory prior to plan...
[2024-02-28T11:24:38.312Z] The refreshed state will be used to calculate this plan, but will not be
[2024-02-28T11:24:38.312Z] persisted to local or remote state storage.
[2024-02-28T11:24:38.312Z]
[2024-02-28T11:24:39.013Z] aws_iam_role.batch_job_standard: Refreshing state... (ID: sadist-datalake-primary-ingest-batch-job-standard)
[2024-02-28T11:24:39.013Z] aws_iam_role.batch_service_role: Refreshing state... (ID: sadist-datalake-primary-ingest-batch-service-role)
[2024-02-28T11:24:39.013Z] aws_iam_policy.serviceNow_CloudWatchFullAccess: Refreshing state... (ID: arn:aws:iam::959579952097:policy/serviceNow_CloudWatchFullAccess)
[2024-02-28T11:24:39.013Z] aws_iam_policy.serviceNow_secretmanager_policy: Refreshing state... (ID: arn:aws:iam::959579952097:policy/serviceNow_secretmanager_policy)
[2024-02-28T11:24:39.013Z] aws_iam_role.sadist-datalake-primary-ingest-lambda-exception-handler_role: Refreshing state... (ID: sadist-datalake-primary-ingest-lambda-exception-dev)
[2024-02-28T11:24:39.013Z] aws_sns_topic.exception: Refreshing state... (ID: arn:aws:sns:us-east-1:959579952097:sadist-datalake-primary-ingest-exception)
[2024-02-28T11:24:39.013Z] aws_iam_policy.serviceNow_lambdasnspolicy: Refreshing state... (ID: arn:aws:iam::959579952097:policy/serviceNow_lambdasnspolicy)
[2024-02-28T11:24:39.013Z] data.aws_iam_policy_document.AmazonS3FullAccess_policy_document: Refreshing state...
[2024-02-28T11:24:39.013Z] data.aws_sns_topic.sadist-datalake-primary-ingest-exception: Refreshing state...
[2024-02-28T11:24:39.013Z] data.aws_ssm_parameter.consumption_bucket_arns: Refreshing state...
[2024-02-28T11:24:39.013Z] data.aws_region.current: Refreshing state...
[2024-02-28T11:24:39.013Z] data.aws_caller_identity.current: Refreshing state...
[2024-02-28T11:24:39.013Z] aws_dynamodb_table.metadata: Refreshing state... (ID: datalake-s3-metastore)
[2024-02-28T11:24:39.013Z] aws_iam_role.sadist-datalake-primary-ingest-sfn-standard_role: Refreshing state... (ID: sadist-datalake-primary-ingest-sfn-standard_role_dev)
[2024-02-28T11:24:39.013Z] aws_iam_policy.serviceNow_SnsPublish: Refreshing state... (ID: arn:aws:iam::959579952097:policy/serviceNow_SnsPublish)
[2024-02-28T11:24:39.114Z] data.aws_iam_policy_document.kms_policy_policy_document: Refreshing state...
[2024-02-28T11:24:39.114Z] data.aws_ssm_parameter.lz_bucket_arns: Refreshing state...
[2024-02-28T11:24:39.114Z] aws_iam_role.lambda_router: Refreshing state... (ID: sadist-datalake-primary-ingest-lambda-router)
[2024-02-28T11:24:39.114Z] data.aws_iam_policy_document.AWSGlueConsoleFullAccess_policy_document: Refreshing state...
[2024-02-28T11:24:39.114Z] aws_key_pair.batch_ssh: Refreshing state... (ID: sadist-datalake-primary-ingest-key)
[2024-02-28T11:24:39.214Z] aws_iam_role.batch_ecs_instance_role: Refreshing state... (ID: sadist-datalake-primary-ingest-ecs-instance-role)
[2024-02-28T11:24:41.017Z] aws_iam_policy.serviceNow_s3full_access: Refreshing state... (ID: arn:aws:iam::959579952097:policy/serviceNow_s3full_access)
[2024-02-28T11:24:41.017Z] data.aws_caller_identity.current: Refreshing state...
[2024-02-28T11:24:41.017Z] aws_iam_role.execute_glue_job_lambda_role: Refreshing state... (ID: execute_glue_job_lambda_role_dev)
[2024-02-28T11:24:41.017Z] aws_iam_role.sadist_lambda_role: Refreshing state... (ID: sadist_lambda_role)
[2024-02-28T11:24:41.017Z] data.aws_ssm_parameter.core_kms_key_arns: Refreshing state...
[2024-02-28T11:24:41.118Z] aws_cloudformation_stack.sns_topic_stack: Refreshing state... (ID: arn:aws:cloudformation:us-east-1:959579...e/254add80-8d0f-11e9-a700-123ad236a92a)
[2024-02-28T11:24:41.118Z] data.aws_iam_policy_document.Pii_AWSGlueServiceRole_policy_document: Refreshing state...
[2024-02-28T11:24:41.118Z] data.aws_ssm_parameter.raw_bucket_arns: Refreshing state...
[2024-02-28T11:24:41.118Z] data.aws_iam_policy_document.AWSGlueServiceRole1_policy_document: Refreshing state...
[2024-02-28T11:24:41.118Z] data.aws_ssm_parameter.cleansed_bucket_arns: Refreshing state...
[2024-02-28T11:24:41.118Z] data.aws_iam_policy_document.AWSGlueServiceNotebookRole_policy_document: Refreshing state...
[2024-02-28T11:24:41.118Z] aws_iam_role.sfn_standard: Refreshing state... (ID: sadist-datalake-primary-ingest-sfn-standard)
[2024-02-28T11:24:41.118Z] aws_iam_role.lambda_exception_handler: Refreshing state... (ID: sadist-datalake-primary-ingest-lambda-exception-handler)
[2024-02-28T11:24:41.118Z] aws_security_group.batch_primary: Refreshing state... (ID: sg-0499c7135f4340fda)
[2024-02-28T11:24:41.118Z] data.aws_ssm_parameter.exception_bucket_arns: Refreshing state...
[2024-02-28T11:24:41.118Z] data.aws_iam_policy_document.lambda_custom_policy_document: Refreshing state...
[2024-02-28T11:24:41.118Z] aws_iam_policy.serviceNow_cloudwatchLogs: Refreshing state... (ID: arn:aws:iam::959579952097:policy/serviceNow_cloudwatchLogs)
[2024-02-28T11:24:41.218Z] aws_iam_policy.AmazonS3FullAccess_policy: Refreshing state... (ID: arn:aws:iam::959579952097:policy/AmazonS3FullAccess_policy_dev)
[2024-02-28T11:24:41.218Z] data.aws_vpc_endpoint.primary_vpc_s3: Refreshing state...
[2024-02-28T11:24:41.919Z] data.aws_iam_policy_document.de_glue_pass_role_policy_document: Refreshing state...
[2024-02-28T11:24:41.919Z] data.aws_iam_policy_document.sadist-datalake-primary-ingest-lambda_exception_handler_policy_document: Refreshing state...
[2024-02-28T11:24:41.919Z] data.aws_iam_policy_document.sadist-datalake-primary-ingest-sfn-standard_policy_document: Refreshing state...
[2024-02-28T11:24:41.919Z] data.template_file.batch_job_standard_definition: Refreshing state...
[2024-02-28T11:24:41.919Z] aws_iam_policy.kms_policy_policy: Refreshing state... (ID: arn:aws:iam::959579952097:policy/kms_policy_policy_dev)
[2024-02-28T11:24:43.121Z] aws_iam_role_policy_attachment.batch_service_role: Refreshing state... (ID: sadist-datalake-primary-ingest-batch-service-role-20181210035322671900000004)
[2024-02-28T11:24:43.121Z] aws_iam_policy.AWSGlueConsoleFullAccess_policy: Refreshing state... (ID: arn:aws:iam::959579952097:policy/AWSGlueConsoleFullAccess_policy_dev)
[2024-02-28T11:24:43.121Z] aws_iam_role_policy_attachment.batch_ecs_instance_role: Refreshing state... (ID: sadist-datalake-primary-ingest-ecs-instance-role-20181210035322565600000003)
[2024-02-28T11:24:43.121Z] aws_iam_instance_profile.batch_ecs_instance_role: Refreshing state... (ID: sadist-datalake-primary-ingest-ecs-instance-role)
[2024-02-28T11:24:43.121Z] aws_kms_key.primary: Refreshing state... (ID: 15d5672f-2fb9-427f-bd38-e12cae7da668)
[2024-02-28T11:24:43.121Z] aws_iam_policy.Pii_AWSGlueServiceRole_policy: Refreshing state... (ID: arn:aws:iam::959579952097:policy/Pii_AWSGlueServiceRole_policy_dev)
[2024-02-28T11:24:45.124Z] aws_iam_policy.AWSGlueServiceRole_policy: Refreshing state... (ID: arn:aws:iam::959579952097:policy/AWSGlueServiceRole_policy_dev)
[2024-02-28T11:24:45.124Z] aws_iam_policy.AWSGlueServiceNotebookRole_policy: Refreshing state... (ID: arn:aws:iam::959579952097:policy/AWSGlueServiceNotebookRole_policy_dev)
[2024-02-28T11:24:45.225Z] null_resource.sns_exception_subscription: Refreshing state... (ID: 5957220987111624637)
[2024-02-28T11:24:45.225Z] aws_iam_role_policy_attachment.serviceNow_SnsPublish: Refreshing state... (ID: sadist_lambda_role-20230124130120751000000003)
[2024-02-28T11:24:45.225Z] aws_iam_role_policy_attachment.serviceNow_lambdasns_policy_attach: Refreshing state... (ID: sadist_lambda_role-20221123084715502500000001)
[2024-02-28T11:24:45.225Z] aws_iam_role_policy_attachment.serviceNow_secretmanager_policy_attach: Refreshing state... (ID: sadist_lambda_role-20221123084715602200000002)
[2024-02-28T11:24:45.225Z] aws_lambda_function.SadistServiceNow: Refreshing state... (ID: SadistServiceNow)
[2024-02-28T11:24:45.225Z] aws_iam_role_policy_attachment.serviceNow_CloudWatchFullAccess: Refreshing state... (ID: sadist_lambda_role-20230124130120738100000001)
[2024-02-28T11:24:45.225Z] aws_lambda_function.deleteGlueJob: Refreshing state... (ID: deleteGlueJob-SADIST)
[2024-02-28T11:24:45.225Z] aws_lambda_function.check_glue_job_status: Refreshing state... (ID: check_glue_job_status-SADIST)
[2024-02-28T11:24:45.225Z] aws_iam_policy.lambda_custom_policy: Refreshing state... (ID: arn:aws:iam::959579952097:policy/lambda_custom_policy_dev)
[2024-02-28T11:24:45.225Z] aws_security_group_rule.batch_self_ingress: Refreshing state... (ID: sgrule-577380798)
[2024-02-28T11:24:45.225Z] aws_security_group_rule.batch_self_egress: Refreshing state... (ID: sgrule-2871869471)
[2024-02-28T11:24:45.225Z] aws_security_group_rule.batch_ssh_ingress: Refreshing state... (ID: sgrule-1366209858)
[2024-02-28T11:24:45.225Z] aws_security_group_rule.batch_icmp_ingress: Refreshing state... (ID: sgrule-255866393)
[2024-02-28T11:24:45.326Z] aws_security_group_rule.batch_egress: Refreshing state... (ID: sgrule-4170749696)
[2024-02-28T11:24:45.326Z] aws_iam_policy.degluepassrole_policy: Refreshing state... (ID: arn:aws:iam::959579952097:policy/degluepassrole_policy_dev)
[2024-02-28T11:24:45.326Z] aws_iam_policy.sadist-datalake-primary-ingest-lambda_exception_handler_policy: Refreshing state... (ID: arn:aws:iam::959579952097:policy/sadist...st-lambda_exception_handler_policy_dev)
[2024-02-28T11:24:45.326Z] aws_iam_policy.sadist-datalake-primary-ingest-sfn-standard_policy: Refreshing state... (ID: arn:aws:iam::959579952097:policy/sadist...primary-ingest-sfn-standard_policy_dev)
[2024-02-28T11:24:45.326Z] aws_batch_job_definition.standard: Refreshing state... (ID: arn:aws:batch:us-east-1:959579952097:jo...st-datalake-primary-ingest-standard:71)
[2024-02-28T11:24:45.326Z] aws_iam_role_policy_attachment.serviceNow_s3full_access: Refreshing state... (ID: sadist_lambda_role-20230124130120742500000002)
[2024-02-28T11:24:45.326Z] aws_iam_role_policy.sfn_standard: Refreshing state... (ID: sadist-datalake-primary-ingest-sfn-stan...fn-standard-20190606160534881700000001)
[2024-02-28T11:24:45.326Z] aws_lambda_function.exception_handler: Refreshing state... (ID: sadist-datalake-primary-ingest-exception-handler)
[2024-02-28T11:24:45.326Z] aws_iam_role_policy.lambda_exception_handler: Refreshing state... (ID: sadist-datalake-primary-ingest-lambda-e...rimary-ingest-lambda_exception_handler)
[2024-02-28T11:24:45.326Z] aws_iam_role_policy_attachment.serviceNow_cloudwatchLogs: Refreshing state... (ID: sadist_lambda_role-20230125123323483300000001)
[2024-02-28T11:24:45.326Z] aws_batch_compute_environment.primary: Refreshing state... (ID: sadist-datalake-primary-ingest)
[2024-02-28T11:24:45.326Z] aws_iam_role_policy_attachment.kms_policy_policy_attach: Refreshing state... (ID: sadist-datalake-primary-ingest-lambda-exception-dev-20190910142833546600000002)
[2024-02-28T11:24:45.326Z] aws_iam_role_policy_attachment.pii_AWSGlueServiceRole_policy_attach: Refreshing state... (ID: execute_glue_job_lambda_role_dev-20190612073144630500000001)
[2024-02-28T11:24:45.326Z] aws_iam_role_policy_attachment.AWSGlueConsoleFullAccess_policy_attach: Refreshing state... (ID: execute_glue_job_lambda_role_dev-20190612073144722000000004)
[2024-02-28T11:24:45.326Z] aws_iam_role_policy_attachment.AmazonS3FullAccess_policy_attach: Refreshing state... (ID: sadist-datalake-primary-ingest-lambda-exception-dev-20190910142833521800000001)
[2024-02-28T11:24:45.426Z] aws_iam_role_policy_attachment.AWSGlueServiceRole_policy_attach: Refreshing state... (ID: sadist-datalake-primary-ingest-sfn-standard_role_dev-20190612073144870200000007)
[2024-02-28T11:24:45.426Z] aws_sqs_queue.dlq: Refreshing state... (ID: https://sqs.us-east-1.amazonaws.com/959...097/sadist-datalake-primary-ingest-dlq)
[2024-02-28T11:24:45.426Z] aws_kms_alias.primary: Refreshing state... (ID: alias/sadist-datalake-primary-ingest)
[2024-02-28T11:24:45.426Z] aws_iam_role_policy_attachment.AWSGlueServiceNotebookRole_policy_attach: Refreshing state... (ID: execute_glue_job_lambda_role_dev-20190612073144875400000008)
[2024-02-28T11:24:45.426Z] data.template_file.sfn-definition: Refreshing state...
[2024-02-28T11:24:45.426Z] aws_lambda_permission.allow_sadist_sns: Refreshing state... (ID: AllowExecutionFromSNS)
[2024-02-28T11:24:45.426Z] aws_sns_topic_subscription.user_updates_lampda_target: Refreshing state... (ID: arn:aws:sns:us-east-1:959579952097:sadi...n:ca247e7f-c2a6-4b3c-b322-3209c568231e)
[2024-02-28T11:24:45.426Z] aws_iam_role_policy_attachment.lambda_custom_policy_attach: Refreshing state... (ID: execute_glue_job_lambda_role_dev-20190612073144883200000009)
[2024-02-28T11:24:45.426Z] aws_iam_role_policy_attachment.sadist-datalake-primary-ingest-lambda_exception_handler_policy_attach: Refreshing state... (ID: sadist-datalake-primary-ingest-lambda-exception-dev-20190910142833547600000003)
[2024-02-28T11:24:45.426Z] aws_ssm_parameter.this: Refreshing state... (ID: /sadist/datalake-primary-ingest/kms-key-arn)
[2024-02-28T11:24:45.426Z] aws_s3_bucket.this: Refreshing state... (ID: aap-datalake-sadist-datalake-primary-ingest-config-dev)
[2024-02-28T11:24:45.426Z] aws_s3_bucket.this: Refreshing state... (ID: aap-datalake-sadist-datalake-primary-ingest-archive-dev)
[2024-02-28T11:24:45.426Z] aws_ssm_parameter.this: Refreshing state... (ID: /sadist/datalake-primary-ingest/kms-key-id)
[2024-02-28T11:24:45.426Z] aws_s3_bucket.this: Refreshing state... (ID: aap-dl-masking-stg-dev)
[2024-02-28T11:24:45.426Z] aws_iam_role_policy_attachment.sadist-datalake-primary-ingest-sfn-standard_policy_attach: Refreshing state... (ID: sadist-datalake-primary-ingest-sfn-standard_role_dev-20190612073144713800000002)
[2024-02-28T11:24:45.426Z] aws_iam_role_policy_attachment.degluepassrole_policy_attach: Refreshing state... (ID: execute_glue_job_lambda_role_dev-20190612073144730500000005)
[2024-02-28T11:24:45.426Z] aws_sfn_state_machine.sfn_state_machine: Refreshing state... (ID: arn:aws:states:us-east-1:959579952097:s...:sadist-masking-service-glue-execution)
[2024-02-28T11:24:45.426Z] aws_batch_job_queue.primary: Refreshing state... (ID: arn:aws:batch:us-east-1:959579952097:job-queue/sadist-datalake-primary-ingest)
[2024-02-28T11:24:45.426Z] aws_sqs_queue.lz_in: Refreshing state... (ID: https://sqs.us-east-1.amazonaws.com/959...7/sadist-datalake-primary-ingest-lz-in)
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z] Error: Error refreshing state: 8 errors occurred:
[2024-02-28T11:24:45.527Z] * module.sadist.module.archive_s3_bucket.aws_s3_bucket.this: 1 error occurred:
[2024-02-28T11:24:45.527Z] * module.sadist.module.archive_s3_bucket.aws_s3_bucket.this: aws_s3_bucket.this: unexpected EOF
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z] * module.pii_microservice.aws_sfn_state_machine.sfn_state_machine: 1 error occurred:
[2024-02-28T11:24:45.527Z] * module.pii_microservice.aws_sfn_state_machine.sfn_state_machine: aws_sfn_state_machine.sfn_state_machine: unexpected EOF
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z] * module.sadist.module.ssm_primary_kms_key_id.aws_ssm_parameter.this: 1 error occurred:
[2024-02-28T11:24:45.527Z] * module.sadist.module.ssm_primary_kms_key_id.aws_ssm_parameter.this: aws_ssm_parameter.this: unexpected EOF
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z] * module.sadist.aws_sqs_queue.lz_in: 1 error occurred:
[2024-02-28T11:24:45.527Z] * module.sadist.aws_sqs_queue.lz_in: aws_sqs_queue.lz_in: unexpected EOF
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z] * module.sadist.module.masking_s3_bucket.aws_s3_bucket.this: 1 error occurred:
[2024-02-28T11:24:45.527Z] * module.sadist.module.masking_s3_bucket.aws_s3_bucket.this: aws_s3_bucket.this: unexpected EOF
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z] * module.sadist.aws_batch_job_queue.primary: 1 error occurred:
[2024-02-28T11:24:45.527Z] * module.sadist.aws_batch_job_queue.primary: aws_batch_job_queue.primary: unexpected EOF
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z] * module.sadist.module.config_s3_bucket.aws_s3_bucket.this: 1 error occurred:
[2024-02-28T11:24:45.527Z] * module.sadist.module.config_s3_bucket.aws_s3_bucket.this: aws_s3_bucket.this: unexpected EOF
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z] * module.sadist.module.ssm_primary_kms_key_arn.aws_ssm_parameter.this: 1 error occurred:
[2024-02-28T11:24:45.527Z] * module.sadist.module.ssm_primary_kms_key_arn.aws_ssm_parameter.this: aws_ssm_parameter.this: unexpected EOF
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.527Z]
[2024-02-28T11:24:45.628Z] panic: runtime error: index out of range [1] with length 1
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4:
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: goroutine 1221 [running]:
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: github.com/terraform-providers/terraform-provider-aws/aws.resourceAwsBatchJobQueueRead(0xc000168460, 0x45e8040, 0xc0002e8500, 0xc000168460, 0x0)
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: /opt/teamcity-agent/work/5d79fe75d4460a2f/src/github.com/terraform-providers/terraform-provider-aws/aws/resource_aws_batch_job_queue.go:110 +0x55a
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: github.com/hashicorp/terraform-plugin-sdk/helper/schema.(*Resource).Refresh(0xc000153b80, 0xc000a14500, 0x45e8040, 0xc0002e8500, 0xc000015510, 0x40be01, 0xc0006cd380)
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: /opt/teamcity-agent/work/5d79fe75d4460a2f/pkg/mod/github.com/hashicorp/terraform-plugin-sdk@v1.4.1/helper/schema/resource.go:511 +0x16f
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: github.com/hashicorp/terraform-plugin-sdk/helper/schema.(*Provider).Refresh(0xc000245600, 0xc0012c7540, 0xc000a14500, 0xc0006cd380, 0xc000fbc330, 0x18)
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: /opt/teamcity-agent/work/5d79fe75d4460a2f/pkg/mod/github.com/hashicorp/terraform-plugin-sdk@v1.4.1/helper/schema/provider.go:333 +0x8f
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: github.com/hashicorp/terraform-plugin-sdk/plugin.(*ResourceProviderServer).Refresh(0xc000ce3760, 0xc0009b32e0, 0xc0009b3450, 0x0, 0x0)
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: /opt/teamcity-agent/work/5d79fe75d4460a2f/pkg/mod/github.com/hashicorp/terraform-plugin-sdk@v1.4.1/plugin/resource_provider.go:552 +0x4e
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: reflect.Value.call(0xc000138840, 0xc00012e150, 0x13, 0x58594d9, 0x4, 0xc001001f18, 0x3, 0x3, 0xc00043af38, 0x621d4c, ...)
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: /opt/goenv/versions/1.13.5/src/reflect/value.go:460 +0x5f6
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: reflect.Value.Call(0xc000138840, 0xc00012e150, 0x13, 0xc00043af18, 0x3, 0x3, 0x3, 0x620a880, 0x11)
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.453Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: /opt/goenv/versions/1.13.5/src/reflect/value.go:321 +0xb4
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.454Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: net/rpc.(*service).call(0xc00014a000, 0xc000156190, 0xc00004e0a8, 0xc00004e140, 0xc000274480, 0xc0009304a0, 0x45e6e00, 0xc0009b32e0, 0x16, 0x45e6e40, ...)
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.454Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: /opt/goenv/versions/1.13.5/src/net/rpc/server.go:377 +0x16f
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.454Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: created by net/rpc.(*Server).ServeCodec
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.454Z [DEBUG] plugin.terraform-provider-aws_v2.45.0_x4: /opt/goenv/versions/1.13.5/src/net/rpc/server.go:474 +0x42b
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist: eval: *terraform.EvalRefresh, err: aws_sqs_queue.lz_in: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist: eval: *terraform.EvalSequence, err: aws_sqs_queue.lz_in: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] [walkRefresh] Exiting eval tree: module.sadist.aws_sqs_queue.lz_in
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist.archive_s3_bucket: eval: *terraform.EvalRefresh, err: aws_s3_bucket.this: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist.archive_s3_bucket: eval: *terraform.EvalSequence, err: aws_s3_bucket.this: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] [walkRefresh] Exiting eval tree: module.sadist.module.archive_s3_bucket.aws_s3_bucket.this
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.aws_sqs_queue_policy.lz_in"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.pii_microservice: eval: *terraform.EvalRefresh, err: aws_sfn_state_machine.sfn_state_machine: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.pii_microservice: eval: *terraform.EvalSequence, err: aws_sfn_state_machine.sfn_state_machine: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] [walkRefresh] Exiting eval tree: module.pii_microservice.aws_sfn_state_machine.sfn_state_machine
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.module.archive_s3_bucket.aws_s3_bucket_policy.this"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist.ssm_primary_kms_key_id: eval: *terraform.EvalRefresh, err: aws_ssm_parameter.this: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist.config_s3_bucket: eval: *terraform.EvalRefresh, err: aws_s3_bucket.this: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist.ssm_primary_kms_key_arn: eval: *terraform.EvalRefresh, err: aws_ssm_parameter.this: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist.masking_s3_bucket: eval: *terraform.EvalRefresh, err: aws_s3_bucket.this: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist.masking_s3_bucket: eval: *terraform.EvalSequence, err: aws_s3_bucket.this: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] [walkRefresh] Exiting eval tree: module.sadist.module.masking_s3_bucket.aws_s3_bucket.this
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.module.ssm_sqs_lz_in_arn.var.value"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.module.archive_s3_bucket.output.arn"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.module.ssm_sqs_lz_in_arn.aws_ssm_parameter.this"
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.456Z [DEBUG] plugin: plugin process exited: path=/home/ec2-user/workspace/DataLake/TEST-build-and-deploy_corp.datalake.sadist/code/terraform/environments/dev/.terraform/plugins/linux_amd64/terraform-provider-aws_v2.45.0_x4
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.module.archive_s3_bucket.output.id"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist.config_s3_bucket: eval: *terraform.EvalSequence, err: aws_s3_bucket.this: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.module.masking_s3_bucket.aws_s3_bucket_policy.this"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist.ssm_primary_kms_key_id: eval: *terraform.EvalSequence, err: aws_ssm_parameter.this: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] [walkRefresh] Exiting eval tree: module.sadist.module.ssm_primary_kms_key_id.aws_ssm_parameter.this
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.module.masking_s3_bucket.output.arn"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist: eval: *terraform.EvalRefresh, err: aws_batch_job_queue.primary: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.module.masking_s3_bucket.output.id"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist: eval: *terraform.EvalSequence, err: aws_batch_job_queue.primary: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] [walkRefresh] Exiting eval tree: module.sadist.aws_batch_job_queue.primary
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [ERROR] root.sadist.ssm_primary_kms_key_arn: eval: *terraform.EvalSequence, err: aws_ssm_parameter.this: unexpected EOF
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] [walkRefresh] Exiting eval tree: module.sadist.module.ssm_primary_kms_key_arn.aws_ssm_parameter.this
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.data.template_file.sfn_standard_definition"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] [walkRefresh] Exiting eval tree: module.sadist.module.config_s3_bucket.aws_s3_bucket.this
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.aws_sfn_state_machine.sfn_standard_pgp_archive"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.aws_sfn_state_machine.sfn_standard_sfmc_pgp_archive"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.aws_sfn_state_machine.sfn_standard_archive"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.module.config_s3_bucket.output.id"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "provider.template (close)"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.aws_sfn_state_machine.sfn_standard_pgp_gunzip"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.aws_lambda_function.router"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.aws_sfn_state_machine.sfn_standard_pgp"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.aws_sfn_state_machine.sfn_standard_unencrypted"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.module.config_s3_bucket.aws_s3_bucket_policy.this"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.module.config_s3_bucket.output.arn"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.aws_sfn_state_machine.sfn_standard_archive_secured"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.local.allowed_bucket_arns"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.local.sadist_sfn_arns"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.local.allowed_bucket_objects"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.aws_iam_role_policy.batch_job_standard"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.aws_iam_role_policy.lambda_router"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "module.sadist.aws_lambda_event_source_mapping.router"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "provider.aws.primary (close)"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [TRACE] dag/walk: upstream errored, not walking "root"
[2024-02-28T11:24:45.628Z] 2024/02/28 11:24:45 [DEBUG] plugin: waiting for all plugin processes to complete...
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.523Z [WARN ] plugin: error closing client during Kill: err="connection is shut down"
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.525Z [DEBUG] plugin: plugin process exited: path=/home/ec2-user/workspace/DataLake/TEST-build-and-deploy_corp.datalake.sadist/code/terraform/environments/dev/.terraform/plugins/linux_amd64/terraform-provider-template_v1.0.0_x4
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.525Z [DEBUG] plugin.terraform: local-exec-provisioner (internal) 2024/02/28 11:24:45 [ERR] plugin: plugin server: accept unix /tmp/plugin307148607: use of closed network connection
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.525Z [DEBUG] plugin.terraform: local-exec-provisioner (internal) 2024/02/28 11:24:45 [DEBUG] plugin: waiting for all plugin processes to complete...
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.525Z [DEBUG] plugin: plugin process exited: path=/opt/terraform0.11.15/terraform
[2024-02-28T11:24:45.628Z] 2024-02-28T11:24:45.525Z [DEBUG] plugin: plugin process exited: path=/home/ec2-user/workspace/DataLake/TEST-build-and-deploy_corp.datalake.sadist/code/terraform/environments/dev/.terraform/plugins/linux_amd64/terraform-provider-null_v1.0.0_x4
[2024-02-28T11:24:45.628Z]
[2024-02-28T11:24:45.628Z]
[2024-02-28T11:24:45.628Z]
[2024-02-28T11:24:45.628Z] !!!!!!!!!!!!!!!!!!!!!!!!!!! TERRAFORM CRASH !!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2024-02-28T11:24:45.628Z]
[2024-02-28T11:24:45.628Z] Terraform crashed! This is always indicative of a bug within Terraform.
[2024-02-28T11:24:45.628Z] A crash log has been placed at "crash.log" relative to your current
[2024-02-28T11:24:45.628Z] working directory. It would be immensely helpful if you could please
[2024-02-28T11:24:45.628Z] report the crash with Terraform[1] so that we can fix this.
[2024-02-28T11:24:45.628Z]
[2024-02-28T11:24:45.628Z] When reporting bugs, please include your terraform version. That
[2024-02-28T11:24:45.628Z] information is available on the first line of crash.log. You can also
[2024-02-28T11:24:45.628Z] get it by running 'terraform --version' on the command line.
[2024-02-28T11:24:45.628Z]
[2024-02-28T11:24:45.628Z]
[2024-02-28T11:24:45.628Z] !!!!!!!!!!!!!!!!!!!!!!!!!!! TERRAFORM CRASH !!!!!!!!!!!!!!!!!!!!!!!!!!!!
script returned exit code 1
Expected Behavior
It should Run successfully or give any errors if any.
Actual Behavior
TERRAFORM CRASHED
Steps to Reproduce
[2024-02-28T11:24:33.202Z] + terraform0.11.15 init -backend-config=profile=default
[2024-02-28T11:24:33.202Z] Initializing modules...
[2024-02-28T11:24:33.202Z] - module.sadist
[2024-02-28T11:24:33.202Z] Getting source "../../solution"
[2024-02-28T11:24:33.202Z] - module.pii_microservice
[2024-02-28T11:24:33.202Z] Getting source "../../solution/modules/pii_microservice/pii_microservice"
[2024-02-28T11:24:33.202Z] - module.sadist.config_s3_bucket
[2024-02-28T11:24:33.202Z] Getting source "./modules/s3_bucket"
[2024-02-28T11:24:33.202Z] - module.sadist.archive_s3_bucket
[2024-02-28T11:24:33.202Z] Getting source "./modules/s3_bucket"
[2024-02-28T11:24:33.202Z] - module.sadist.masking_s3_bucket
[2024-02-28T11:24:33.202Z] Getting source "./modules/s3_bucket"
[2024-02-28T11:24:33.202Z] - module.sadist.ssm_primary_kms_key_arn
[2024-02-28T11:24:33.202Z] Getting source "./modules/ssm_params/stringlist"
[2024-02-28T11:24:33.202Z] - module.sadist.ssm_primary_kms_key_id
[2024-02-28T11:24:33.202Z] Getting source "./modules/ssm_params/stringlist"
[2024-02-28T11:24:33.202Z] - module.sadist.ssm_sqs_lz_in_arn
[2024-02-28T11:24:33.202Z] Getting source "./modules/ssm_params/stringlist"
[2024-02-28T11:24:33.202Z]
[2024-02-28T11:24:33.202Z] Initializing the backend...
[2024-02-28T11:24:33.202Z]
[2024-02-28T11:24:33.202Z] Successfully configured the backend "s3"! Terraform will automatically
[2024-02-28T11:24:33.202Z] use this backend unless the backend configuration changes.
[2024-02-28T11:24:33.503Z]
[2024-02-28T11:24:33.503Z] Initializing provider plugins...
[2024-02-28T11:24:33.503Z] - Checking for available provider plugins on https://releases.hashicorp.com/...
[2024-02-28T11:24:33.604Z] - Downloading plugin for provider "null" (1.0.0)...
[2024-02-28T11:24:33.804Z] - Downloading plugin for provider "aws" (2.45.0)...
[2024-02-28T11:24:35.607Z] - Downloading plugin for provider "template" (1.0.0)...
terraform crashing at plan, so no apply output found
Additional Context
We are working on terraform version 0.11.15 and planning to upgrade 0.12.0 the to 0.13.0, all of sudden terraform started creashing.
References
No response