search

data-dot-all / dataall

A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.
https://data-dot-all.github.io/dataall/
Apache License 2.0
232 stars 82 forks source link

Cant create a pipeline with error deployment failed #666

Closed MATTT-P closed 9 months ago

MATTT-P commented 1 year ago

Describe the bug

When creating a new pipeline, no matter which CICD strategy is selected, we are not able to create a pipeline.

The recommended action from the error is to bootstrap but it still persists after bootstrapping.

Error:

[Container] 2023/08/17 10:54:51 Waiting for agent ping
[Container] 2023/08/17 10:54:52 Waiting for DOWNLOAD_SOURCE
[Container] 2023/08/17 10:54:53 Phase is DOWNLOAD_SOURCE
[Container] 2023/08/17 10:54:53 CODEBUILD_SRC_DIR=/codebuild/output/src2773701546/src
[Container] 2023/08/17 10:54:53 YAML location is /codebuild/output/src2773701546/src/deploy_buildspec.yaml
[Container] 2023/08/17 10:54:53 Setting HTTP client timeout to higher timeout for S3 source
[Container] 2023/08/17 10:54:53 Processing environment variables
[Container] 2023/08/17 10:54:54 No runtime version selected in buildspec.
[Container] 2023/08/17 10:54:54 Git credential helper enabled
GITHUB Git credential unavailable.
BITBUCKET Git credential unavailable.
GITHUB_ENTERPRISE Git credential unavailable.
[Container] 2023/08/17 10:54:54 Moving to directory /codebuild/output/src2773701546/src
[Container] 2023/08/17 10:54:54 Configuring ssm agent with target id: codebuild:c90ad1f3-55c5-4950-8412-824486005564
[Container] 2023/08/17 10:54:54 Successfully updated ssm agent configuration
[Container] 2023/08/17 10:54:54 Registering with agent
[Container] 2023/08/17 10:54:54 Phases found in YAML: 2
[Container] 2023/08/17 10:54:54  PRE_BUILD: 4 commands
[Container] 2023/08/17 10:54:54  BUILD: 2 commands
[Container] 2023/08/17 10:54:54 Phase complete: DOWNLOAD_SOURCE State: SUCCEEDED
[Container] 2023/08/17 10:54:54 Phase context status code:  Message: 
[Container] 2023/08/17 10:54:54 Entering phase INSTALL
[Container] 2023/08/17 10:54:54 Phase complete: INSTALL State: SUCCEEDED
[Container] 2023/08/17 10:54:54 Phase context status code:  Message: 
[Container] 2023/08/17 10:54:54 Entering phase PRE_BUILD
[Container] 2023/08/17 10:54:54 Running command n 16.15.1
  installing : node-v16.15.1
       mkdir : /usr/local/n/versions/node/16.15.1
       fetch : https://nodejs.org/dist/v16.15.1/node-v16.15.1-linux-x64.tar.xz
     copying : node/16.15.1
   installed : v16.15.1 (with npm 8.11.0)

[Container] 2023/08/17 10:55:10 Running command npm install -g aws-cdk
npm WARN config global `--global`, `--local` are deprecated. Use `--location=global` instead.

added 1 package, and audited 2 packages in 1s

found 0 vulnerabilities

[Container] 2023/08/17 10:55:12 Running command pip install aws-ddk
Collecting aws-ddk
  Downloading aws_ddk-0.6.2-py3-none-any.whl (32 kB)
Requirement already satisfied: botocore<2.0.0,>=1.23.37 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from aws-ddk) (1.31.8)
Requirement already satisfied: boto3<2.0.0,>=1.24.11 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from aws-ddk) (1.28.8)
Requirement already satisfied: click<9.0.0,>=8.0.3 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from aws-ddk) (8.1.3)
Requirement already satisfied: cookiecutter<3.0.0,>=1.7.3 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from aws-ddk) (2.1.1)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from boto3<2.0.0,>=1.24.11->aws-ddk) (1.0.1)
Requirement already satisfied: s3transfer<0.7.0,>=0.6.0 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from boto3<2.0.0,>=1.24.11->aws-ddk) (0.6.1)
Requirement already satisfied: urllib3<1.27,>=1.25.4 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from botocore<2.0.0,>=1.23.37->aws-ddk) (1.26.16)
Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from botocore<2.0.0,>=1.23.37->aws-ddk) (2.8.2)
Requirement already satisfied: requests>=2.23.0 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from cookiecutter<3.0.0,>=1.7.3->aws-ddk) (2.31.0)
Requirement already satisfied: jinja2-time>=0.2.0 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from cookiecutter<3.0.0,>=1.7.3->aws-ddk) (0.2.0)
Requirement already satisfied: binaryornot>=0.4.4 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from cookiecutter<3.0.0,>=1.7.3->aws-ddk) (0.4.4)
Requirement already satisfied: Jinja2<4.0.0,>=2.7 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from cookiecutter<3.0.0,>=1.7.3->aws-ddk) (3.1.2)
Requirement already satisfied: python-slugify>=4.0.0 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from cookiecutter<3.0.0,>=1.7.3->aws-ddk) (8.0.1)
Requirement already satisfied: pyyaml>=5.3.1 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from cookiecutter<3.0.0,>=1.7.3->aws-ddk) (6.0.1)
Requirement already satisfied: chardet>=3.0.2 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from binaryornot>=0.4.4->cookiecutter<3.0.0,>=1.7.3->aws-ddk) (5.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from Jinja2<4.0.0,>=2.7->cookiecutter<3.0.0,>=1.7.3->aws-ddk) (2.1.3)
Requirement already satisfied: arrow in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from jinja2-time>=0.2.0->cookiecutter<3.0.0,>=1.7.3->aws-ddk) (1.2.3)
Requirement already satisfied: six>=1.5 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<2.0.0,>=1.23.37->aws-ddk) (1.16.0)
Requirement already satisfied: text-unidecode>=1.3 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from python-slugify>=4.0.0->cookiecutter<3.0.0,>=1.7.3->aws-ddk) (1.3)
Requirement already satisfied: charset-normalizer<4,>=2 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from requests>=2.23.0->cookiecutter<3.0.0,>=1.7.3->aws-ddk) (3.2.0)
Requirement already satisfied: idna<4,>=2.5 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from requests>=2.23.0->cookiecutter<3.0.0,>=1.7.3->aws-ddk) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from requests>=2.23.0->cookiecutter<3.0.0,>=1.7.3->aws-ddk) (2023.5.7)
Installing collected packages: aws-ddk
Successfully installed aws-ddk-0.6.2
WARNING: Running pip as root will break packages and permissions. You should install packages reliably by using venv: https://pip.pypa.io/warnings/venv
WARNING: You are using pip version 21.1.2; however, version 23.2.1 is available.
You should consider upgrading via the '/root/.pyenv/versions/3.9.16/bin/python3.9 -m pip install --upgrade pip' command.

[Container] 2023/08/17 10:55:19 Running command pip install -r requirements.txt
Collecting aws-cdk-lib==2.29.0
  Downloading aws_cdk_lib-2.29.0-py3-none-any.whl (61.1 MB)
Collecting aws-cdk.aws-glue-alpha==2.29.0a0
  Downloading aws_cdk.aws_glue_alpha-2.29.0a0-py3-none-any.whl (192 kB)
Collecting aws-cdk.aws-kinesisfirehose-alpha==2.29.0a0
  Downloading aws_cdk.aws_kinesisfirehose_alpha-2.29.0a0-py3-none-any.whl (110 kB)
Collecting aws-cdk.aws-kinesisfirehose-destinations-alpha==2.29.0a0
  Downloading aws_cdk.aws_kinesisfirehose_destinations_alpha-2.29.0a0-py3-none-any.whl (52 kB)
Collecting constructs<11.0.0,>=10.0.0
  Downloading constructs-10.2.69-py3-none-any.whl (59 kB)
Collecting aws_ddk_core==0.5.1
  Downloading aws_ddk_core-0.5.1-py3-none-any.whl (71 kB)
Collecting publication>=0.0.3
  Downloading publication-0.0.3-py2.py3-none-any.whl (7.7 kB)
Collecting jsii<2.0.0,>=1.60.1
  Downloading jsii-1.87.0-py3-none-any.whl (582 kB)
Collecting marshmallow<4.0.0,>=3.14.1
  Downloading marshmallow-3.20.1-py3-none-any.whl (49 kB)
Collecting typeguard~=2.13.3
  Downloading typeguard-2.13.3-py3-none-any.whl (17 kB)
Requirement already satisfied: python-dateutil in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from jsii<2.0.0,>=1.60.1->aws-cdk-lib==2.29.0->-r requirements.txt (line 1)) (2.8.2)
Collecting cattrs<23.2,>=1.8
  Downloading cattrs-23.1.2-py3-none-any.whl (50 kB)
Requirement already satisfied: attrs<24.0,>=21.2 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from jsii<2.0.0,>=1.60.1->aws-cdk-lib==2.29.0->-r requirements.txt (line 1)) (23.1.0)
Requirement already satisfied: typing-extensions<5.0,>=3.7 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from jsii<2.0.0,>=1.60.1->aws-cdk-lib==2.29.0->-r requirements.txt (line 1)) (4.7.1)
Collecting importlib-resources>=5.2.0
  Downloading importlib_resources-6.0.1-py3-none-any.whl (34 kB)
Collecting exceptiongroup
  Downloading exceptiongroup-1.1.3-py3-none-any.whl (14 kB)
Requirement already satisfied: zipp>=3.1.0 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from importlib-resources>=5.2.0->jsii<2.0.0,>=1.60.1->aws-cdk-lib==2.29.0->-r requirements.txt (line 1)) (3.16.2)
Requirement already satisfied: packaging>=17.0 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from marshmallow<4.0.0,>=3.14.1->aws_ddk_core==0.5.1->-r requirements.txt (line 6)) (23.1)
Requirement already satisfied: six>=1.5 in /root/.pyenv/versions/3.9.16/lib/python3.9/site-packages (from python-dateutil->jsii<2.0.0,>=1.60.1->aws-cdk-lib==2.29.0->-r requirements.txt (line 1)) (1.16.0)
Installing collected packages: exceptiongroup, typeguard, publication, importlib-resources, cattrs, jsii, constructs, aws-cdk-lib, aws-cdk.aws-kinesisfirehose-alpha, marshmallow, aws-cdk.aws-kinesisfirehose-destinations-alpha, aws-cdk.aws-glue-alpha, aws-ddk-core
Successfully installed aws-cdk-lib-2.29.0 aws-cdk.aws-glue-alpha-2.29.0a0 aws-cdk.aws-kinesisfirehose-alpha-2.29.0a0 aws-cdk.aws-kinesisfirehose-destinations-alpha-2.29.0a0 aws-ddk-core-0.5.1 cattrs-23.1.2 constructs-10.2.69 exceptiongroup-1.1.3 importlib-resources-6.0.1 jsii-1.87.0 marshmallow-3.20.1 publication-0.0.3 typeguard-2.13.3
WARNING: Running pip as root will break packages and permissions. You should install packages reliably by using venv: https://pip.pypa.io/warnings/venv
WARNING: You are using pip version 21.1.2; however, version 23.2.1 is available.
You should consider upgrading via the '/root/.pyenv/versions/3.9.16/bin/python3.9 -m pip install --upgrade pip' command.

[Container] 2023/08/17 10:55:29 Phase complete: PRE_BUILD State: SUCCEEDED
[Container] 2023/08/17 10:55:29 Phase context status code:  Message: 
[Container] 2023/08/17 10:55:29 Entering phase BUILD
[Container] 2023/08/17 10:55:29 Running command aws sts get-caller-identity
{
    "UserId": "AROA4FU5JMFX2D4CLX6M6:AWSCodeBuild-c90ad1f3-55c5-4950-8412-824486005564",
    "Account": "xxx",
    "Arn": "arn:aws:sts::xxx:assumed-role/dataall-sbx-daupgradetest7-8kmt053f/AWSCodeBuild-c90ad1f3-55c5-4950-8412-824486005564"
}

[Container] 2023/08/17 10:55:33 Running command ddk deploy
AWS DDK CLI 0.6.2 (Python 3.9.16 (main, Jul 20 2023, 23:17:39) 
[GCC 7.3.1 20180712 (Red Hat 7.3.1-15)])
Deploying DDK stacks: None to AWS account xxx and region eu-west-1...
!!                                                                                                                  !!
!!  Please upgrade to a supported node version as soon as possible.                                                 !!
!!  This software is currently running on node v16.15.1.                                                            !!
!!  - ^20.0.0 (Planned end-of-life: 2026-04-30)                                                                     !!
!!  - ^16.3.0 (Planned end-of-life: 2023-09-11) [DEPRECATED]                                                        !!
!!  This warning can be silenced by setting the JSII_SILENCE_WARNING_DEPRECATED_NODE_VERSION environment variable.  !!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
b'!!                                                                                                                  !!\n'
b'!!  Please upgrade to a supported node version as soon as possible.                                                 !!\n'
b'!!  This software is currently running on node v16.15.1.                                                            !!\n'
b'!!  - ^20.0.0 (Planned end-of-life: 2026-04-30)                                                                     !!\n'
b'!!  - ^16.3.0 (Planned end-of-life: 2023-09-11) [DEPRECATED]                                                        !!\n'
b'!!  This warning can be silenced by setting the JSII_SILENCE_WARNING_DEPRECATED_NODE_VERSION environment variable.  !!\n'
b'!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!\n'
✨  Synthesis time: 5.96s
current credentials could not be used to assume 'arn:aws:iam::xxx:role/ddk-dev-hnb659fds-deploy-xxx-eu-west-1', but are for the right account. Proceeding anyway.
 ❌ Deployment failed: Error: dataall-sbx-daupgradetest7-8kmt053f-DdkApplicationStack: SSM parameter /ddk/dev/hnb659fds/bootstrap-version not found. Has the environment been bootstrapped? Please run 'cdk bootstrap' (see https://docs.aws.amazon.com/cdk/latest/guide/bootstrapping.html)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at async Object.buildAsset (/usr/local/lib/node_modules/aws-cdk/lib/index.js:429:151013)

ERROR - Failed to run `cdk deploy --all --require-approval never --output .ddk.out`. Exception: Exit code: 1.

[Container] 2023/08/17 10:55:41 Command did not exit successfully ddk deploy exit status 1
[Container] 2023/08/17 10:55:41 Phase complete: BUILD State: FAILED
[Container] 2023/08/17 10:55:41 Phase context status code: COMMAND_EXECUTION_ERROR Message: Error while executing command: ddk deploy. Reason: exit status 1
[Container] 2023/08/17 10:55:41 Entering phase POST_BUILD
[Container] 2023/08/17 10:55:41 Phase complete: POST_BUILD State: SUCCEEDED
[Container] 2023/08/17 10:55:41 Phase context status code:  Message:

How to Reproduce

Create a pipeline. All 3 of the options produce the same error.

Expected behavior

Pipeline created successfully.

Your project

No response

Screenshots

No response

OS

n/a

Python version

3.7

AWS data.all version

1.5.5

Additional context

No response

dlpzx commented 1 year ago

Hello @MATTT-P, thanks for raising an issue. The error log might be a bit misleading as it suggests you to run cdk bootstrap while it should be suggesting ddk bootstrap. We can confirm this hypothesis given that the logs fail when trying to find the SSM parameter /ddk/dev/hnb659fds/bootstrap-version.

We are using AWS DDK CLI 0.6.2 as you can see in the logs. In versions <1.0.0 DDK uses the DDK CLI (here are the docs for the CLI documentation) and this is the multi-account implementation that data.all leverages.

I hope that helps, please feel free to reach out if you still face issues

MATTT-P commented 1 year ago

@dlpzx After ddk bootstrapping, using "gitflow" and "CodePipeline - trunk" CICD strategy now CodePipeline runs successfully.

But using "CDK - trunk" strategy CodePipeline is not getting created and in dataAll UI pipeline status shows in PENDING state forever. we tried to debug this issue but found that stackID is getting assigned NULL value in case of "CDK - trunk" strategy. In case of other two strategy there was a proper value allocated to stackID.

Below is the stack log for CDK - trunk pipeline:

CDK - trunk stack log

-- Using schema: dev --
Starting deployment task for stack : pdk2vp8y
Starting new stack from  stackid pdk2vp8y
..............................................
        Running configure                     
..............................................
AWS_CONTAINER_CREDENTIALS_RELATIVE_URI: /v2/credentials/aba96ea8-f485-4975-972e-4be27db55892
stackuri = pdk2vp8y, stackId = None
-- Using schema: dev --
Remote boto3 session using pivot role for account= xxx
Checking Repository Exists: dataall-sbx-daupgradetest3-qtejf5se
Running Commands: ddk init dataall-sbx-daupgradetest3-qtejf5se --generate-only; cd dataall-sbx-daupgradetest3-qtejf5se; git init --initial-branch main; ddk create-repository dataall-sbx-daupgradetest3-qtejf5se -t application dataall -t team Sandbox1Admin
AWS DDK CLI 0.5.1 (Python 3.8.16 (default, Mar 10 2023, 03:07:48) 
[GCC 7.3.1 20180712 (Red Hat 7.3.1-15)])
Initializing AWS DDK project...
Done.
Initialized empty Git repository in /dataall/cdkproxy/cdkpipeline/dataall-sbx-daupgradetest3-qtejf5se/.git/
AWS DDK CLI 0.5.1 (Python 3.8.16 (default, Mar 10 2023, 03:07:48) 
[GCC 7.3.1 20180712 (Red Hat 7.3.1-15)])
Creating AWS CodeCommit repository...
Running git commands...
Done.
Successfully Initialized New CDK/DDK App
Running Commands: git config user.email "codebuild@example.com"; git config user.name "CodeBuild"; git config --local credential.helper "!aws codecommit credential-helper $@"; git config --local credential.UseHttpPath true; git add .; git commit -a -m 'Initial Commit' ; git push -u origin main
[main (root-commit) 4cf1f28] Initial Commit
 12 files changed, 327 insertions(+)
 create mode 100644 .gitignore
 create mode 100644 README.md
 create mode 100644 app.py
 create mode 100644 cdk.json
 create mode 100644 ddk.json
 create mode 100644 ddk_app/__init__.py
 create mode 100644 ddk_app/ddk_app_stack.py
 create mode 100644 requirements-dev.txt
 create mode 100644 requirements.txt
 create mode 100644 setup.py
 create mode 100644 source.bat
 create mode 100755 test.sh
remote: Validating objects: 0%        
remote: Validating objects: 100%        
To https://git-codecommit.eu-west-1.amazonaws.com/v1/repos/dataall-sbx-daupgradetest3-qtejf5se
 * [new branch]      main -> main
branch 'main' set up to track 'origin/main'.
Successfully Pushed DDK App Code
python path = /:/usr/lib64/python38.zip/:/usr/lib64/python3.8/:/usr/lib64/python3.8/lib-dynload/:/usr/local/lib64/python3.8/site-packages/:/usr/local/lib/python3.8/site-packages/:/usr/lib64/python3.8/site-packages/:/usr/lib/python3.8/site-packages:/code
app_path: ./app.py
Remote boto3 session using pivot role for account= xxx
Running command : 
 . ~/.nvm/nvm.sh && cdk deploy --all --require-approval  never -c appid='dataall-sbx-cdkpipeline-qtejf5se' -c account='xxx' -c region='eu-west-1' -c stack='cdkpipeline' -c target_uri='qtejf5se' -c data='{}' --app "/usr/bin/python3.8 ./app.py" --verbose
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!                                                                                                                  !!
!!  Node 16 is approaching end-of-life and will no longer be supported in new releases after 2023-09-11.            !!
!!  Please upgrade to a supported node version as soon as possible.                                                 !!
!!                                                                                                                  !!
!!  This software is currently running on node v16.20.2.                                                            !!
!!  As of the current release of this software, supported node releases are:                                        !!
!!  - ^20.0.0 (Planned end-of-life: 2026-04-30)                                                                     !!
!!  - ^18.0.0 (Planned end-of-life: 2025-04-30)                                                                     !!
!!  - ^16.3.0 (Planned end-of-life: 2023-09-11) [DEPRECATED]                                                        !!
!!                                                                                                                  !!
!!  This warning can be silenced by setting the JSII_SILENCE_WARNING_DEPRECATED_NODE_VERSION environment variable.  !!
!!                                                                                                                  !!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[14:13:59] CDK toolkit version: 2.92.0 (build bf62e55)
[14:13:59] Command line arguments: {
  _: [ 'deploy' ],
  all: true,
  'require-approval': 'never',
  requireApproval: 'never',
  c: [
    'appid=dataall-sbx-cdkpipeline-qtejf5se',
    'account=xxx',
    'region=eu-west-1',
    'stack=cdkpipeline',
    'target_uri=qtejf5se',
    'data={}'
  ],
  context: [
    'appid=dataall-sbx-cdkpipeline-qtejf5se',
    'account=xxx',
    'region=eu-west-1',
    'stack=cdkpipeline',
    'target_uri=qtejf5se',
    'data={}'
  ],
  app: '/usr/bin/python3.8 ./app.py',
  a: '/usr/bin/python3.8 ./app.py',
  verbose: 1,
  v: 1,
  defaultAccount: xxx,
  defaultRegion: 'eu-west-1',
  lookups: true,
  'ignore-errors': false,
  ignoreErrors: false,
  json: false,
  j: false,
  debug: false,
  ec2creds: undefined,
  i: undefined,
  'version-reporting': undefined,
  versionReporting: undefined,
  'path-metadata': undefined,
  pathMetadata: undefined,
  'asset-metadata': undefined,
  assetMetadata: undefined,
  'role-arn': undefined,
  r: undefined,
  roleArn: undefined,
  staging: true,
  'no-color': false,
  noColor: false,
  ci: false,
  'build-exclude': [],
  E: [],
  buildExclude: [],
  force: false,
  f: false,
  parameters: [ {} ],
  'previous-parameters': true,
  previousParameters: true,
  logs: true,
  concurrency: 1,
  'asset-prebuild': true,
  assetPrebuild: true,
  '$0': 'cdk'
}
[14:13:59] CLI argument context: appid=dataall-sbx-cdkpipeline-qtejf5se
[14:13:59] CLI argument context: account=xxx
[14:13:59] CLI argument context: region=eu-west-1
[14:13:59] CLI argument context: stack=cdkpipeline
[14:13:59] CLI argument context: target_uri=qtejf5se
[14:13:59] CLI argument context: data={}
[14:13:59] cdk.json: {
  "app": "python3 app.py",
  "watch": {
    "include": [
      "**"
    ],
    "exclude": [
      "README.md",
      "cdk*.json",
      "requirements*.txt",
      "source.bat",
      "**/__init__.py",
      "python/__pycache__",
      "tests"
    ]
  },
  "context": {
    "@aws-cdk/aws-apigateway:usagePlanKeyOrderInsensitiveId": true,
    "@aws-cdk/core:stackRelativeExports": true,
    "@aws-cdk/aws-rds:lowercaseDbIdentifier": true,
    "@aws-cdk/aws-lambda:recognizeVersionProps": true,
    "@aws-cdk/aws-cloudfront:defaultSecurityPolicyTLSv1.2_2021": true,
    "@aws-cdk-containers/ecs-service-extensions:enableDefaultLogDriver": true,
    "@aws-cdk/aws-ec2:uniqueImdsv2TemplateName": true,
    "@aws-cdk/core:target-partitions": [
      "aws",
      "aws-cn"
    ]
  }
}
[14:13:59] merged settings: {
  versionReporting: true,
  assetMetadata: true,
  pathMetadata: true,
  output: 'cdk.out',
  app: '/usr/bin/python3.8 ./app.py',
  watch: {
    include: [ '**' ],
    exclude: [
      'README.md',
      'cdk*.json',
      'requirements*.txt',
      'source.bat',
      '**/__init__.py',
      'python/__pycache__',
      'tests'
    ]
  },
  context: {
    '@aws-cdk/aws-apigateway:usagePlanKeyOrderInsensitiveId': true,
    '@aws-cdk/core:stackRelativeExports': true,
    '@aws-cdk/aws-rds:lowercaseDbIdentifier': true,
    '@aws-cdk/aws-lambda:recognizeVersionProps': true,
    '@aws-cdk/aws-cloudfront:defaultSecurityPolicyTLSv1.2_2021': true,
    '@aws-cdk-containers/ecs-service-extensions:enableDefaultLogDriver': true,
    '@aws-cdk/aws-ec2:uniqueImdsv2TemplateName': true,
    '@aws-cdk/core:target-partitions': [ 'aws', 'aws-cn' ],
    appid: 'dataall-sbx-cdkpipeline-qtejf5se',
    account: 'xxx',
    region: 'eu-west-1',
    stack: 'cdkpipeline',
    target_uri: 'qtejf5se',
    data: '{}'
  },
  debug: false,
  requireApproval: 'never',
  toolkitBucket: {},
  staging: true,
  bundlingStacks: [ '**' ],
  lookups: true,
  assetPrebuild: true
}
[14:13:59] Determining if we're on an EC2 instance.
[14:13:59] Looks like an EC2 instance.
[14:13:59] Toolkit stack: CDKToolkit
[14:13:59] Setting "CDK_DEFAULT_REGION" environment variable to eu-west-1
[14:13:59] Resolving default credentials
[14:13:59] Looking up default account ID from STS
[14:14:00] Notices refreshed
[14:14:00] Failed to store notices in the cache: Error: ENOENT: no such file or directory, open '/root/.cdk/cache/notices.json'
[14:14:00] Default account ID: xxx
[14:14:00] Setting "CDK_DEFAULT_ACCOUNT" environment variable to xxx
[14:14:00] context: {
  '@aws-cdk/aws-apigateway:usagePlanKeyOrderInsensitiveId': true,
  '@aws-cdk/core:stackRelativeExports': true,
  '@aws-cdk/aws-rds:lowercaseDbIdentifier': true,
  '@aws-cdk/aws-lambda:recognizeVersionProps': true,
  '@aws-cdk/aws-cloudfront:defaultSecurityPolicyTLSv1.2_2021': true,
  '@aws-cdk-containers/ecs-service-extensions:enableDefaultLogDriver': true,
  '@aws-cdk/aws-ec2:uniqueImdsv2TemplateName': true,
  '@aws-cdk/core:target-partitions': [ 'aws', 'aws-cn' ],
  appid: 'dataall-sbx-cdkpipeline-qtejf5se',
  account: 'xxx',
  region: 'eu-west-1',
  stack: 'cdkpipeline',
  target_uri: 'qtejf5se',
  data: '{}',
  'aws:cdk:enable-path-metadata': true,
  'aws:cdk:enable-asset-metadata': true,
  'aws:cdk:version-reporting': true,
  'aws:cdk:bundling-stacks': [ '**' ]
}
[14:14:00] outdir: cdk.out
[14:14:00] env: {
  CDK_DEFAULT_REGION: 'eu-west-1',
  CDK_DEFAULT_ACCOUNT: 'xxx',
  CDK_OUTDIR: 'cdk.out',
  CDK_CLI_ASM_VERSION: '33.0.0',
  CDK_CLI_VERSION: '2.92.0'
}
b'!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!\n'
b'!!                                                                                                                  !!\n'
b'!!  Node 16 is approaching end-of-life and will no longer be supported in new releases after 2023-09-11.            !!\n'
b'!!  Please upgrade to a supported node version as soon as possible.                                                 !!\n'
b'!!                                                                                                                  !!\n'
b'!!  This software is currently running on node v16.20.2.                                                            !!\n'
b'!!  As of the current release of this software, supported node releases are:                                        !!\n'
b'!!  - ^20.0.0 (Planned end-of-life: 2026-04-30)                                                                     !!\n'
b'!!  - ^18.0.0 (Planned end-of-life: 2025-04-30)                                                                     !!\n'
b'!!  - ^16.3.0 (Planned end-of-life: 2023-09-11) [DEPRECATED]                                                        !!\n'
b'!!                                                                                                                  !!\n'
b'!!  This warning can be silenced by setting the JSII_SILENCE_WARNING_DEPRECATED_NODE_VERSION environment variable.  !!\n'
b'!!                                                                                                                  !!\n'
b'!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!\n'
✨  Synthesis time: 10.74s
[14:14:10] Checking for previously published assets
[14:14:10] Retrieved account ID xxx from disk cache
[14:14:10] Assuming role 'arn:aws:iam::xxx:role/ddk-cicd-hnb659fds-deploy-xxx-eu-west-1'.
[14:14:10] Retrieved account ID xxx from disk cache
[14:14:10] Assuming role 'arn:aws:iam::xxx:role/ddk-cicd-hnb659fds-file-publish-xxx-eu-west-1'.
[14:14:10] dataall-cdkpipeline-qtejf5se:  check: Check s3://ddk-cicd-hnb659fds-assets-xxx-eu-west-1/f14e7268987d6f8e350cc9fb1e9fb1c08d7849a350b423f07cd1258b058e96aa.json
[14:14:10] 1 total assets, 1 still need to be published
[14:14:10] Retrieved account ID xxx from disk cache
[14:14:10] Waiting for stack CDKToolkit to finish creating or updating...
dataall-cdkpipeline-qtejf5se:  start: Building f14e7268987d6f8e350cc9fb1e9fb1c08d7849a350b423f07cd1258b058e96aa:xxx-eu-west-1
dataall-cdkpipeline-qtejf5se:  success: Built f14e7268987d6f8e350cc9fb1e9fb1c08d7849a350b423f07cd1258b058e96aa:xxx-eu-west-1
[14:14:11] Retrieved account ID xxx from disk cache
dataall-cdkpipeline-qtejf5se:  start: Publishing f14e7268987d6f8e350cc9fb1e9fb1c08d7849a350b423f07cd1258b058e96aa:xxx-eu-west-1
[14:14:11] Retrieved account ID xxx from disk cache
[14:14:11] Assuming role 'arn:aws:iam::xxx:role/ddk-cicd-hnb659fds-file-publish-xxx-eu-west-1'.
[14:14:11] dataall-cdkpipeline-qtejf5se:  check: Check s3://ddk-cicd-hnb659fds-assets-xxx-eu-west-1/f14e7268987d6f8e350cc9fb1e9fb1c08d7849a350b423f07cd1258b058e96aa.json
[14:14:11] Call failed: getBucketEncryption({"Bucket":"ddk-cicd-hnb659fds-assets-xxx-eu-west-1"}) => Access Denied (code=AccessDenied)
[14:14:11] dataall-cdkpipeline-qtejf5se:  debug: Could not read encryption settings of bucket 'ddk-cicd-hnb659fds-assets-xxx-eu-west-1': uploading with default settings ("cdk bootstrap" to version 9 if your organization's policies prevent a successful upload or to get rid of this message).
[14:14:11] dataall-cdkpipeline-qtejf5se:  upload: Upload s3://ddk-cicd-hnb659fds-assets-xxx-eu-west-1/f14e7268987d6f8e350cc9fb1e9fb1c08d7849a350b423f07cd1258b058e96aa.json
dataall-cdkpipeline-qtejf5se:  success: Published f14e7268987d6f8e350cc9fb1e9fb1c08d7849a350b423f07cd1258b058e96aa:xxx-eu-west-1
dataall-cdkpipeline-qtejf5se: deploying... [1/1]
[14:14:11] Retrieved account ID xxx from disk cache
[14:14:11] Call failed: describeStacks({"StackName":"dataall-cdkpipeline-qtejf5se"}) => Stack with id dataall-cdkpipeline-qtejf5se does not exist (code=ValidationError)
[14:14:11] dataall-cdkpipeline-qtejf5se: checking if we can skip deploy
[14:14:11] dataall-cdkpipeline-qtejf5se: no existing stack
[14:14:11] dataall-cdkpipeline-qtejf5se: deploying...
[14:14:11] Attempting to create ChangeSet with name cdk-deploy-change-set to create stack dataall-cdkpipeline-qtejf5se
dataall-cdkpipeline-qtejf5se: creating CloudFormation changeset...
[14:14:11] Initiated creation of changeset: arn:aws:cloudformation:eu-west-1:xxx:changeSet/cdk-deploy-change-set/d8f2c4c4-9476-405c-84dd-fefb7e9b0138; waiting for it to finish creating...
[14:14:11] Waiting for changeset cdk-deploy-change-set on stack dataall-cdkpipeline-qtejf5se to finish creating...
[14:14:11] Changeset cdk-deploy-change-set on stack dataall-cdkpipeline-qtejf5se is still creating
[14:14:16] Changeset cdk-deploy-change-set on stack dataall-cdkpipeline-qtejf5se is still creating
[14:14:21] Initiating execution of changeset arn:aws:cloudformation:eu-west-1:xxx:changeSet/cdk-deploy-change-set/d8f2c4c4-9476-405c-84dd-fefb7e9b0138 on stack dataall-cdkpipeline-qtejf5se
[14:14:22] Execution of changeset arn:aws:cloudformation:eu-west-1:xxx:changeSet/cdk-deploy-change-set/d8f2c4c4-9476-405c-84dd-fefb7e9b0138 on stack dataall-cdkpipeline-qtejf5se has started; waiting for the update to complete...
[14:14:22] Waiting for stack dataall-cdkpipeline-qtejf5se to finish creating or updating...
[14:14:22] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS (User Initiated))
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:11 PM | REVIEW_IN_PROGRESS   | AWS::CloudFormation::Stack  | dataall-cdkpipeline-qtejf5se User Initiated
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:22 PM | CREATE_IN_PROGRESS   | AWS::CloudFormation::Stack  | dataall-cdkpipeline-qtejf5se User Initiated
[14:14:27] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:27 PM | CREATE_IN_PROGRESS   | AWS::IAM::Role              | code-pipeline/Pipeline/Role (codepipelinePipelineRole6B0A7474) 
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:27 PM | CREATE_IN_PROGRESS   | AWS::CDK::Metadata          | CDKMetadata/Default (CDKMetadata) 
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:27 PM | CREATE_IN_PROGRESS   | AWS::IAM::Role              | code-pipeline/Pipeline/Build/Synth/CdkBuildProject/Role (codepipelinePipelineBuildSynthCdkBuildProjectRole3DB0FD8D) 
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:27 PM | CREATE_IN_PROGRESS   | AWS::IAM::Role              | code-pipeline/Pipeline/EventsRole (codepipelinePipelineEventsRoleF75805EA) 
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:27 PM | CREATE_IN_PROGRESS   | AWS::KMS::Key               | code-pipeline/Pipeline/ArtifactsBucketEncryptionKey (codepipelinePipelineArtifactsBucketEncryptionKey3A0FD228) 
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:27 PM | CREATE_IN_PROGRESS   | AWS::IAM::Role              | code-pipeline/UpdatePipeline/SelfMutation/Role (codepipelineUpdatePipelineSelfMutationRole8863CC9B) 
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:27 PM | CREATE_IN_PROGRESS   | AWS::IAM::Role              | code-pipeline/Pipeline/Source/dataall-sbx-daupgradetest3-qtejf5se/CodePipelineActionRole (codepipelinePipelineSourcedataallsbxdaupgradetest3qtejf5seCodePipelineActionRole10288AD0) 
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:27 PM | CREATE_IN_PROGRESS   | AWS::IAM::Role              | code-pipeline/Pipeline/Role (codepipelinePipelineRole6B0A7474) Resource creation Initiated
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:27 PM | CREATE_IN_PROGRESS   | AWS::IAM::Role              | code-pipeline/Pipeline/Build/Synth/CdkBuildProject/Role (codepipelinePipelineBuildSynthCdkBuildProjectRole3DB0FD8D) Resource creation Initiated
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:27 PM | CREATE_IN_PROGRESS   | AWS::IAM::Role              | code-pipeline/Pipeline/EventsRole (codepipelinePipelineEventsRoleF75805EA) Resource creation Initiated
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:28 PM | CREATE_IN_PROGRESS   | AWS::IAM::Role              | code-pipeline/UpdatePipeline/SelfMutation/Role (codepipelineUpdatePipelineSelfMutationRole8863CC9B) Resource creation Initiated
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:28 PM | CREATE_IN_PROGRESS   | AWS::IAM::Role              | code-pipeline/Pipeline/Source/dataall-sbx-daupgradetest3-qtejf5se/CodePipelineActionRole (codepipelinePipelineSourcedataallsbxdaupgradetest3qtejf5seCodePipelineActionRole10288AD0) Resource creation Initiated
dataall-cdkpipeline-qtejf5se |  0/22 | 2:14:28 PM | CREATE_IN_PROGRESS   | AWS::CDK::Metadata          | CDKMetadata/Default (CDKMetadata) Resource creation Initiated
dataall-cdkpipeline-qtejf5se |  1/22 | 2:14:28 PM | CREATE_COMPLETE      | AWS::CDK::Metadata          | CDKMetadata/Default (CDKMetadata) 
dataall-cdkpipeline-qtejf5se |  1/22 | 2:14:28 PM | CREATE_IN_PROGRESS   | AWS::KMS::Key               | code-pipeline/Pipeline/ArtifactsBucketEncryptionKey (codepipelinePipelineArtifactsBucketEncryptionKey3A0FD228) Resource creation Initiated
[14:14:32] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:14:37] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:14:42] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:14:47] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
dataall-cdkpipeline-qtejf5se |  2/22 | 2:14:46 PM | CREATE_COMPLETE      | AWS::IAM::Role              | code-pipeline/Pipeline/Role (codepipelinePipelineRole6B0A7474) 
dataall-cdkpipeline-qtejf5se |  3/22 | 2:14:46 PM | CREATE_COMPLETE      | AWS::IAM::Role              | code-pipeline/Pipeline/Build/Synth/CdkBuildProject/Role (codepipelinePipelineBuildSynthCdkBuildProjectRole3DB0FD8D) 
dataall-cdkpipeline-qtejf5se |  4/22 | 2:14:46 PM | CREATE_COMPLETE      | AWS::IAM::Role              | code-pipeline/Pipeline/EventsRole (codepipelinePipelineEventsRoleF75805EA) 
dataall-cdkpipeline-qtejf5se |  5/22 | 2:14:46 PM | CREATE_COMPLETE      | AWS::IAM::Role              | code-pipeline/UpdatePipeline/SelfMutation/Role (codepipelineUpdatePipelineSelfMutationRole8863CC9B) 
dataall-cdkpipeline-qtejf5se |  6/22 | 2:14:46 PM | CREATE_COMPLETE      | AWS::IAM::Role              | code-pipeline/Pipeline/Source/dataall-sbx-daupgradetest3-qtejf5se/CodePipelineActionRole (codepipelinePipelineSourcedataallsbxdaupgradetest3qtejf5seCodePipelineActionRole10288AD0) 
[14:14:52] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
dataall-cdkpipeline-qtejf5se |  6/22 | 2:14:48 PM | CREATE_IN_PROGRESS   | AWS::IAM::Role              | code-pipeline/CodeBuildActionRole (codepipelineCodeBuildActionRoleB15E1A14) 
dataall-cdkpipeline-qtejf5se |  6/22 | 2:14:48 PM | CREATE_IN_PROGRESS   | AWS::IAM::Role              | code-pipeline/CodeBuildActionRole (codepipelineCodeBuildActionRoleB15E1A14) Resource creation Initiated
[14:14:57] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:15:02] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:15:07] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
dataall-cdkpipeline-qtejf5se |  7/22 | 2:15:07 PM | CREATE_COMPLETE      | AWS::IAM::Role              | code-pipeline/CodeBuildActionRole (codepipelineCodeBuildActionRoleB15E1A14) 
[14:15:12] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:15:18] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:15:23] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:15:28] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:15:33] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:15:38] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
 7/22 Currently in progress: dataall-cdkpipeline-qtejf5se, codepipelinePipelineArtifactsBucketEncryptionKey3A0FD228
[14:15:43] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:15:48] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:15:53] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:15:58] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:16:03] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:16:08] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:16:13] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:16:18] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:16:23] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:16:28] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:16:33] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
dataall-cdkpipeline-qtejf5se |  8/22 | 2:16:29 PM | CREATE_COMPLETE      | AWS::KMS::Key               | code-pipeline/Pipeline/ArtifactsBucketEncryptionKey (codepipelinePipelineArtifactsBucketEncryptionKey3A0FD228) 
dataall-cdkpipeline-qtejf5se |  8/22 | 2:16:31 PM | CREATE_IN_PROGRESS   | AWS::KMS::Alias             | code-pipeline/Pipeline/ArtifactsBucketEncryptionKeyAlias (codepipelinePipelineArtifactsBucketEncryptionKeyAliasFE101608) 
dataall-cdkpipeline-qtejf5se |  8/22 | 2:16:31 PM | CREATE_IN_PROGRESS   | AWS::CodeBuild::Project     | code-pipeline/Pipeline/Build/Synth/CdkBuildProject (codepipelinePipelineBuildSynthCdkBuildProject55AA4B0E) 
dataall-cdkpipeline-qtejf5se |  8/22 | 2:16:31 PM | CREATE_IN_PROGRESS   | AWS::CodeBuild::Project     | code-pipeline/UpdatePipeline/SelfMutation (codepipelineUpdatePipelineSelfMutationF7C423B0) 
dataall-cdkpipeline-qtejf5se |  8/22 | 2:16:31 PM | CREATE_IN_PROGRESS   | AWS::S3::Bucket             | code-pipeline/Pipeline/ArtifactsBucket (codepipelinePipelineArtifactsBucket8B048B65) 
dataall-cdkpipeline-qtejf5se |  8/22 | 2:16:32 PM | CREATE_IN_PROGRESS   | AWS::KMS::Alias             | code-pipeline/Pipeline/ArtifactsBucketEncryptionKeyAlias (codepipelinePipelineArtifactsBucketEncryptionKeyAliasFE101608) Resource creation Initiated
dataall-cdkpipeline-qtejf5se |  8/22 | 2:16:32 PM | CREATE_IN_PROGRESS   | AWS::CodeBuild::Project     | code-pipeline/Pipeline/Build/Synth/CdkBuildProject (codepipelinePipelineBuildSynthCdkBuildProject55AA4B0E) Resource creation Initiated
dataall-cdkpipeline-qtejf5se |  8/22 | 2:16:32 PM | CREATE_IN_PROGRESS   | AWS::S3::Bucket             | code-pipeline/Pipeline/ArtifactsBucket (codepipelinePipelineArtifactsBucket8B048B65) Resource creation Initiated
dataall-cdkpipeline-qtejf5se |  8/22 | 2:16:32 PM | CREATE_IN_PROGRESS   | AWS::CodeBuild::Project     | code-pipeline/UpdatePipeline/SelfMutation (codepipelineUpdatePipelineSelfMutationF7C423B0) Resource creation Initiated
dataall-cdkpipeline-qtejf5se |  9/22 | 2:16:32 PM | CREATE_COMPLETE      | AWS::CodeBuild::Project     | code-pipeline/Pipeline/Build/Synth/CdkBuildProject (codepipelinePipelineBuildSynthCdkBuildProject55AA4B0E) 
dataall-cdkpipeline-qtejf5se | 10/22 | 2:16:33 PM | CREATE_COMPLETE      | AWS::CodeBuild::Project     | code-pipeline/UpdatePipeline/SelfMutation (codepipelineUpdatePipelineSelfMutationF7C423B0) 
[14:16:39] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
dataall-cdkpipeline-qtejf5se | 10/22 | 2:16:34 PM | CREATE_IN_PROGRESS   | AWS::IAM::Policy            | code-pipeline/CodeBuildActionRole/DefaultPolicy (codepipelineCodeBuildActionRoleDefaultPolicyBC4962E5) 
dataall-cdkpipeline-qtejf5se | 10/22 | 2:16:36 PM | CREATE_IN_PROGRESS   | AWS::IAM::Policy            | code-pipeline/CodeBuildActionRole/DefaultPolicy (codepipelineCodeBuildActionRoleDefaultPolicyBC4962E5) Resource creation Initiated
[14:16:44] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:16:49] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:16:54] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
dataall-cdkpipeline-qtejf5se | 11/22 | 2:16:51 PM | CREATE_COMPLETE      | AWS::IAM::Policy            | code-pipeline/CodeBuildActionRole/DefaultPolicy (codepipelineCodeBuildActionRoleDefaultPolicyBC4962E5) 
dataall-cdkpipeline-qtejf5se | 12/22 | 2:16:53 PM | CREATE_COMPLETE      | AWS::S3::Bucket             | code-pipeline/Pipeline/ArtifactsBucket (codepipelinePipelineArtifactsBucket8B048B65) 
[14:16:59] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
dataall-cdkpipeline-qtejf5se | 12/22 | 2:16:54 PM | CREATE_IN_PROGRESS   | AWS::S3::BucketPolicy       | code-pipeline/Pipeline/ArtifactsBucket/Policy (codepipelinePipelineArtifactsBucketPolicy5087DB5C) 
dataall-cdkpipeline-qtejf5se | 12/22 | 2:16:54 PM | CREATE_IN_PROGRESS   | AWS::IAM::Policy            | code-pipeline/UpdatePipeline/SelfMutation/Role/DefaultPolicy (codepipelineUpdatePipelineSelfMutationRoleDefaultPolicyC4D753BF) 
dataall-cdkpipeline-qtejf5se | 12/22 | 2:16:54 PM | CREATE_IN_PROGRESS   | AWS::IAM::Policy            | code-pipeline/Pipeline/Build/Synth/CdkBuildProject/Role/DefaultPolicy (codepipelinePipelineBuildSynthCdkBuildProjectRoleDefaultPolicy122381F0) 
dataall-cdkpipeline-qtejf5se | 12/22 | 2:16:54 PM | CREATE_IN_PROGRESS   | AWS::IAM::Policy            | code-pipeline/Pipeline/Source/dataall-sbx-daupgradetest3-qtejf5se/CodePipelineActionRole/DefaultPolicy (codepipelinePipelineSourcedataallsbxdaupgradetest3qtejf5seCodePipelineActionRoleDefaultPolicy3B060F36) 
dataall-cdkpipeline-qtejf5se | 12/22 | 2:16:55 PM | CREATE_IN_PROGRESS   | AWS::IAM::Policy            | code-pipeline/Pipeline/Role/DefaultPolicy (codepipelinePipelineRoleDefaultPolicyB6BE2215) 
dataall-cdkpipeline-qtejf5se | 12/22 | 2:16:55 PM | CREATE_IN_PROGRESS   | AWS::S3::BucketPolicy       | code-pipeline/Pipeline/ArtifactsBucket/Policy (codepipelinePipelineArtifactsBucketPolicy5087DB5C) Resource creation Initiated
dataall-cdkpipeline-qtejf5se | 13/22 | 2:16:55 PM | CREATE_COMPLETE      | AWS::S3::BucketPolicy       | code-pipeline/Pipeline/ArtifactsBucket/Policy (codepipelinePipelineArtifactsBucketPolicy5087DB5C) 
dataall-cdkpipeline-qtejf5se | 13/22 | 2:16:55 PM | CREATE_IN_PROGRESS   | AWS::IAM::Policy            | code-pipeline/UpdatePipeline/SelfMutation/Role/DefaultPolicy (codepipelineUpdatePipelineSelfMutationRoleDefaultPolicyC4D753BF) Resource creation Initiated
dataall-cdkpipeline-qtejf5se | 13/22 | 2:16:56 PM | CREATE_IN_PROGRESS   | AWS::IAM::Policy            | code-pipeline/Pipeline/Source/dataall-sbx-daupgradetest3-qtejf5se/CodePipelineActionRole/DefaultPolicy (codepipelinePipelineSourcedataallsbxdaupgradetest3qtejf5seCodePipelineActionRoleDefaultPolicy3B060F36) Resource creation Initiated
dataall-cdkpipeline-qtejf5se | 13/22 | 2:16:56 PM | CREATE_IN_PROGRESS   | AWS::IAM::Policy            | code-pipeline/Pipeline/Build/Synth/CdkBuildProject/Role/DefaultPolicy (codepipelinePipelineBuildSynthCdkBuildProjectRoleDefaultPolicy122381F0) Resource creation Initiated
dataall-cdkpipeline-qtejf5se | 13/22 | 2:16:56 PM | CREATE_IN_PROGRESS   | AWS::IAM::Policy            | code-pipeline/Pipeline/Role/DefaultPolicy (codepipelinePipelineRoleDefaultPolicyB6BE2215) Resource creation Initiated
[14:17:04] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:17:09] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:17:14] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
dataall-cdkpipeline-qtejf5se | 14/22 | 2:17:11 PM | CREATE_COMPLETE      | AWS::IAM::Policy            | code-pipeline/UpdatePipeline/SelfMutation/Role/DefaultPolicy (codepipelineUpdatePipelineSelfMutationRoleDefaultPolicyC4D753BF) 
dataall-cdkpipeline-qtejf5se | 15/22 | 2:17:11 PM | CREATE_COMPLETE      | AWS::IAM::Policy            | code-pipeline/Pipeline/Source/dataall-sbx-daupgradetest3-qtejf5se/CodePipelineActionRole/DefaultPolicy (codepipelinePipelineSourcedataallsbxdaupgradetest3qtejf5seCodePipelineActionRoleDefaultPolicy3B060F36) 
dataall-cdkpipeline-qtejf5se | 16/22 | 2:17:11 PM | CREATE_COMPLETE      | AWS::IAM::Policy            | code-pipeline/Pipeline/Build/Synth/CdkBuildProject/Role/DefaultPolicy (codepipelinePipelineBuildSynthCdkBuildProjectRoleDefaultPolicy122381F0) 
dataall-cdkpipeline-qtejf5se | 17/22 | 2:17:11 PM | CREATE_COMPLETE      | AWS::IAM::Policy            | code-pipeline/Pipeline/Role/DefaultPolicy (codepipelinePipelineRoleDefaultPolicyB6BE2215) 
dataall-cdkpipeline-qtejf5se | 17/22 | 2:17:14 PM | CREATE_IN_PROGRESS   | AWS::CodePipeline::Pipeline | code-pipeline/Pipeline (codepipelinePipeline60D14C3F) 
dataall-cdkpipeline-qtejf5se | 17/22 | 2:17:14 PM | CREATE_IN_PROGRESS   | AWS::CodePipeline::Pipeline | code-pipeline/Pipeline (codepipelinePipeline60D14C3F) Resource creation Initiated
[14:17:19] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
dataall-cdkpipeline-qtejf5se | 18/22 | 2:17:15 PM | CREATE_COMPLETE      | AWS::CodePipeline::Pipeline | code-pipeline/Pipeline (codepipelinePipeline60D14C3F) 
dataall-cdkpipeline-qtejf5se | 18/22 | 2:17:16 PM | CREATE_IN_PROGRESS   | AWS::IAM::Policy            | code-pipeline/Pipeline/EventsRole/DefaultPolicy (codepipelinePipelineEventsRoleDefaultPolicy54D3CD84) 
dataall-cdkpipeline-qtejf5se | 18/22 | 2:17:16 PM | CREATE_IN_PROGRESS   | AWS::Events::Rule           | dataall-sbx-daupgradetest3-qtejf5se/dataallcdkpipelineqtejf5secodepipelinePipeline024FDE14-main-EventRule (dataallsbxdaupgradetest3qtejf5sedataallcdkpipelineqtejf5secodepipelinePipeline024FDE14mainEventRuleCB55D2E6) 
dataall-cdkpipeline-qtejf5se | 18/22 | 2:17:17 PM | CREATE_IN_PROGRESS   | AWS::Events::Rule           | dataall-sbx-daupgradetest3-qtejf5se/dataallcdkpipelineqtejf5secodepipelinePipeline024FDE14-main-EventRule (dataallsbxdaupgradetest3qtejf5sedataallcdkpipelineqtejf5secodepipelinePipeline024FDE14mainEventRuleCB55D2E6) Resource creation Initiated
dataall-cdkpipeline-qtejf5se | 18/22 | 2:17:17 PM | CREATE_IN_PROGRESS   | AWS::IAM::Policy            | code-pipeline/Pipeline/EventsRole/DefaultPolicy (codepipelinePipelineEventsRoleDefaultPolicy54D3CD84) Resource creation Initiated
[14:17:24] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:17:29] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:17:34] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
dataall-cdkpipeline-qtejf5se | 19/22 | 2:17:32 PM | CREATE_COMPLETE      | AWS::KMS::Alias             | code-pipeline/Pipeline/ArtifactsBucketEncryptionKeyAlias (codepipelinePipelineArtifactsBucketEncryptionKeyAliasFE101608) 
dataall-cdkpipeline-qtejf5se | 20/22 | 2:17:33 PM | CREATE_COMPLETE      | AWS::IAM::Policy            | code-pipeline/Pipeline/EventsRole/DefaultPolicy (codepipelinePipelineEventsRoleDefaultPolicy54D3CD84) 
[14:17:39] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:17:44] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:17:49] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:18:00] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:18:05] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
20/22 Currently in progress: dataall-cdkpipeline-qtejf5se, dataallsbxdaupgradetest3qtejf5sedataallcdkpipelineqtejf5secodepipelinePipeline024FDE14mainEventRuleCB55D2E6
[14:18:10] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
[14:18:15] Stack dataall-cdkpipeline-qtejf5se has an ongoing operation in progress and is not stable (CREATE_IN_PROGRESS)
dataall-cdkpipeline-qtejf5se | 21/22 | 2:18:17 PM | CREATE_COMPLETE      | AWS::Events::Rule           | dataall-sbx-daupgradetest3-qtejf5se/dataallcdkpipelineqtejf5secodepipelinePipeline024FDE14-main-EventRule (dataallsbxdaupgradetest3qtejf5sedataallcdkpipelineqtejf5secodepipelinePipeline024FDE14mainEventRuleCB55D2E6) 
dataall-cdkpipeline-qtejf5se | 22/22 | 2:18:18 PM | CREATE_COMPLETE      | AWS::CloudFormation::Stack  | dataall-cdkpipeline-qtejf5se 
[14:18:20] Stack dataall-cdkpipeline-qtejf5se has completed updating
 ✅  dataall-cdkpipeline-qtejf5se
✨  Deployment time: 249.19s
Stack ARN:
arn:aws:cloudformation:eu-west-1:xxx:stack/dataall-cdkpipeline-qtejf5se/80cf1be0-3dd1-11ee-844b-06b7aa8731c3
✨  Total time: 259.93s
[14:18:20] Notices refreshed
Running command : 
 deactivate; rm -rf ./dataall-sbx-daupgradetest3-qtejf5se
Successfully cleaned cloned repo: ./dataall-sbx-daupgradetest3-qtejf5se. 
Remote boto3 session using pivot role for account= xxx
Failed to retrieve stack output for stack dataall-sbx-cdkpipeline-qtejf5se due to: An error occurred (ValidationError) when calling the DescribeStacks operation: Stack with id dataall-sbx-cdkpipeline-qtejf5se does not exist
Failed to deploy stack pdk2vp8y due to Required parameter name not set
Triggering deployment failure alarm...
Sending deployment failure notification
Traceback (most recent call last):
  File "/dataall/cdkproxy/cdk_cli_wrapper.py", line 195, in describe_stack
    return {'StackId': meta.stack_id, 'StackStatus': meta.stack_status}
  File "/usr/local/lib/python3.8/site-packages/boto3/resources/factory.py", line 380, in property_loader
    self.load()
  File "/usr/local/lib/python3.8/site-packages/boto3/resources/factory.py", line 564, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/boto3/resources/action.py", line 88, in __call__
    response = getattr(parent.meta.client, operation_name)(*args, **params)
  File "/usr/local/lib/python3.8/site-packages/botocore/client.py", line 514, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/site-packages/botocore/client.py", line 938, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (ValidationError) when calling the DescribeStacks operation: Stack with id dataall-sbx-cdkpipeline-qtejf5se does not exist
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/lib64/python3.8/runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib64/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/dataall/tasks/cdkproxy.py", line 21, in <module>
    deploy_cdk_stack(engine=engine, stackid=stack_uri, app_path='../cdkproxy/app.py')
  File "/dataall/cdkproxy/cdk_cli_wrapper.py", line 182, in deploy_cdk_stack
    raise e
  File "/dataall/cdkproxy/cdk_cli_wrapper.py", line 170, in deploy_cdk_stack
    meta = describe_stack(stack)
  File "/dataall/cdkproxy/cdk_cli_wrapper.py", line 198, in describe_stack
    meta = resource.Stack(stack.stackid)
  File "/usr/local/lib/python3.8/site-packages/boto3/resources/factory.py", line 527, in create_resource
    return partial(
  File "/usr/local/lib/python3.8/site-packages/boto3/resources/base.py", line 125, in __init__
    raise ValueError(f'Required parameter {identifier} not set')
ValueError: Required parameter name not set
louishourcade commented 1 year ago

Hi @MATTT-P, In the logs, I see that the Cloudformation stack is dataall-cdkpipeline-qtejf5se, while the subsequent code tries to get output from the stack dataall-sbx-daupgradetest3-qtejf5se. In backend/dataall/cdkproxy/cdkpipeline/cdk_pipeline.py, it seems that when a user selects the "CDK pipeline - trunk based" strategy, then the Cloudformation stack is named dataall-cdkpipeline-{URI}. But I believe that dataall tries to interact with the cloudformation stack {env_prefix}-cdkpipeline-{URI}. dataall is the default environment prefix, but you would get the error if you have another environment prefix for your environment (such as dataall-sbx in your case). @MATTT-P could you try creating a "CDK pipeline - trunk based" in an environment which has dataall as the environment prefix ? We will then see if this is the only thing causing the error. If that's the case, we will fix it in the open-source repository. cc @dlpzx

dlpzx commented 1 year ago

Thanks @louishourcade for looking into the issue. Also, it looks like the deployment was successful, the issue is on the describe stack operation. @MATTT-P can you check if the stack was created in CloudFormation?

I think the issue is in backend.dataall.cdkproxy.cdk_cli_wrapper.describe_stack in line 199, where we use the stack.name which includes the env_prefix. The solution would be to pass the env_prefix in the creation of the pipeline backend/dataall/cdkproxy/cdkpipeline/cdk_pipeline.py in line 161 id = f"dataall-cdkpipeline-{pipeline.DataPipelineUri}"

noah-paige commented 9 months ago

The above solution has been implemented in PR #985

Closing this issue for now as remediated - please do open again or create a new issue if any further issues persist, thanks