search

DataDog / datadog-agent

Main repository for Datadog Agent
https://docs.datadoghq.com/
Apache License 2.0
2.84k stars 1.19k forks source link

Add gitlab ci diff cli / pr comment #27153

Closed CelianR closed 2 months ago

CelianR commented 3 months ago

What does this PR do?

This adds a task that prints gitlab ci modifications as shown below. It also comments on PRs.

Screenshot 2024-07-01 at 16 39 48

Motivation

Additional Notes

This adds:

Possible Drawbacks / Trade-offs

Describe how to test/QA your changes

agent-platform-auto-pr[bot] commented 3 months ago

[Fast Unit Tests Report]

On pipeline 39033913 (CI Visibility). The following jobs did not run any unit tests:

Jobs: - tests_deb-arm64-py3 - tests_deb-x64-py3 - tests_flavor_dogstatsd_deb-x64 - tests_flavor_heroku_deb-x64 - tests_flavor_iot_deb-x64 - tests_rpm-arm64-py3 - tests_rpm-x64-py3 - tests_windows-x64

If you modified Go files and expected unit tests to run in these jobs, please double check the job logs. If you think tests should have been executed reach out to #agent-devx-help

pr-commenter[bot] commented 3 months ago

Regression Detector

Regression Detector Results

Run ID: 61f04f82-28e1-43ac-b309-3df15439e9ad Metrics dashboard Target profiles

Baseline: 76be39d3e7a9cd16f334dbf012097f42ddadb76f Comparison: df616a2649a91a7006ada2148a8d5f2a071b8c1d

Performance changes are noted in the perf column of each table:

No significant changes in experiment optimization goals

Confidence level: 90.00% Effect size tolerance: |Δ mean %| ≥ 5.00%

There were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.

Fine details of change detection per experiment

| perf | experiment | goal | Δ mean % | Δ mean % CI | links | |------|----------------------------|--------------------|----------|-----------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | ➖ | tcp_syslog_to_blackhole | ingress throughput | +7.35 | [-5.93, +20.63] | [Logs](https://app.datadoghq.com/logs?query=experiment%3Atcp_syslog_to_blackhole%20run_id%3A61f04f82-28e1-43ac-b309-3df15439e9ad&agg_m=count&agg_m_source=base&agg_q=%40span.url&agg_q_source=base&agg_t=count&fromUser=true&index=single-machine-performance-target-logs&messageDisplay=inline&refresh_mode=paused&storage=hot&stream_sort=time%2Cdesc&top_n=100&top_o=top&viz=stream&x_missing=true&from_ts=1720785712000&to_ts=1720797112000&live=false) | | ➖ | pycheck_1000_100byte_tags | % cpu utilization | +0.74 | [-4.16, +5.63] | [Logs](https://app.datadoghq.com/logs?query=experiment%3Apycheck_1000_100byte_tags%20run_id%3A61f04f82-28e1-43ac-b309-3df15439e9ad&agg_m=count&agg_m_source=base&agg_q=%40span.url&agg_q_source=base&agg_t=count&fromUser=true&index=single-machine-performance-target-logs&messageDisplay=inline&refresh_mode=paused&storage=hot&stream_sort=time%2Cdesc&top_n=100&top_o=top&viz=stream&x_missing=true&from_ts=1720785712000&to_ts=1720797112000&live=false) | | ➖ | idle | memory utilization | +0.42 | [+0.37, +0.47] | [Logs](https://app.datadoghq.com/logs?query=experiment%3Aidle%20run_id%3A61f04f82-28e1-43ac-b309-3df15439e9ad&agg_m=count&agg_m_source=base&agg_q=%40span.url&agg_q_source=base&agg_t=count&fromUser=true&index=single-machine-performance-target-logs&messageDisplay=inline&refresh_mode=paused&storage=hot&stream_sort=time%2Cdesc&top_n=100&top_o=top&viz=stream&x_missing=true&from_ts=1720785712000&to_ts=1720797112000&live=false) | | ➖ | file_tree | memory utilization | +0.18 | [+0.06, +0.31] | [Logs](https://app.datadoghq.com/logs?query=experiment%3Afile_tree%20run_id%3A61f04f82-28e1-43ac-b309-3df15439e9ad&agg_m=count&agg_m_source=base&agg_q=%40span.url&agg_q_source=base&agg_t=count&fromUser=true&index=single-machine-performance-target-logs&messageDisplay=inline&refresh_mode=paused&storage=hot&stream_sort=time%2Cdesc&top_n=100&top_o=top&viz=stream&x_missing=true&from_ts=1720785712000&to_ts=1720797112000&live=false) | | ➖ | basic_py_check | % cpu utilization | +0.12 | [-2.62, +2.87] | [Logs](https://app.datadoghq.com/logs?query=experiment%3Abasic_py_check%20run_id%3A61f04f82-28e1-43ac-b309-3df15439e9ad&agg_m=count&agg_m_source=base&agg_q=%40span.url&agg_q_source=base&agg_t=count&fromUser=true&index=single-machine-performance-target-logs&messageDisplay=inline&refresh_mode=paused&storage=hot&stream_sort=time%2Cdesc&top_n=100&top_o=top&viz=stream&x_missing=true&from_ts=1720785712000&to_ts=1720797112000&live=false) | | ➖ | uds_dogstatsd_to_api_cpu | % cpu utilization | +0.10 | [-0.80, +1.00] | [Logs](https://app.datadoghq.com/logs?query=experiment%3Auds_dogstatsd_to_api_cpu%20run_id%3A61f04f82-28e1-43ac-b309-3df15439e9ad&agg_m=count&agg_m_source=base&agg_q=%40span.url&agg_q_source=base&agg_t=count&fromUser=true&index=single-machine-performance-target-logs&messageDisplay=inline&refresh_mode=paused&storage=hot&stream_sort=time%2Cdesc&top_n=100&top_o=top&viz=stream&x_missing=true&from_ts=1720785712000&to_ts=1720797112000&live=false) | | ➖ | tcp_dd_logs_filter_exclude | ingress throughput | -0.00 | [-0.01, +0.01] | [Logs](https://app.datadoghq.com/logs?query=experiment%3Atcp_dd_logs_filter_exclude%20run_id%3A61f04f82-28e1-43ac-b309-3df15439e9ad&agg_m=count&agg_m_source=base&agg_q=%40span.url&agg_q_source=base&agg_t=count&fromUser=true&index=single-machine-performance-target-logs&messageDisplay=inline&refresh_mode=paused&storage=hot&stream_sort=time%2Cdesc&top_n=100&top_o=top&viz=stream&x_missing=true&from_ts=1720785712000&to_ts=1720797112000&live=false) | | ➖ | uds_dogstatsd_to_api | ingress throughput | -0.00 | [-0.00, +0.00] | [Logs](https://app.datadoghq.com/logs?query=experiment%3Auds_dogstatsd_to_api%20run_id%3A61f04f82-28e1-43ac-b309-3df15439e9ad&agg_m=count&agg_m_source=base&agg_q=%40span.url&agg_q_source=base&agg_t=count&fromUser=true&index=single-machine-performance-target-logs&messageDisplay=inline&refresh_mode=paused&storage=hot&stream_sort=time%2Cdesc&top_n=100&top_o=top&viz=stream&x_missing=true&from_ts=1720785712000&to_ts=1720797112000&live=false) | | ➖ | otel_to_otel_logs | ingress throughput | -0.00 | [-0.81, +0.80] | [Logs](https://app.datadoghq.com/logs?query=experiment%3Aotel_to_otel_logs%20run_id%3A61f04f82-28e1-43ac-b309-3df15439e9ad&agg_m=count&agg_m_source=base&agg_q=%40span.url&agg_q_source=base&agg_t=count&fromUser=true&index=single-machine-performance-target-logs&messageDisplay=inline&refresh_mode=paused&storage=hot&stream_sort=time%2Cdesc&top_n=100&top_o=top&viz=stream&x_missing=true&from_ts=1720785712000&to_ts=1720797112000&live=false) |

Explanation

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI". For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true: 1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look. 2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that *if our statistical model is accurate*, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants. 3. Its configuration does not mark it "erratic".
CelianR commented 3 months ago

Example Gitlab CI Configuration Changes

Modified Jobs

notify_failure_summary_daily

 ```diff notify_failure_summary_daily: dependencies: [] image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES resource_group: notification rules: - if: $BUCKET_BRANCH != "nightly" && $BUCKET_BRANCH != "oldnightly" && $BUCKET_BRANCH != "dev" when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null when: always script: - source /root/.bashrc - export SLACK_API_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $SLACK_AGENT_CI_TOKEN_SSM_NAME) - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_READ_API_TOKEN_SSM_NAME) - export DD_API_KEY=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $API_KEY_ORG2_SSM_NAME) - python3 -m pip install -r requirements.txt -r tasks/libs/requirements-notifications.txt - - weekday="$(date --utc '+%A')" + - weekday="$(date --utc '+%A')" ah ? +++ - "if [ \"$weekday\" = \"Sunday\" ] || [ \"$weekday\" = \"Monday\" ]; then\n echo\ \ \"Skipping daily summary on $weekday\"\n exit\nfi\n" - inv -e notify.failure-summary-send-notifications --daily-summary - "if [ \"$weekday\" = \"Friday\" ]; then\n echo 'Sending weekly summary'\n inv\ \ -e notify.failure-summary-send-notifications --weekly-summary\nfi\n" stage: notify tags: - arch:amd64 timeout: 15 minutes ```

Added Jobs

notify_gitlab_ci_changes

 ```yaml notify_gitlab_ci_changes: before_script: - git fetch origin main - git checkout main - git checkout - image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: [] rules: - if: $CI_PIPELINE_SOURCE != "push" when: never - changes: compare_to: main paths: - .gitlab-ci.yml - .gitlab/**/*.yml script: - source /root/.bashrc - python3 -m pip install -r tasks/libs/requirements-github.txt - 'export GITHUB_KEY=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITHUB_PR_COMMENTER_APP_KEY_SSM_NAME) export GITHUB_APP_ID=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITHUB_PR_COMMENTER_INTEGRATION_ID_SSM_NAME) export GITHUB_INSTALLATION_ID=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITHUB_PR_COMMENTER_INSTALLATION_ID_SSM_NAME) export GITHUB_TOKEN=$(inv github.get-token-from-app --pkey-env GITHUB_KEY --installation-id GITHUB_INSTALLATION_ID --no-base64) export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_FULL_API_TOKEN_SSM_NAME) ' - inv -e notify.gitlab-ci-diff --pr-comment stage: notify tags: - arch:amd64 ```

Renamed Jobs

Changes

Removed Modified Added Renamed
0 1 1 1
pr-commenter[bot] commented 3 months ago

Gitlab CI Configuration Changes

Added Jobs

notify_gitlab_ci_changes ```yaml notify_gitlab_ci_changes: before_script: - git fetch origin main - git checkout main - git checkout - image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: [] rules: - if: $CI_PIPELINE_SOURCE != "push" when: never - changes: compare_to: main paths: - .gitlab-ci.yml - .gitlab/**/*.yml script: - source /root/.bashrc - python3 -m pip install -r tasks/libs/requirements-github.txt - 'export GITHUB_KEY_B64=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITHUB_PR_COMMENTER_APP_KEY_SSM_NAME | base64) export GITHUB_APP_ID=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITHUB_PR_COMMENTER_INTEGRATION_ID_SSM_NAME) export GITHUB_INSTALLATION_ID=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITHUB_PR_COMMENTER_INSTALLATION_ID_SSM_NAME) export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_FULL_API_TOKEN_SSM_NAME) ' - inv -e notify.gitlab-ci-diff --pr-comment stage: notify tags: - arch:amd64 ```

Changes Summary

Removed Modified Added Renamed
0 0 1 0

:information_source: Diff available in the job log.

amenasria commented 3 months ago

👏 praise: ‏Wtf this is so clean omg thank you for this !!!!

CelianR commented 3 months ago

Gitlab CI Configuration Changes (jaime/oteluabuild)

Modified Jobs
cws_instrumentation_dev_branch_multiarch ```diff cws_instrumentation_dev_branch_multiarch: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_cws_instrumentation_amd64 - docker_build_cws_instrumentation_arm64 rules: - allow_failure: true if: $CI_COMMIT_BRANCH == "main" || $DEPLOY_AGENT == "true" || $RUN_ALL_BUILDS == "true" || $DDR_WORKFLOW_ID != null when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: cws-instrumentation-dev:${CI_COMMIT_REF_SLUG} IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_SOURCES: ${SRC_CWS_INSTRUMENTATION}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64,${SRC_CWS_INSTRUMENTATION}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-arm64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
datadog-agent-6-arm64 ```diff datadog-agent-6-arm64: artifacts: expire_in: 2 weeks paths: - $OMNIBUS_PACKAGE_DIR before_script: - export RELEASE_VERSION=$RELEASE_VERSION_6 cache: - key: files: - omnibus/Gemfile - release.json prefix: omnibus-deps-$CI_JOB_NAME-$OMNIBUS_RUBY_VERSION-$OMNIBUS_SOFTWARE paths: - omnibus/vendor/bundle image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_arm64$DATADOG_AGENT_ARMBUILDIMAGES_SUFFIX:$DATADOG_AGENT_ARMBUILDIMAGES needs: - go_mod_tidy_check - build_system-probe-arm64 - go_deps - generate_minimized_btfs_arm64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - when: on_success script: - source /root/.bashrc - echo "About to build for $RELEASE_VERSION" - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_RUBY}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export BUNDLE_MIRROR__RUBYGEMS__ORG=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_GEMS_PATH}; fi - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_PYTHON}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export PIP_INDEX_URL=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_PYPI_PATH}; fi - mkdir -p $GOPATH/pkg/mod && tar xJf modcache.tar.xz -C $GOPATH/pkg/mod - rm -f modcache.tar.xz - pushd omnibus && bundle config set --local path 'vendor/bundle' && popd - rm -rf $OMNIBUS_PACKAGE_DIR/* - tar -xf $CI_PROJECT_DIR/sysprobe-build-outputs.tar.xz - mkdir -p /tmp/system-probe - $S3_CP_CMD $S3_PERMANENT_ARTIFACTS_URI/clang-$CLANG_LLVM_VER.${PACKAGE_ARCH} /tmp/system-probe/clang-bpf - $S3_CP_CMD $S3_PERMANENT_ARTIFACTS_URI/llc-$CLANG_LLVM_VER.${PACKAGE_ARCH} /tmp/system-probe/llc-bpf - cp $CI_PROJECT_DIR/minimized-btfs.tar.xz /tmp/system-probe/minimized-btfs.tar.xz - chmod 0744 /tmp/system-probe/clang-bpf /tmp/system-probe/llc-bpf - inv -e omnibus.build --release-version "$RELEASE_VERSION" --major-version "$AGENT_MAJOR_VERSION" --python-runtimes "$PYTHON_RUNTIMES" --base-dir $OMNIBUS_BASE_DIR ${USE_S3_CACHING} --skip-deps --go-mod-cache="$GOPATH/pkg/mod" --system-probe-bin=/tmp/system-probe + --flavor "$FLAVOR" - ls -la $OMNIBUS_PACKAGE_DIR - $S3_CP_CMD $OMNIBUS_PACKAGE_DIR/version-manifest.json $S3_SBOM_STORAGE_URI/$CI_JOB_NAME/version-manifest.json stage: package_build tags: - arch:arm64 variables: AGENT_MAJOR_VERSION: 6 + FLAVOR: base KUBERNETES_CPU_REQUEST: 16 KUBERNETES_MEMORY_LIMIT: 32Gi KUBERNETES_MEMORY_REQUEST: 32Gi PACKAGE_ARCH: arm64 PYTHON_RUNTIMES: 23 ```
datadog-agent-6-x64 ```diff datadog-agent-6-x64: artifacts: expire_in: 2 weeks paths: - $OMNIBUS_PACKAGE_DIR before_script: - export RELEASE_VERSION=$RELEASE_VERSION_6 cache: - key: files: - omnibus/Gemfile - release.json prefix: omnibus-deps-$CI_JOB_NAME-$OMNIBUS_RUBY_VERSION-$OMNIBUS_SOFTWARE paths: - omnibus/vendor/bundle image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/rpm_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - go_mod_tidy_check - build_system-probe-x64 - go_deps - generate_minimized_btfs_x64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - when: on_success script: - source /root/.bashrc - echo "About to build for $RELEASE_VERSION" - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_RUBY}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export BUNDLE_MIRROR__RUBYGEMS__ORG=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_GEMS_PATH}; fi - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_PYTHON}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export PIP_INDEX_URL=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_PYPI_PATH}; fi - mkdir -p $GOPATH/pkg/mod && tar xJf modcache.tar.xz -C $GOPATH/pkg/mod - rm -f modcache.tar.xz - pushd omnibus && bundle config set --local path 'vendor/bundle' && popd - rm -rf $OMNIBUS_PACKAGE_DIR/* - tar -xf $CI_PROJECT_DIR/sysprobe-build-outputs.tar.xz - mkdir -p /tmp/system-probe - $S3_CP_CMD $S3_PERMANENT_ARTIFACTS_URI/clang-$CLANG_LLVM_VER.${PACKAGE_ARCH} /tmp/system-probe/clang-bpf - $S3_CP_CMD $S3_PERMANENT_ARTIFACTS_URI/llc-$CLANG_LLVM_VER.${PACKAGE_ARCH} /tmp/system-probe/llc-bpf - cp $CI_PROJECT_DIR/minimized-btfs.tar.xz /tmp/system-probe/minimized-btfs.tar.xz - chmod 0744 /tmp/system-probe/clang-bpf /tmp/system-probe/llc-bpf - inv -e omnibus.build --release-version "$RELEASE_VERSION" --major-version "$AGENT_MAJOR_VERSION" --python-runtimes "$PYTHON_RUNTIMES" --base-dir $OMNIBUS_BASE_DIR ${USE_S3_CACHING} --skip-deps --go-mod-cache="$GOPATH/pkg/mod" --system-probe-bin=/tmp/system-probe + --flavor "$FLAVOR" - ls -la $OMNIBUS_PACKAGE_DIR - $S3_CP_CMD $OMNIBUS_PACKAGE_DIR/version-manifest.json $S3_SBOM_STORAGE_URI/$CI_JOB_NAME/version-manifest.json stage: package_build tags: - arch:amd64 variables: AGENT_MAJOR_VERSION: 6 + FLAVOR: base KUBERNETES_CPU_REQUEST: 16 KUBERNETES_MEMORY_LIMIT: 32Gi KUBERNETES_MEMORY_REQUEST: 32Gi PACKAGE_ARCH: amd64 PYTHON_RUNTIMES: 23 ```
datadog-agent-7-arm64 ```diff datadog-agent-7-arm64: artifacts: expire_in: 2 weeks paths: - $OMNIBUS_PACKAGE_DIR before_script: - export RELEASE_VERSION=$RELEASE_VERSION_7 cache: - key: files: - omnibus/Gemfile - release.json prefix: omnibus-deps-$CI_JOB_NAME-$OMNIBUS_RUBY_VERSION-$OMNIBUS_SOFTWARE paths: - omnibus/vendor/bundle image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_arm64$DATADOG_AGENT_ARMBUILDIMAGES_SUFFIX:$DATADOG_AGENT_ARMBUILDIMAGES needs: - go_mod_tidy_check - build_system-probe-arm64 - go_deps - generate_minimized_btfs_arm64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - when: on_success script: - source /root/.bashrc - echo "About to build for $RELEASE_VERSION" - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_RUBY}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export BUNDLE_MIRROR__RUBYGEMS__ORG=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_GEMS_PATH}; fi - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_PYTHON}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export PIP_INDEX_URL=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_PYPI_PATH}; fi - mkdir -p $GOPATH/pkg/mod && tar xJf modcache.tar.xz -C $GOPATH/pkg/mod - rm -f modcache.tar.xz - pushd omnibus && bundle config set --local path 'vendor/bundle' && popd - rm -rf $OMNIBUS_PACKAGE_DIR/* - tar -xf $CI_PROJECT_DIR/sysprobe-build-outputs.tar.xz - mkdir -p /tmp/system-probe - $S3_CP_CMD $S3_PERMANENT_ARTIFACTS_URI/clang-$CLANG_LLVM_VER.${PACKAGE_ARCH} /tmp/system-probe/clang-bpf - $S3_CP_CMD $S3_PERMANENT_ARTIFACTS_URI/llc-$CLANG_LLVM_VER.${PACKAGE_ARCH} /tmp/system-probe/llc-bpf - cp $CI_PROJECT_DIR/minimized-btfs.tar.xz /tmp/system-probe/minimized-btfs.tar.xz - chmod 0744 /tmp/system-probe/clang-bpf /tmp/system-probe/llc-bpf - inv -e omnibus.build --release-version "$RELEASE_VERSION" --major-version "$AGENT_MAJOR_VERSION" --python-runtimes "$PYTHON_RUNTIMES" --base-dir $OMNIBUS_BASE_DIR ${USE_S3_CACHING} --skip-deps --go-mod-cache="$GOPATH/pkg/mod" --system-probe-bin=/tmp/system-probe + --flavor "$FLAVOR" - ls -la $OMNIBUS_PACKAGE_DIR - $S3_CP_CMD $OMNIBUS_PACKAGE_DIR/version-manifest.json $S3_SBOM_STORAGE_URI/$CI_JOB_NAME/version-manifest.json stage: package_build tags: - arch:arm64 variables: AGENT_MAJOR_VERSION: 7 + FLAVOR: base KUBERNETES_CPU_REQUEST: 16 KUBERNETES_MEMORY_LIMIT: 32Gi KUBERNETES_MEMORY_REQUEST: 32Gi PACKAGE_ARCH: arm64 PYTHON_RUNTIMES: '3' ```
datadog-agent-7-x64 ```diff datadog-agent-7-x64: artifacts: expire_in: 2 weeks paths: - $OMNIBUS_PACKAGE_DIR before_script: - export RELEASE_VERSION=$RELEASE_VERSION_7 cache: - key: files: - omnibus/Gemfile - release.json prefix: omnibus-deps-$CI_JOB_NAME-$OMNIBUS_RUBY_VERSION-$OMNIBUS_SOFTWARE paths: - omnibus/vendor/bundle image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/rpm_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - go_mod_tidy_check - build_system-probe-x64 - go_deps - generate_minimized_btfs_x64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - when: on_success script: - source /root/.bashrc - echo "About to build for $RELEASE_VERSION" - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_RUBY}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export BUNDLE_MIRROR__RUBYGEMS__ORG=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_GEMS_PATH}; fi - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_PYTHON}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export PIP_INDEX_URL=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_PYPI_PATH}; fi - mkdir -p $GOPATH/pkg/mod && tar xJf modcache.tar.xz -C $GOPATH/pkg/mod - rm -f modcache.tar.xz - pushd omnibus && bundle config set --local path 'vendor/bundle' && popd - rm -rf $OMNIBUS_PACKAGE_DIR/* - tar -xf $CI_PROJECT_DIR/sysprobe-build-outputs.tar.xz - mkdir -p /tmp/system-probe - $S3_CP_CMD $S3_PERMANENT_ARTIFACTS_URI/clang-$CLANG_LLVM_VER.${PACKAGE_ARCH} /tmp/system-probe/clang-bpf - $S3_CP_CMD $S3_PERMANENT_ARTIFACTS_URI/llc-$CLANG_LLVM_VER.${PACKAGE_ARCH} /tmp/system-probe/llc-bpf - cp $CI_PROJECT_DIR/minimized-btfs.tar.xz /tmp/system-probe/minimized-btfs.tar.xz - chmod 0744 /tmp/system-probe/clang-bpf /tmp/system-probe/llc-bpf - inv -e omnibus.build --release-version "$RELEASE_VERSION" --major-version "$AGENT_MAJOR_VERSION" --python-runtimes "$PYTHON_RUNTIMES" --base-dir $OMNIBUS_BASE_DIR ${USE_S3_CACHING} --skip-deps --go-mod-cache="$GOPATH/pkg/mod" --system-probe-bin=/tmp/system-probe + --flavor "$FLAVOR" - ls -la $OMNIBUS_PACKAGE_DIR - $S3_CP_CMD $OMNIBUS_PACKAGE_DIR/version-manifest.json $S3_SBOM_STORAGE_URI/$CI_JOB_NAME/version-manifest.json stage: package_build tags: - arch:amd64 variables: AGENT_MAJOR_VERSION: 7 + FLAVOR: base KUBERNETES_CPU_REQUEST: 16 KUBERNETES_MEMORY_LIMIT: 32Gi KUBERNETES_MEMORY_REQUEST: 32Gi PACKAGE_ARCH: amd64 PYTHON_RUNTIMES: '3' ```
dca_dev_branch ```diff dca_dev_branch: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_cluster_agent_amd64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: cluster-agent-dev:${CI_COMMIT_REF_SLUG} IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_SOURCES: ${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dca_dev_branch_multiarch ```diff dca_dev_branch_multiarch: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_cluster_agent_amd64 - docker_build_cluster_agent_arm64 rules: - allow_failure: true if: $CI_COMMIT_BRANCH == "main" || $DEPLOY_AGENT == "true" || $RUN_ALL_BUILDS == "true" || $DDR_WORKFLOW_ID != null when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: cluster-agent-dev:${CI_COMMIT_REF_SLUG} IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_SOURCES: ${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64,${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-arm64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dca_dev_master ```diff dca_dev_master: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_cluster_agent_amd64 rules: - if: $CI_COMMIT_BRANCH == "main" script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: cluster-agent-dev:master IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_SOURCES: ${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dca_scan_master ```diff dca_scan_master: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_cluster_agent_amd64 rules: - if: $CI_COMMIT_BRANCH == "main" script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: container_scan tags: - arch:amd64 variables: IMG_DESTINATIONS: cluster-agent-scan:master IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_SOURCES: ${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dca_scan_nightly ```diff dca_scan_nightly: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_cluster_agent_amd64 rules: - if: $BUCKET_BRANCH != "nightly" && $BUCKET_BRANCH != "oldnightly" && $BUCKET_BRANCH != "dev" when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: container_scan tags: - arch:amd64 variables: IMG_DESTINATIONS: cluster-agent-scan:${BUCKET_BRANCH} IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_SOURCES: ${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
deploy_containers-cws-instrumentation-final-versioned ```diff deploy_containers-cws-instrumentation-final-versioned: before_script: - source /root/.bashrc - if [[ "$VERSION" == "" ]]; then export VERSION="$(inv agent.version --major-version 7 --url-safe)"; fi - if [[ "$CWS_INSTRUMENTATION_REPOSITORY" == "" ]]; then export CWS_INSTRUMENTATION_REPOSITORY="cws-instrumentation"; fi - export IMG_BASE_SRC="${SRC_CWS_INSTRUMENTATION}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}" - export IMG_SOURCES="${IMG_BASE_SRC}-amd64,${IMG_BASE_SRC}-arm64" - export IMG_DESTINATIONS="${CWS_INSTRUMENTATION_REPOSITORY}:${VERSION}" dependencies: [] image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES rules: - if: $DEPLOY_AGENT != "true" && $DDR_WORKFLOW_ID == null when: never - if: ($DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null) && $BUCKET_BRANCH == "beta" when: never - allow_failure: true if: $BUCKET_BRANCH != "beta" && $BUCKET_BRANCH != "stable" variables: AGENT_REPOSITORY: agent-dev DSD_REPOSITORY: dogstatsd-dev IMG_REGISTRIES: dev when: manual - allow_failure: true variables: AGENT_REPOSITORY: agent DSD_REPOSITORY: dogstatsd IMG_REGISTRIES: public when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: deploy_cws_instrumentation tags: - arch:amd64 variables: IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
deploy_containers-cws-instrumentation-latest ```diff deploy_containers-cws-instrumentation-latest: before_script: - source /root/.bashrc - if [[ "$VERSION" == "" ]]; then export VERSION="$(inv agent.version --major-version 7 --url-safe)"; fi - if [[ "$CWS_INSTRUMENTATION_REPOSITORY" == "" ]]; then export CWS_INSTRUMENTATION_REPOSITORY="cws-instrumentation"; fi - export IMG_BASE_SRC="${SRC_CWS_INSTRUMENTATION}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}" - export IMG_SOURCES="${IMG_BASE_SRC}-amd64,${IMG_BASE_SRC}-arm64" - export IMG_DESTINATIONS="${CWS_INSTRUMENTATION_REPOSITORY}:${VERSION}" dependencies: [] image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES rules: - if: $DEPLOY_AGENT != "true" && $DDR_WORKFLOW_ID == null when: never - if: ($DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null) && $BUCKET_BRANCH == "beta" when: never - allow_failure: true if: $BUCKET_BRANCH != "beta" && $BUCKET_BRANCH != "stable" variables: AGENT_REPOSITORY: agent-dev DSD_REPOSITORY: dogstatsd-dev IMG_REGISTRIES: dev when: manual - allow_failure: true variables: AGENT_REPOSITORY: agent DSD_REPOSITORY: dogstatsd IMG_REGISTRIES: public when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: deploy_cws_instrumentation tags: - arch:amd64 variables: IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd VERSION: latest ```
deploy_containers-cws-instrumentation-rc-mutable ```diff deploy_containers-cws-instrumentation-rc-mutable: before_script: - source /root/.bashrc - if [[ "$VERSION" == "" ]]; then export VERSION="$(inv agent.version --major-version 7 --url-safe)"; fi - if [[ "$CWS_INSTRUMENTATION_REPOSITORY" == "" ]]; then export CWS_INSTRUMENTATION_REPOSITORY="cws-instrumentation"; fi - export IMG_BASE_SRC="${SRC_CWS_INSTRUMENTATION}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}" - export IMG_SOURCES="${IMG_BASE_SRC}-amd64,${IMG_BASE_SRC}-arm64" - export IMG_DESTINATIONS="${CWS_INSTRUMENTATION_REPOSITORY}:${VERSION}" dependencies: [] image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES rules: - if: $DEPLOY_AGENT != "true" && $DDR_WORKFLOW_ID == null when: never - if: ($DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null) && $BUCKET_BRANCH == "beta" && $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ variables: AGENT_REPOSITORY: agent DSD_REPOSITORY: dogstatsd IMG_REGISTRIES: public when: on_success script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: deploy_cws_instrumentation tags: - arch:amd64 variables: IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd VERSION: rc ```
deploy_containers-cws-instrumentation-rc-versioned ```diff deploy_containers-cws-instrumentation-rc-versioned: before_script: - source /root/.bashrc - if [[ "$VERSION" == "" ]]; then export VERSION="$(inv agent.version --major-version 7 --url-safe)"; fi - if [[ "$CWS_INSTRUMENTATION_REPOSITORY" == "" ]]; then export CWS_INSTRUMENTATION_REPOSITORY="cws-instrumentation"; fi - export IMG_BASE_SRC="${SRC_CWS_INSTRUMENTATION}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}" - export IMG_SOURCES="${IMG_BASE_SRC}-amd64,${IMG_BASE_SRC}-arm64" - export IMG_DESTINATIONS="${CWS_INSTRUMENTATION_REPOSITORY}:${VERSION}" dependencies: [] image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES rules: - if: $DEPLOY_AGENT != "true" && $DDR_WORKFLOW_ID == null when: never - if: ($DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null) && $BUCKET_BRANCH == "beta" && $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ variables: AGENT_REPOSITORY: agent DSD_REPOSITORY: dogstatsd IMG_REGISTRIES: public when: on_success script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: deploy_cws_instrumentation tags: - arch:amd64 variables: IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
deploy_containers-dca ```diff deploy_containers-dca: before_script: - source /root/.bashrc - if [[ "$VERSION" == "" ]]; then export VERSION="$(inv agent.version --major-version 7 --url-safe)"; fi - if [[ "$CLUSTER_AGENT_REPOSITORY" == "" ]]; then export CLUSTER_AGENT_REPOSITORY="cluster-agent"; fi - export IMG_BASE_SRC="${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}" - export IMG_SOURCES="${IMG_BASE_SRC}-amd64,${IMG_BASE_SRC}-arm64" - export IMG_DESTINATIONS="${CLUSTER_AGENT_REPOSITORY}:${VERSION}" image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - artifacts: false job: docker_build_cluster_agent_amd64 - artifacts: false job: docker_build_cluster_agent_arm64 rules: - if: $DEPLOY_AGENT != "true" && $DDR_WORKFLOW_ID == null when: never - allow_failure: true if: $BUCKET_BRANCH != "beta" && $BUCKET_BRANCH != "stable" variables: AGENT_REPOSITORY: agent-dev DSD_REPOSITORY: dogstatsd-dev IMG_REGISTRIES: dev when: manual - if: ($DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null) && $BUCKET_BRANCH == "beta" && $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ variables: AGENT_REPOSITORY: agent DSD_REPOSITORY: dogstatsd IMG_REGISTRIES: public when: on_success - allow_failure: true variables: AGENT_REPOSITORY: agent DSD_REPOSITORY: dogstatsd IMG_REGISTRIES: public when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: deploy_dca tags: - arch:amd64 variables: IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
deploy_containers-dca-latest ```diff deploy_containers-dca-latest: before_script: - source /root/.bashrc - if [[ "$VERSION" == "" ]]; then export VERSION="$(inv agent.version --major-version 7 --url-safe)"; fi - if [[ "$CLUSTER_AGENT_REPOSITORY" == "" ]]; then export CLUSTER_AGENT_REPOSITORY="cluster-agent"; fi - export IMG_BASE_SRC="${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}" - export IMG_SOURCES="${IMG_BASE_SRC}-amd64,${IMG_BASE_SRC}-arm64" - export IMG_DESTINATIONS="${CLUSTER_AGENT_REPOSITORY}:${VERSION}" image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - artifacts: false job: docker_build_cluster_agent_amd64 - artifacts: false job: docker_build_cluster_agent_arm64 rules: - if: $DEPLOY_AGENT != "true" && $DDR_WORKFLOW_ID == null when: never - if: ($DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null) && $BUCKET_BRANCH == "beta" when: never - allow_failure: true if: $BUCKET_BRANCH != "beta" && $BUCKET_BRANCH != "stable" variables: AGENT_REPOSITORY: agent-dev DSD_REPOSITORY: dogstatsd-dev IMG_REGISTRIES: dev when: manual - allow_failure: true variables: AGENT_REPOSITORY: agent DSD_REPOSITORY: dogstatsd IMG_REGISTRIES: public when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: deploy_dca tags: - arch:amd64 variables: IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd VERSION: latest ```
deploy_containers-dca-rc ```diff deploy_containers-dca-rc: before_script: - source /root/.bashrc - if [[ "$VERSION" == "" ]]; then export VERSION="$(inv agent.version --major-version 7 --url-safe)"; fi - if [[ "$CLUSTER_AGENT_REPOSITORY" == "" ]]; then export CLUSTER_AGENT_REPOSITORY="cluster-agent"; fi - export IMG_BASE_SRC="${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}" - export IMG_SOURCES="${IMG_BASE_SRC}-amd64,${IMG_BASE_SRC}-arm64" - export IMG_DESTINATIONS="${CLUSTER_AGENT_REPOSITORY}:${VERSION}" image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - artifacts: false job: docker_build_cluster_agent_amd64 - artifacts: false job: docker_build_cluster_agent_arm64 rules: - if: $DEPLOY_AGENT != "true" && $DDR_WORKFLOW_ID == null when: never - if: ($DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null) && $BUCKET_BRANCH == "beta" && $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ variables: AGENT_REPOSITORY: agent DSD_REPOSITORY: dogstatsd IMG_REGISTRIES: public when: on_success script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: deploy_dca tags: - arch:amd64 variables: IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd VERSION: rc ```
deploy_containers-dca_internal ```diff deploy_containers-dca_internal: before_script: - source /root/.bashrc - if [[ "$VERSION" == "" ]]; then export VERSION="$(inv agent.version --major-version 7 --url-safe)"; fi - if [[ "$CLUSTER_AGENT_REPOSITORY" == "" ]]; then export CLUSTER_AGENT_REPOSITORY="cluster-agent"; fi - export IMG_BASE_SRC="${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}" - export IMG_SOURCES="${IMG_BASE_SRC}-amd64,${IMG_BASE_SRC}-arm64" - export IMG_DESTINATIONS="${CLUSTER_AGENT_REPOSITORY}:${VERSION}" image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - artifacts: false job: docker_build_cluster_agent_amd64 - artifacts: false job: docker_build_cluster_agent_arm64 rules: - if: $DEPLOY_AGENT != "true" && $DDR_WORKFLOW_ID == null when: never - if: ($DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null) && $BUCKET_BRANCH == "beta" when: never - if: $BUCKET_BRANCH != "beta" && $BUCKET_BRANCH != "stable" when: never - allow_failure: true variables: AGENT_REPOSITORY: ci/datadog-agent/agent-release CLUSTER_AGENT_REPOSITORY: ci/datadog-agent/cluster-agent-release DSD_REPOSITORY: ci/datadog-agent/dogstatsd-release IMG_REGISTRIES: internal-aws-ddbuild when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: deploy_dca tags: - arch:amd64 variables: IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
deploy_containers-dca_internal-latest ```diff deploy_containers-dca_internal-latest: before_script: - source /root/.bashrc - if [[ "$VERSION" == "" ]]; then export VERSION="$(inv agent.version --major-version 7 --url-safe)"; fi - if [[ "$CLUSTER_AGENT_REPOSITORY" == "" ]]; then export CLUSTER_AGENT_REPOSITORY="cluster-agent"; fi - export IMG_BASE_SRC="${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}" - export IMG_SOURCES="${IMG_BASE_SRC}-amd64,${IMG_BASE_SRC}-arm64" - export IMG_DESTINATIONS="${CLUSTER_AGENT_REPOSITORY}:${VERSION}" image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - artifacts: false job: docker_build_cluster_agent_amd64 - artifacts: false job: docker_build_cluster_agent_arm64 rules: - if: $DEPLOY_AGENT != "true" && $DDR_WORKFLOW_ID == null when: never - if: ($DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null) && $BUCKET_BRANCH == "beta" when: never - if: $BUCKET_BRANCH != "beta" && $BUCKET_BRANCH != "stable" when: never - allow_failure: true variables: AGENT_REPOSITORY: ci/datadog-agent/agent-release CLUSTER_AGENT_REPOSITORY: ci/datadog-agent/cluster-agent-release DSD_REPOSITORY: ci/datadog-agent/dogstatsd-release IMG_REGISTRIES: internal-aws-ddbuild when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: deploy_dca tags: - arch:amd64 variables: IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd VERSION: latest ```
deploy_containers-dca_internal-rc ```diff deploy_containers-dca_internal-rc: before_script: - source /root/.bashrc - if [[ "$VERSION" == "" ]]; then export VERSION="$(inv agent.version --major-version 7 --url-safe)"; fi - if [[ "$CLUSTER_AGENT_REPOSITORY" == "" ]]; then export CLUSTER_AGENT_REPOSITORY="cluster-agent"; fi - export IMG_BASE_SRC="${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}" - export IMG_SOURCES="${IMG_BASE_SRC}-amd64,${IMG_BASE_SRC}-arm64" - export IMG_DESTINATIONS="${CLUSTER_AGENT_REPOSITORY}:${VERSION}" image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - artifacts: false job: docker_build_cluster_agent_amd64 - artifacts: false job: docker_build_cluster_agent_arm64 rules: - if: $DEPLOY_AGENT != "true" && $DDR_WORKFLOW_ID == null when: never - if: ($DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null) && $BUCKET_BRANCH == "beta" && $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ variables: AGENT_REPOSITORY: ci/datadog-agent/agent-release CLUSTER_AGENT_REPOSITORY: ci/datadog-agent/cluster-agent-release DSD_REPOSITORY: ci/datadog-agent/dogstatsd-release IMG_REGISTRIES: internal-aws-ddbuild when: on_success script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: deploy_dca tags: - arch:amd64 variables: IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd VERSION: rc ```
dev_branch-a6 ```diff dev_branch-a6: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent6 - docker_build_agent6_jmx - docker_build_agent6_py2py3_jmx parallel: matrix: - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG},agent-dev:${CI_COMMIT_REF_SLUG}-py2 IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-amd64 - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG}-jmx,agent-dev:${CI_COMMIT_REF_SLUG}-py2-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-jmx-amd64 - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG}-py2py3-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-py2py3-jmx-amd64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_branch-a6-windows ```diff dev_branch-a6-windows: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent6_windows1809_core - docker_build_agent6_windows2022_core parallel: matrix: - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG}-py2-win-servercore IMG_SOURCES: '%BASE%-win1809-servercore-amd64,%BASE%-winltsc2022-servercore-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_branch-a7-windows ```diff dev_branch-a7-windows: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent7_windows1809 - docker_build_agent7_windows1809_jmx - docker_build_agent7_windows1809_core - docker_build_agent7_windows1809_core_jmx - docker_build_agent7_windows2022 - docker_build_agent7_windows2022_jmx - docker_build_agent7_windows2022_core - docker_build_agent7_windows2022_core_jmx parallel: matrix: - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG}-py3-win IMG_SOURCES: '%BASE%-win1809-amd64,%BASE%-winltsc2022-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7 - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG}-py3-jmx-win IMG_SOURCES: '%BASE%-win1809-amd64,%BASE%-winltsc2022-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG}-py3-win-servercore IMG_SOURCES: '%BASE%-win1809-servercore-amd64,%BASE%-winltsc2022-servercore-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7 - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG}-py3-jmx-win-servercore IMG_SOURCES: '%BASE%-win1809-servercore-amd64,%BASE%-winltsc2022-servercore-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_branch-dogstatsd ```diff dev_branch-dogstatsd: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_dogstatsd_amd64 - docker_build_dogstatsd_arm64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: dogstatsd-dev:${CI_COMMIT_REF_SLUG} IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_SOURCES: ${SRC_DSD}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64,${SRC_DSD}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-arm64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_branch_multiarch-a6 ```diff dev_branch_multiarch-a6: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent6 - docker_build_agent6_arm64 - docker_build_agent6_jmx - docker_build_agent6_jmx_arm64 - docker_build_agent6_py2py3_jmx parallel: matrix: - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG},agent-dev:${CI_COMMIT_REF_SLUG}-py2 IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-arm64 - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG}-jmx,agent-dev:${CI_COMMIT_REF_SLUG}-py2-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-jmx-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-jmx-arm64 - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG}-py2py3-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-py2py3-jmx-amd64 rules: - allow_failure: true if: $CI_COMMIT_BRANCH == "main" || $DEPLOY_AGENT == "true" || $RUN_ALL_BUILDS == "true" || $DDR_WORKFLOW_ID != null when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_branch_multiarch-a7 ```diff dev_branch_multiarch-a7: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent7 - docker_build_agent7_arm64 - docker_build_agent7_jmx - docker_build_agent7_jmx_arm64 parallel: matrix: - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG}-py3 IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-arm64 - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG}-py3-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx-arm64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_branch_multiarch-dogstatsd ```diff dev_branch_multiarch-dogstatsd: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_dogstatsd_amd64 - docker_build_dogstatsd_arm64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: dogstatsd-dev:${CI_COMMIT_REF_SLUG} IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_SOURCES: ${SRC_DSD}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64,${SRC_DSD}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-arm64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_master-a6 ```diff dev_master-a6: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent6 - docker_build_agent6_arm64 - docker_build_agent6_jmx - docker_build_agent6_jmx_arm64 - docker_build_agent6_py2py3_jmx parallel: matrix: - IMG_DESTINATIONS: agent-dev:master,agent-dev:master-py2 IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-arm64 - IMG_DESTINATIONS: agent-dev:master-jmx,agent-dev:master-py2-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-jmx-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-jmx-arm64 rules: - if: $CI_COMMIT_BRANCH == "main" script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_master-a6-windows ```diff dev_master-a6-windows: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent6_windows1809_core - docker_build_agent6_windows2022_core parallel: matrix: - IMG_DESTINATIONS: agent-dev:master-py2-win-servercore IMG_SOURCES: '%BASE%-win1809-servercore-amd64,%BASE%-winltsc2022-servercore-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6 rules: - if: $CI_COMMIT_BRANCH == "main" script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_master-a7 ```diff dev_master-a7: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent7 - docker_build_agent7_arm64 - docker_build_agent7_jmx - docker_build_agent7_jmx_arm64 parallel: matrix: - IMG_DESTINATIONS: agent-dev:master-py3 IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-arm64 - IMG_DESTINATIONS: agent-dev:master-py3-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx-arm64 rules: - if: $CI_COMMIT_BRANCH == "main" script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_master-a7-windows ```diff dev_master-a7-windows: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent7_windows1809 - docker_build_agent7_windows1809_jmx - docker_build_agent7_windows1809_core - docker_build_agent7_windows1809_core_jmx - docker_build_agent7_windows2022 - docker_build_agent7_windows2022_jmx - docker_build_agent7_windows2022_core - docker_build_agent7_windows2022_core_jmx parallel: matrix: - IMG_DESTINATIONS: agent-dev:master-py3-win IMG_SOURCES: '%BASE%-win1809-amd64,%BASE%-winltsc2022-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7 - IMG_DESTINATIONS: agent-dev:master-py3-jmx-win IMG_SOURCES: '%BASE%-win1809-amd64,%BASE%-winltsc2022-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx - IMG_DESTINATIONS: agent-dev:master-py3-win-servercore IMG_SOURCES: '%BASE%-win1809-servercore-amd64,%BASE%-winltsc2022-servercore-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7 - IMG_DESTINATIONS: agent-dev:master-py3-jmx-win-servercore IMG_SOURCES: '%BASE%-win1809-servercore-amd64,%BASE%-winltsc2022-servercore-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx rules: - if: $CI_COMMIT_BRANCH == "main" script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_master-dogstatsd ```diff dev_master-dogstatsd: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_dogstatsd_amd64 - docker_build_dogstatsd_arm64 rules: - if: $CI_COMMIT_BRANCH == "main" script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: dogstatsd-dev:master IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_SOURCES: ${SRC_DSD}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64,${SRC_DSD}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-arm64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_nightly-a6-windows ```diff dev_nightly-a6-windows: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent6_windows1809_core - docker_build_agent6_windows2022_core parallel: matrix: - IMG_DESTINATIONS: agent-dev:nightly-${CI_COMMIT_SHORT_SHA}-py2-win-servercore IMG_SOURCES: '%BASE%-win1809-servercore-amd64,%BASE%-winltsc2022-servercore-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6 rules: - if: $BUCKET_BRANCH != "nightly" && $BUCKET_BRANCH != "oldnightly" && $BUCKET_BRANCH != "dev" when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_nightly-a7 ```diff dev_nightly-a7: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent7 - docker_build_agent7_arm64 - docker_build_agent7_jmx - docker_build_agent7_jmx_arm64 parallel: matrix: - IMG_DESTINATIONS: agent-dev:nightly-${CI_COMMIT_REF_SLUG}-${CI_COMMIT_SHORT_SHA}-py3,agent-dev:nightly-${CI_COMMIT_REF_SLUG}-py3 IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-arm64 - IMG_DESTINATIONS: agent-dev:nightly-${CI_COMMIT_REF_SLUG}-${CI_COMMIT_SHORT_SHA}-py3-jmx,agent-dev:nightly-${CI_COMMIT_REF_SLUG}-py3-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx-arm64 rules: - if: $BUCKET_BRANCH != "nightly" && $BUCKET_BRANCH != "oldnightly" && $BUCKET_BRANCH != "dev" when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_nightly-a7-windows ```diff dev_nightly-a7-windows: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent7_windows1809 - docker_build_agent7_windows1809_jmx - docker_build_agent7_windows1809_core - docker_build_agent7_windows1809_core_jmx - docker_build_agent7_windows2022 - docker_build_agent7_windows2022_jmx - docker_build_agent7_windows2022_core - docker_build_agent7_windows2022_core_jmx parallel: matrix: - IMG_DESTINATIONS: agent-dev:nightly-${CI_COMMIT_SHORT_SHA}-py3-win IMG_SOURCES: '%BASE%-win1809-amd64,%BASE%-winltsc2022-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7 - IMG_DESTINATIONS: agent-dev:nightly-${CI_COMMIT_SHORT_SHA}-py3-jmx-win IMG_SOURCES: '%BASE%-win1809-amd64,%BASE%-winltsc2022-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx - IMG_DESTINATIONS: agent-dev:nightly-${CI_COMMIT_SHORT_SHA}-py3-win-servercore IMG_SOURCES: '%BASE%-win1809-servercore-amd64,%BASE%-winltsc2022-servercore-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7 - IMG_DESTINATIONS: agent-dev:nightly-${CI_COMMIT_SHORT_SHA}-py3-jmx-win-servercore IMG_SOURCES: '%BASE%-win1809-servercore-amd64,%BASE%-winltsc2022-servercore-amd64' IMG_VARIABLES: BASE=${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx rules: - if: $BUCKET_BRANCH != "nightly" && $BUCKET_BRANCH != "oldnightly" && $BUCKET_BRANCH != "dev" when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_nightly-dogstatsd ```diff dev_nightly-dogstatsd: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_dogstatsd_amd64 - docker_build_dogstatsd_arm64 rules: - if: $BUCKET_BRANCH != "nightly" && $BUCKET_BRANCH != "oldnightly" && $BUCKET_BRANCH != "dev" when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: dogstatsd-dev:nightly-${CI_COMMIT_REF_SLUG}-${CI_COMMIT_SHORT_SHA},dogstatsd-dev:nightly-${CI_COMMIT_REF_SLUG} IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_SOURCES: ${SRC_DSD}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64,${SRC_DSD}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-arm64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_nightly_docker_hub-a6 ```diff dev_nightly_docker_hub-a6: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent6 - docker_build_agent6_arm64 - docker_build_agent6_jmx - docker_build_agent6_jmx_arm64 - docker_build_agent6_py2py3_jmx parallel: matrix: - IMG_DESTINATIONS: agent-dev:nightly-${CI_COMMIT_REF_SLUG}-${CI_COMMIT_SHORT_SHA},agent-dev:nightly-${CI_COMMIT_REF_SLUG}-${CI_COMMIT_SHORT_SHA}-py2,agent-dev:nightly-${CI_COMMIT_REF_SLUG}-py2 IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-arm64 - IMG_DESTINATIONS: agent-dev:nightly-${CI_COMMIT_REF_SLUG}-${CI_COMMIT_SHORT_SHA}-jmx,agent-dev:nightly-${CI_COMMIT_REF_SLUG}-${CI_COMMIT_SHORT_SHA}-py2-jmx,agent-dev:nightly-${CI_COMMIT_REF_SLUG}-py2-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-jmx-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-jmx-arm64 rules: - if: $BUCKET_BRANCH != "nightly" && $BUCKET_BRANCH != "oldnightly" && $BUCKET_BRANCH != "dev" when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
docker_trigger_cluster_agent_internal ```diff docker_trigger_cluster_agent_internal: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - artifacts: false job: docker_build_cluster_agent_amd64 - artifacts: false job: docker_build_cluster_agent_arm64 rules: - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - if [ "$BUCKET_BRANCH" = "beta" ] || [ "$BUCKET_BRANCH" = "stable" ]; then TMPL_SRC_REPO="${TMPL_SRC_REPO}-release"; fi - "if [ \"$BUCKET_BRANCH\" = \"nightly\" ]; then\n RELEASE_TAG=\"${RELEASE_TAG}-${CI_COMMIT_SHORT_SHA}\"\ \n TMPL_SRC_REPO=\"${TMPL_SRC_REPO}-nightly\"\nfi\n" - if [ "$BUCKET_BRANCH" = "dev" ]; then RELEASE_TAG="dev-${RELEASE_TAG}-${CI_COMMIT_SHORT_SHA}"; fi - inv pipeline.trigger-child-pipeline --project-name DataDog/images --git-ref master - --timeout 3600 --variable IMAGE_VERSION --variable IMAGE_NAME --variable RELEASE_TAG ? --------------- + --variable IMAGE_VERSION --variable IMAGE_NAME --variable RELEASE_TAG --variable ? +++++++++++ - --variable BUILD_TAG --variable TMPL_SRC_IMAGE --variable TMPL_SRC_REPO --variable ? ----------- + BUILD_TAG --variable TMPL_SRC_IMAGE --variable TMPL_SRC_REPO --variable RELEASE_STAGING ? ++++++++++++++++ - RELEASE_STAGING --variable RELEASE_PROD --variable DYNAMIC_BUILD_RENDER_RULES ? ---------------- + --variable RELEASE_PROD --variable DYNAMIC_BUILD_RENDER_RULES --variable APPS ? ++++++++++++++++ - --variable APPS --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID ? ---------------- + --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ++++++++++++++++++++++ - --variable TARGET_ENV --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ---------------------- + --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: internal_image_deploy tags: - arch:amd64 variables: BUILD_TAG: ${CI_COMMIT_REF_SLUG} DYNAMIC_BUILD_RENDER_RULES: agent-build-only IMAGE_NAME: datadog-cluster-agent IMAGE_VERSION: tmpl-v4 RELEASE_PROD: 'true' RELEASE_STAGING: 'true' RELEASE_TAG: ${CI_COMMIT_REF_SLUG} TMPL_SRC_IMAGE: v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA} TMPL_SRC_REPO: ci/datadog-agent/cluster-agent ```
docker_trigger_cws_instrumentation_internal ```diff docker_trigger_cws_instrumentation_internal: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - artifacts: false job: docker_build_cws_instrumentation_amd64 - artifacts: false job: docker_build_cws_instrumentation_arm64 rules: - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - if [ "$BUCKET_BRANCH" = "beta" ] || [ "$BUCKET_BRANCH" = "stable" ]; then TMPL_SRC_REPO="${TMPL_SRC_REPO}-release"; fi - "if [ \"$BUCKET_BRANCH\" = \"nightly\" ]; then\n RELEASE_TAG=\"${RELEASE_TAG}-${CI_COMMIT_SHORT_SHA}\"\ \n TMPL_SRC_REPO=\"${TMPL_SRC_REPO}-nightly\"\nfi\n" - if [ "$BUCKET_BRANCH" = "dev" ]; then RELEASE_TAG="dev-${RELEASE_TAG}-${CI_COMMIT_SHORT_SHA}"; fi - inv pipeline.trigger-child-pipeline --project-name DataDog/images --git-ref master - --timeout 3600 --variable IMAGE_VERSION --variable IMAGE_NAME --variable RELEASE_TAG ? --------------- + --variable IMAGE_VERSION --variable IMAGE_NAME --variable RELEASE_TAG --variable ? +++++++++++ - --variable BUILD_TAG --variable TMPL_SRC_IMAGE --variable TMPL_SRC_REPO --variable ? ----------- + BUILD_TAG --variable TMPL_SRC_IMAGE --variable TMPL_SRC_REPO --variable RELEASE_STAGING ? ++++++++++++++++ - RELEASE_STAGING --variable RELEASE_PROD --variable DYNAMIC_BUILD_RENDER_RULES ? ---------------- + --variable RELEASE_PROD --variable DYNAMIC_BUILD_RENDER_RULES --variable APPS ? ++++++++++++++++ - --variable APPS --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID ? ---------------- + --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ++++++++++++++++++++++ - --variable TARGET_ENV --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ---------------------- + --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: internal_image_deploy tags: - arch:amd64 variables: BUILD_TAG: ${CI_COMMIT_REF_SLUG} DYNAMIC_BUILD_RENDER_RULES: agent-build-only IMAGE_NAME: datadog-cws-instrumentation IMAGE_VERSION: tmpl-v1 RELEASE_PROD: 'true' RELEASE_STAGING: 'true' RELEASE_TAG: ${CI_COMMIT_REF_SLUG} TMPL_SRC_IMAGE: v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA} TMPL_SRC_REPO: ci/datadog-agent/cws-instrumentation ```
docker_trigger_internal ```diff docker_trigger_internal: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - artifacts: false job: docker_build_agent7_jmx - artifacts: false job: docker_build_agent7_jmx_arm64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null variables: RELEASE_PROD: 'true' - allow_failure: true variables: RELEASE_PROD: 'false' when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - if [ "$BUCKET_BRANCH" = "beta" ] || [ "$BUCKET_BRANCH" = "stable" ]; then TMPL_SRC_REPO="${TMPL_SRC_REPO}-release"; fi - "if [ \"$BUCKET_BRANCH\" = \"nightly\" ]; then\n RELEASE_TAG=\"${RELEASE_TAG}-${CI_COMMIT_SHORT_SHA}\"\ \n TMPL_SRC_REPO=\"${TMPL_SRC_REPO}-nightly\"\nfi\n" - if [ "$BUCKET_BRANCH" = "dev" ]; then RELEASE_TAG="dev-${RELEASE_TAG}-${CI_COMMIT_SHORT_SHA}"; fi - inv pipeline.trigger-child-pipeline --project-name DataDog/images --git-ref master - --timeout 3600 --variable IMAGE_VERSION --variable IMAGE_NAME --variable RELEASE_TAG ? --------------- + --variable IMAGE_VERSION --variable IMAGE_NAME --variable RELEASE_TAG --variable ? +++++++++++ - --variable BUILD_TAG --variable TMPL_SRC_IMAGE --variable TMPL_SRC_REPO --variable ? ----------- + BUILD_TAG --variable TMPL_SRC_IMAGE --variable TMPL_SRC_REPO --variable RELEASE_STAGING ? ++++++++++++++++ - RELEASE_STAGING --variable RELEASE_PROD --variable DYNAMIC_BUILD_RENDER_RULES ? ---------------- + --variable RELEASE_PROD --variable DYNAMIC_BUILD_RENDER_RULES --variable APPS ? ++++++++++++++++ - --variable APPS --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID ? ---------------- + --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ++++++++++++++++++++++ - --variable TARGET_ENV --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ---------------------- + --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: internal_image_deploy tags: - arch:amd64 variables: BUILD_TAG: ${CI_COMMIT_REF_SLUG}-jmx DYNAMIC_BUILD_RENDER_RULES: agent-build-only IMAGE_NAME: datadog-agent IMAGE_VERSION: tmpl-v9 RELEASE_STAGING: 'true' RELEASE_TAG: ${CI_COMMIT_REF_SLUG}-jmx TMPL_SRC_IMAGE: v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx TMPL_SRC_REPO: ci/datadog-agent/agent ```
kitchen_test_security_agent_arm64 ```diff kitchen_test_security_agent_arm64: after_script: - $CI_PROJECT_DIR/tools/ci/junit_upload.sh "$DD_AGENT_TESTING_DIR/junit-*.tar.gz" artifacts: expire_in: 2 weeks paths: - $DD_AGENT_TESTING_DIR/junit-*.tar.gz when: always before_script: - pushd $DD_AGENT_TESTING_DIR - tasks/kitchen_setup.sh image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/dd-agent-testing$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - tests_ebpf_arm64 - prepare_secagent_ebpf_functional_tests_arm64 parallel: matrix: - KITCHEN_CWS_PLATFORM: - docker - ad - ebpfless + - ebpfless-no-seccomp KITCHEN_OSVERS: ubuntu-20-04-2,ubuntu-22-04 KITCHEN_PLATFORM: ubuntu retry: 1 rules: - allow_failure: true if: $CI_COMMIT_BRANCH == "main" - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RUN_KMT_TESTS == 'on' - changes: compare_to: main paths: - pkg/ebpf/**/* - pkg/security/**/* - pkg/eventmonitor/**/* - test/kitchen/site-cookbooks/dd-security-agent-check/**/* - test/kitchen/test/integration/security-agent-test/**/* - test/kitchen/test/integration/security-agent-stress/**/* - .gitlab/functional_test/security_agent.yml - .gitlab/kernel_matrix_testing/security_agent.yml - .gitlab/kernel_matrix_testing/common.yml - test/new-e2e/system-probe/**/* - test/new-e2e/scenarios/system-probe/**/* - test/new-e2e/runner/**/* - test/new-e2e-utils/**/* - test/new-e2e/go.mod - tasks/security_agent.py - tasks/kmt.py - tasks/kernel_matrix_testing/* - allow_failure: true when: manual script: - echo "CI_JOB_URL=${CI_JOB_URL}" >> $DD_AGENT_TESTING_DIR/site-cookbooks/dd-security-agent-check/files/job_env.txt - echo "CI_JOB_ID=${CI_JOB_ID}" >> $DD_AGENT_TESTING_DIR/site-cookbooks/dd-security-agent-check/files/job_env.txt - echo "CI_JOB_NAME=${CI_JOB_NAME}" >> $DD_AGENT_TESTING_DIR/site-cookbooks/dd-security-agent-check/files/job_env.txt - echo "CI_JOB_STAGE=${CI_JOB_STAGE}" >> $DD_AGENT_TESTING_DIR/site-cookbooks/dd-security-agent-check/files/job_env.txt - tasks/run-test-kitchen.sh security-agent-test $AGENT_MAJOR_VERSION - popd - inv system-probe.print-failed-tests --output-dir $DD_AGENT_TESTING_DIR/testjson stage: functional_test tags: - arch:amd64 variables: AGENT_FLAVOR: datadog-agent AGENT_MAJOR_VERSION: 7 CHEF_VERSION: 14.15.6 DD_PIPELINE_ID: $CI_PIPELINE_ID-fnct KITCHEN_ARCH: arm64 KITCHEN_CI_MOUNT_PATH: /mnt/ci KITCHEN_CI_ROOT_PATH: /tmp/ci KITCHEN_EC2_IAM_PROFILE_NAME: ci-datadog-agent-e2e-runner KITCHEN_EC2_INSTANCE_TYPE: t4g.xlarge KITCHEN_EC2_REGION: us-east-1 KITCHEN_EC2_SG_IDS: sg-019917348cb0eb7e7 KITCHEN_EC2_SUBNET: subnet-05d7c6b1b5cfea811 KITCHEN_PROVIDER: ec2 KUBERNETES_MEMORY_LIMIT: 12Gi KUBERNETES_MEMORY_REQUEST: 6Gi ```
kitchen_test_security_agent_x64 ```diff kitchen_test_security_agent_x64: after_script: - $CI_PROJECT_DIR/tools/ci/junit_upload.sh "$DD_AGENT_TESTING_DIR/junit-*.tar.gz" artifacts: expire_in: 2 weeks paths: - $DD_AGENT_TESTING_DIR/junit-*.tar.gz when: always before_script: - pushd $DD_AGENT_TESTING_DIR - tasks/kitchen_setup.sh image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/dd-agent-testing$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - tests_ebpf_x64 - prepare_secagent_ebpf_functional_tests_x64 parallel: matrix: - KITCHEN_CWS_PLATFORM: - docker KITCHEN_OSVERS: centos-77 KITCHEN_PLATFORM: centos - KITCHEN_CWS_PLATFORM: - docker KITCHEN_OSVERS: ubuntu-18-04-0,ubuntu-18-04,ubuntu-18-04-3 KITCHEN_PLATFORM: ubuntu - KITCHEN_CWS_PLATFORM: - docker KITCHEN_OSVERS: ubuntu-20-04,ubuntu-20-04-2,ubuntu-22-04 KITCHEN_PLATFORM: ubuntu - KITCHEN_CWS_PLATFORM: - ad - ebpfless + - ebpfless-no-seccomp KITCHEN_OSVERS: ubuntu-22-04 KITCHEN_PLATFORM: ubuntu - KITCHEN_CWS_PLATFORM: - docker KITCHEN_OSVERS: debian-10,debian-11 KITCHEN_PLATFORM: debian - KITCHEN_CWS_PLATFORM: - host - docker KITCHEN_OSVERS: oracle-7-9 KITCHEN_PLATFORM: oracle retry: 1 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - echo "CI_JOB_URL=${CI_JOB_URL}" >> $DD_AGENT_TESTING_DIR/site-cookbooks/dd-security-agent-check/files/job_env.txt - echo "CI_JOB_ID=${CI_JOB_ID}" >> $DD_AGENT_TESTING_DIR/site-cookbooks/dd-security-agent-check/files/job_env.txt - echo "CI_JOB_NAME=${CI_JOB_NAME}" >> $DD_AGENT_TESTING_DIR/site-cookbooks/dd-security-agent-check/files/job_env.txt - echo "CI_JOB_STAGE=${CI_JOB_STAGE}" >> $DD_AGENT_TESTING_DIR/site-cookbooks/dd-security-agent-check/files/job_env.txt - tasks/run-test-kitchen.sh security-agent-test $AGENT_MAJOR_VERSION - popd - inv system-probe.print-failed-tests --output-dir $DD_AGENT_TESTING_DIR/testjson stage: functional_test tags: - arch:amd64 variables: AGENT_FLAVOR: datadog-agent AGENT_MAJOR_VERSION: 7 AZURE_LOCATION: North Central US CHEF_VERSION: 14.15.6 DD_PIPELINE_ID: $CI_PIPELINE_ID-fnct KITCHEN_ARCH: x86_64 KITCHEN_PROVIDER: azure KUBERNETES_MEMORY_LIMIT: 12Gi KUBERNETES_MEMORY_REQUEST: 6Gi ```
new-e2e-containers ```diff new-e2e-containers: after_script: - $CI_PROJECT_DIR/tools/ci/junit_upload.sh artifacts: expire_in: 2 weeks paths: - $E2E_OUTPUT_DIR - junit-*.tgz reports: annotations: - $EXTERNAL_LINKS_PATH when: always before_script: - mkdir -p ~/.aws - $CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $AGENT_QA_PROFILE_SSM_NAME >> ~/.aws/config - export AWS_PROFILE=agent-qa-ci - $CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $SSH_PUBLIC_KEY_RSA_SSM_NAME > $E2E_PUBLIC_KEY_PATH - touch $E2E_PRIVATE_KEY_PATH && chmod 600 $E2E_PRIVATE_KEY_PATH && $CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $SSH_KEY_RSA_SSM_NAME > $E2E_PRIVATE_KEY_PATH - pulumi login "s3://dd-pulumi-state?region=us-east-1&awssdk=v2&profile=$AWS_PROFILE" - inv -e gitlab.generate-ci-visibility-links --output=$EXTERNAL_LINKS_PATH image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/test-infra-definitions/runner$TEST_INFRA_DEFINITIONS_BUILDIMAGES_SUFFIX:$TEST_INFRA_DEFINITIONS_BUILDIMAGES needs: - qa_agent - qa_dca - qa_dogstatsd parallel: matrix: + - EXTRA_PARAMS: --run TestKindSuite -c ddinfra:kubernetesVersion=1.19 + - EXTRA_PARAMS: --run TestKindSuite -c ddinfra:kubernetesVersion=1.22 - EXTRA_PARAMS: --run TestKindSuite -c ddinfra:kubernetesVersion=1.27 - EXTRA_PARAMS: --run TestKindSuite -c ddinfra:kubernetesVersion=1.29 - EXTRA_PARAMS: --run TestKindSuite -c ddinfra:osDescriptor=ubuntu:20.04 - EXTRA_PARAMS: --run TestKindSuite -c ddinfra:osDescriptor=ubuntu:22.04 - EXTRA_PARAMS: --run TestEKSSuite - EXTRA_PARAMS: --run TestECSSuite - EXTRA_PARAMS: --run TestDockerSuite - EXTRA_PARAMS: --skip "Test(Kind|EKS|ECS|Docker)Suite" rules: - if: $RUN_E2E_TESTS == "off" when: never - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RUN_E2E_TESTS == "on" when: on_success - if: $CI_COMMIT_BRANCH == "main" when: on_success - if: $CI_COMMIT_BRANCH =~ /^[0-9]+\.[0-9]+\.x$/ when: on_success - if: $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ when: on_success - changes: compare_to: main paths: - test/new-e2e/pkg/**/* - test/new-e2e/go.mod - changes: compare_to: main paths: - comp/core/tagger/**/* - comp/core/workloadmeta/**/* - comp/core/autodiscovery/listeners/**/* - comp/core/autodiscovery/providers/**/* - comp/languagedetection/**/* - pkg/collector/corechecks/cluster/**/* - pkg/collector/corechecks/containers/**/* - pkg/collector/corechecks/containerimage/**/* - pkg/collector/corechecks/containerlifecycle/**/* - pkg/collector/corechecks/kubernetes/**/* - pkg/collector/corechecks/sbom/**/* - pkg/sbom/**/* - pkg/util/clusteragent/**/* - pkg/util/containerd/**/* - pkg/util/containers/**/* - pkg/util/docker/**/* - pkg/util/ecs/**/* - pkg/util/kubernetes/**/* - pkg/util/cgroups/**/* - pkg/util/trivy/**/* - test/new-e2e/tests/containers/**/* - test/new-e2e/go.mod when: on_success - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - inv -e new-e2e-tests.run --targets $TARGETS -c ddagent:imagePullRegistry=669783387624.dkr.ecr.us-east-1.amazonaws.com -c ddagent:imagePullUsername=AWS -c ddagent:imagePullPassword=$(aws ecr get-login-password) --junit-tar junit-${CI_JOB_ID}.tgz ${EXTRA_PARAMS} --test-washer stage: e2e tags: - arch:amd64 variables: E2E_COMMIT_SHA: $CI_COMMIT_SHORT_SHA E2E_KEY_PAIR_NAME: datadog-agent-ci-rsa E2E_OUTPUT_DIR: $CI_PROJECT_DIR/e2e-output E2E_PIPELINE_ID: $CI_PIPELINE_ID E2E_PRIVATE_KEY_PATH: /tmp/agent-qa-ssh-key E2E_PUBLIC_KEY_PATH: /tmp/agent-qa-ssh-key.pub EXTERNAL_LINKS_PATH: external_links_$CI_JOB_ID.json KUBERNETES_CPU_REQUEST: 6 KUBERNETES_MEMORY_LIMIT: 16Gi KUBERNETES_MEMORY_REQUEST: 12Gi SHOULD_RUN_IN_FLAKES_FINDER: 'true' TARGETS: ./tests/containers TEAM: container-integrations ```
notify_failure_summary_daily ```diff notify_failure_summary_daily: dependencies: [] image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES resource_group: notification rules: - if: $BUCKET_BRANCH != "nightly" && $BUCKET_BRANCH != "oldnightly" && $BUCKET_BRANCH != "dev" when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null when: always script: - source /root/.bashrc - export SLACK_API_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $SLACK_AGENT_CI_TOKEN_SSM_NAME) - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_READ_API_TOKEN_SSM_NAME) - export DD_API_KEY=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $API_KEY_ORG2_SSM_NAME) - python3 -m pip install -r requirements.txt -r tasks/libs/requirements-notifications.txt - weekday="$(date --utc '+%A')" - "if [ \"$weekday\" = \"Sunday\" ] || [ \"$weekday\" = \"Monday\" ]; then\n echo\ \ \"Skipping daily summary on $weekday\"\n exit\nfi\n" - - inv -e notify.failure-summary-send-notifications --daily-summary + - inv -e notify.failure-summary-send-notifications --is-daily-summary=true ? +++ +++++ - "if [ \"$weekday\" = \"Friday\" ]; then\n echo 'Sending weekly summary'\n inv\ - \ -e notify.failure-summary-send-notifications --weekly-summary\nfi\n" ? ^^^^ + \ -e notify.failure-summary-send-notifications --is-daily-summary=false\nfi\n" ? ^^^^^^ ++++++ stage: notify tags: - arch:amd64 timeout: 15 minutes ```
publish_fakeintake ```diff publish_fakeintake: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - job: docker_build_fakeintake optional: false rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - changes: compare_to: main paths: - test/fakeintake/**/* - .gitlab/binary_build/fakeintake.yml - .gitlab/container_build/fakeintake.yml - .gitlab/dev_container_deploy/fakeintake.yml script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: fakeintake:v${CI_COMMIT_SHORT_SHA} IMG_REGISTRIES: public IMG_SIGNING: 'false' IMG_SOURCES: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/fakeintake:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA} IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
publish_fakeintake_latest ```diff publish_fakeintake_latest: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - job: docker_build_fakeintake optional: false rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - changes: compare_to: main paths: - test/fakeintake/**/* - .gitlab/binary_build/fakeintake.yml - .gitlab/container_build/fakeintake.yml - .gitlab/dev_container_deploy/fakeintake.yml if: $CI_COMMIT_BRANCH == "main" script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: fakeintake:latest IMG_REGISTRIES: public IMG_SIGNING: 'false' IMG_SOURCES: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/fakeintake:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA} IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
qa_agent ```diff qa_agent: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent7 - docker_build_agent7_arm64 + - docker_build_ot_agent7 + - docker_build_ot_agent7_arm64 - docker_build_agent7_windows1809 - docker_build_agent7_windows2022 + parallel: + matrix: + - IMG_DESTINATIONS: agent:${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA} + IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-arm64 + - IMG_DESTINATIONS: agent:${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA} + IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-win1809-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-winltsc2022-amd64 + - IMG_DESTINATIONS: agent:${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-ot + IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-ot-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-ot-arm64 rules: - if: $RUN_E2E_TESTS == "off" when: never - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RUN_E2E_TESTS == "on" when: on_success - if: $CI_COMMIT_BRANCH == "main" when: on_success - if: $CI_COMMIT_BRANCH =~ /^[0-9]+\.[0-9]+\.x$/ when: on_success - if: $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ when: on_success - changes: compare_to: main paths: - test/new-e2e/pkg/**/* - test/new-e2e/go.mod - changes: compare_to: main paths: - test/new-e2e/tests/agent-metrics-logs/**/* - cmd/agent/subcommands/dogstatsd*/* - cmd/agent/subcommands/streamlogs/* - cmd/dogstatsd/**/* - comp/agent/jmxlogger/**/* - comp/aggregator/**/* - comp/collector/**/* - comp/core/agenttelemetry/**/* - comp/core/autodiscovery/providers/config_reader*.go - comp/core/autodiscovery/providers/file*.go - comp/forwarder/**/* - comp/logs/**/* - comp/serializer/compression/**/* - pkg/aggregator/**/* - pkg/collector/**/* - pkg/commonchecks/**/* - pkg/dogstatsd/**/* - pkg/jmxfetch/**/* - pkg/logs/**/* - pkg/metrics/**/* - pkg/persistentcache/**/* - pkg/serializer/**/* - rtloader/**/* - if: $RUN_E2E_TESTS == "off" when: never - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RUN_E2E_TESTS == "on" when: on_success - if: $CI_COMMIT_BRANCH == "main" when: on_success - if: $CI_COMMIT_BRANCH =~ /^[0-9]+\.[0-9]+\.x$/ when: on_success - if: $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ when: on_success - changes: compare_to: main paths: - test/new-e2e/pkg/**/* - test/new-e2e/go.mod - changes: compare_to: main paths: - pkg/trace/**/* - cmd/trace-agent/**/* - comp/trace/**/* - test/new-e2e/tests/apm/**/* - test/new-e2e/go.mod when: on_success - if: $RUN_E2E_TESTS == "off" when: never - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RUN_E2E_TESTS == "on" when: on_success - if: $CI_COMMIT_BRANCH == "main" when: on_success - if: $CI_COMMIT_BRANCH =~ /^[0-9]+\.[0-9]+\.x$/ when: on_success - if: $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ when: on_success - changes: compare_to: main paths: - test/new-e2e/pkg/**/* - test/new-e2e/go.mod - changes: compare_to: main paths: - comp/core/tagger/**/* - comp/core/workloadmeta/**/* - comp/core/autodiscovery/listeners/**/* - comp/core/autodiscovery/providers/**/* - comp/languagedetection/**/* - pkg/collector/corechecks/cluster/**/* - pkg/collector/corechecks/containers/**/* - pkg/collector/corechecks/containerimage/**/* - pkg/collector/corechecks/containerlifecycle/**/* - pkg/collector/corechecks/kubernetes/**/* - pkg/collector/corechecks/sbom/**/* - pkg/sbom/**/* - pkg/util/clusteragent/**/* - pkg/util/containerd/**/* - pkg/util/containers/**/* - pkg/util/docker/**/* - pkg/util/ecs/**/* - pkg/util/kubernetes/**/* - pkg/util/cgroups/**/* - pkg/util/trivy/**/* - test/new-e2e/tests/containers/**/* - test/new-e2e/go.mod when: on_success - if: $RUN_E2E_TESTS == "off" when: never - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RUN_E2E_TESTS == "on" when: on_success - if: $CI_COMMIT_BRANCH == "main" when: on_success - if: $CI_COMMIT_BRANCH =~ /^[0-9]+\.[0-9]+\.x$/ when: on_success - if: $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ when: on_success - changes: compare_to: main paths: - test/new-e2e/pkg/**/* - test/new-e2e/go.mod - changes: compare_to: main paths: - test/new-e2e/tests/npm/**/* - if: $RUN_E2E_TESTS == "off" when: never - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RUN_E2E_TESTS == "on" when: on_success - if: $CI_COMMIT_BRANCH == "main" when: on_success - if: $CI_COMMIT_BRANCH =~ /^[0-9]+\.[0-9]+\.x$/ when: on_success - if: $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ when: on_success - changes: compare_to: main paths: - test/new-e2e/pkg/**/* - test/new-e2e/go.mod - changes: compare_to: main paths: - test/new-e2e/tests/process/**/* - cmd/process-agent/**/* - comp/process/**/* - pkg/process/**/* - pkg/config/setup/process.go - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: - IMG_DESTINATIONS: agent:${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA} IMG_REGISTRIES: agent-qa IMG_SIGNING: '' - IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-arm64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-win1809-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-winltsc2022-amd64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
qa_agent_oci ```diff qa_agent_oci: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - deploy_agent_oci rules: - if: $RUN_E2E_TESTS == "off" when: never - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RUN_E2E_TESTS == "on" when: on_success - if: $CI_COMMIT_BRANCH == "main" when: on_success - if: $CI_COMMIT_BRANCH =~ /^[0-9]+\.[0-9]+\.x$/ when: on_success - if: $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ when: on_success - changes: compare_to: main paths: - test/new-e2e/pkg/**/* - test/new-e2e/go.mod - changes: compare_to: main paths: - .gitlab/**/* - omnibus/config/**/* - pkg/fleet/**/* - cmd/installer/**/* - test/new-e2e/tests/installer/**/* - tasks/installer.py when: on_success - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: deploy_packages tags: - arch:amd64 variables: IMG_DESTINATIONS: agent-package:pipeline-${CI_PIPELINE_ID} IMG_REGISTRIES: agent-qa IMG_SIGNING: '' IMG_SOURCES: registry.ddbuild.io/ci/remote-updates/datadog-agent:pipeline-${CI_PIPELINE_ID} IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
qa_cws_instrumentation ```diff qa_cws_instrumentation: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_cws_instrumentation_amd64 - docker_build_cws_instrumentation_arm64 rules: - if: $RUN_E2E_TESTS == "off" when: never - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RUN_E2E_TESTS == "on" when: on_success - if: $CI_COMMIT_BRANCH == "main" when: on_success - if: $CI_COMMIT_BRANCH =~ /^[0-9]+\.[0-9]+\.x$/ when: on_success - if: $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ when: on_success - changes: compare_to: main paths: - test/new-e2e/pkg/**/* - test/new-e2e/go.mod - changes: compare_to: main paths: - test/new-e2e/tests/cws/**/* - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: cws-instrumentation:${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA} IMG_REGISTRIES: agent-qa IMG_SIGNING: '' IMG_SOURCES: ${SRC_CWS_INSTRUMENTATION}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64,${SRC_CWS_INSTRUMENTATION}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-arm64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
qa_dca ```diff qa_dca: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_cluster_agent_amd64 - docker_build_cluster_agent_arm64 rules: - if: $RUN_E2E_TESTS == "off" when: never - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RUN_E2E_TESTS == "on" when: on_success - if: $CI_COMMIT_BRANCH == "main" when: on_success - if: $CI_COMMIT_BRANCH =~ /^[0-9]+\.[0-9]+\.x$/ when: on_success - if: $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ when: on_success - changes: compare_to: main paths: - test/new-e2e/pkg/**/* - test/new-e2e/go.mod - changes: compare_to: main paths: - comp/core/tagger/**/* - comp/core/workloadmeta/**/* - comp/core/autodiscovery/listeners/**/* - comp/core/autodiscovery/providers/**/* - comp/languagedetection/**/* - pkg/collector/corechecks/cluster/**/* - pkg/collector/corechecks/containers/**/* - pkg/collector/corechecks/containerimage/**/* - pkg/collector/corechecks/containerlifecycle/**/* - pkg/collector/corechecks/kubernetes/**/* - pkg/collector/corechecks/sbom/**/* - pkg/sbom/**/* - pkg/util/clusteragent/**/* - pkg/util/containerd/**/* - pkg/util/containers/**/* - pkg/util/docker/**/* - pkg/util/ecs/**/* - pkg/util/kubernetes/**/* - pkg/util/cgroups/**/* - pkg/util/trivy/**/* - test/new-e2e/tests/containers/**/* - test/new-e2e/go.mod when: on_success - if: $RUN_E2E_TESTS == "off" when: never - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RUN_E2E_TESTS == "on" when: on_success - if: $CI_COMMIT_BRANCH == "main" when: on_success - if: $CI_COMMIT_BRANCH =~ /^[0-9]+\.[0-9]+\.x$/ when: on_success - if: $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ when: on_success - changes: compare_to: main paths: - test/new-e2e/pkg/**/* - test/new-e2e/go.mod - changes: compare_to: main paths: - test/new-e2e/tests/process/**/* - cmd/process-agent/**/* - comp/process/**/* - pkg/process/**/* - pkg/config/setup/process.go - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: cluster-agent:${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA} IMG_REGISTRIES: agent-qa IMG_SIGNING: '' IMG_SOURCES: ${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64,${SRC_DCA}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-arm64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
qa_dogstatsd ```diff qa_dogstatsd: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_dogstatsd_amd64 - docker_build_dogstatsd_arm64 rules: - if: $RUN_E2E_TESTS == "off" when: never - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RUN_E2E_TESTS == "on" when: on_success - if: $CI_COMMIT_BRANCH == "main" when: on_success - if: $CI_COMMIT_BRANCH =~ /^[0-9]+\.[0-9]+\.x$/ when: on_success - if: $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ when: on_success - changes: compare_to: main paths: - test/new-e2e/pkg/**/* - test/new-e2e/go.mod - changes: compare_to: main paths: - comp/core/tagger/**/* - comp/core/workloadmeta/**/* - comp/core/autodiscovery/listeners/**/* - comp/core/autodiscovery/providers/**/* - comp/languagedetection/**/* - pkg/collector/corechecks/cluster/**/* - pkg/collector/corechecks/containers/**/* - pkg/collector/corechecks/containerimage/**/* - pkg/collector/corechecks/containerlifecycle/**/* - pkg/collector/corechecks/kubernetes/**/* - pkg/collector/corechecks/sbom/**/* - pkg/sbom/**/* - pkg/util/clusteragent/**/* - pkg/util/containerd/**/* - pkg/util/containers/**/* - pkg/util/docker/**/* - pkg/util/ecs/**/* - pkg/util/kubernetes/**/* - pkg/util/cgroups/**/* - pkg/util/trivy/**/* - test/new-e2e/tests/containers/**/* - test/new-e2e/go.mod when: on_success - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: dogstatsd:${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA} IMG_REGISTRIES: agent-qa IMG_SIGNING: '' IMG_SOURCES: ${SRC_DSD}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64,${SRC_DSD}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-arm64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
qa_installer_oci ```diff qa_installer_oci: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - deploy_installer_oci rules: - if: $RUN_E2E_TESTS == "off" when: never - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RUN_E2E_TESTS == "on" when: on_success - if: $CI_COMMIT_BRANCH == "main" when: on_success - if: $CI_COMMIT_BRANCH =~ /^[0-9]+\.[0-9]+\.x$/ when: on_success - if: $CI_COMMIT_TAG =~ /^[0-9]+\.[0-9]+\.[0-9]+-rc\.[0-9]+$/ when: on_success - changes: compare_to: main paths: - test/new-e2e/pkg/**/* - test/new-e2e/go.mod - changes: compare_to: main paths: - .gitlab/**/* - omnibus/config/**/* - pkg/fleet/**/* - cmd/installer/**/* - test/new-e2e/tests/installer/**/* - tasks/installer.py when: on_success - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: deploy_packages tags: - arch:amd64 variables: IMG_DESTINATIONS: installer-package:pipeline-${CI_PIPELINE_ID} IMG_REGISTRIES: agent-qa IMG_SIGNING: '' IMG_SOURCES: registry.ddbuild.io/ci/remote-updates/datadog-installer:pipeline-${CI_PIPELINE_ID} IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
revert_latest_6 ```diff revert_latest_6: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES parallel: matrix: - IMG_DESTINATIONS: agent:6,agent:latest-py2 IMG_SOURCES: datadog/agent:${NEW_LATEST_RELEASE_6} - IMG_DESTINATIONS: agent:6-jmx,agent:latest-py2-jmx IMG_SOURCES: datadog/agent:${NEW_LATEST_RELEASE_6}-jmx rules: - allow_failure: true if: $CI_COMMIT_BRANCH == "main" when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: maintenance_jobs tags: - arch:amd64 variables: IMG_REGISTRIES: public IMG_SIGNING: '' IMG_VARIABLES: '' NEW_LATEST_RELEASE_6: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
revert_latest_7 ```diff revert_latest_7: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES parallel: matrix: - IMG_DESTINATIONS: agent:7,agent:latest IMG_SOURCES: datadog/agent:${NEW_LATEST_RELEASE_7} - IMG_DESTINATIONS: agent:7-jmx,agent:latest-jmx IMG_SOURCES: datadog/agent:${NEW_LATEST_RELEASE_7}-jmx - IMG_DESTINATIONS: agent:7-servercore,agent:latest-servercore IMG_SOURCES: datadog/agent:${NEW_LATEST_RELEASE_7}-servercore - IMG_DESTINATIONS: agent:7-servercore-jmx,agent:latest-servercore-jmx IMG_SOURCES: datadog/agent:${NEW_LATEST_RELEASE_7}-servercore-jmx - IMG_DESTINATIONS: dogstatsd:7,dogstatsd:latest IMG_SOURCES: datadog/dogstatsd:${NEW_LATEST_RELEASE_7} - IMG_DESTINATIONS: cluster-agent:latest IMG_SOURCES: datadog/cluster-agent:${NEW_LATEST_RELEASE_7} rules: - allow_failure: true if: $CI_COMMIT_BRANCH == "main" when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: maintenance_jobs tags: - arch:amd64 variables: IMG_REGISTRIES: public IMG_SIGNING: '' IMG_VARIABLES: '' NEW_LATEST_RELEASE_7: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
scan_master-a6 ```diff scan_master-a6: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent6 - docker_build_agent6_jmx parallel: matrix: - IMG_DESTINATIONS: agent-scan:master-py2 IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-amd64 - IMG_DESTINATIONS: agent-scan:master-py2-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-jmx-amd64 rules: - if: $CI_COMMIT_BRANCH == "main" script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: container_scan tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
scan_master-a7 ```diff scan_master-a7: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent7 - docker_build_agent7_jmx parallel: matrix: - IMG_DESTINATIONS: agent-scan:master-py3 IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-amd64 - IMG_DESTINATIONS: agent-scan:master-py3-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx-amd64 rules: - if: $CI_COMMIT_BRANCH == "main" script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: container_scan tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
scan_master-dogstatsd ```diff scan_master-dogstatsd: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_dogstatsd_amd64 rules: - if: $CI_COMMIT_BRANCH == "main" script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: container_scan tags: - arch:amd64 variables: IMG_DESTINATIONS: dogstatsd-scan:master IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_SOURCES: ${SRC_DSD}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
scan_nightly-a6 ```diff scan_nightly-a6: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent6 - docker_build_agent6_jmx parallel: matrix: - IMG_DESTINATIONS: agent-scan:${BUCKET_BRANCH}-py2 IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-amd64 - IMG_DESTINATIONS: agent-scan:${BUCKET_BRANCH}-py2-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-6-jmx-amd64 rules: - if: $BUCKET_BRANCH != "nightly" && $BUCKET_BRANCH != "oldnightly" && $BUCKET_BRANCH != "dev" when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: container_scan tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
scan_nightly-a7 ```diff scan_nightly-a7: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent7 - docker_build_agent7_jmx parallel: matrix: - IMG_DESTINATIONS: agent-scan:${BUCKET_BRANCH}-py3 IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-amd64 - IMG_DESTINATIONS: agent-scan:${BUCKET_BRANCH}-py3-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-jmx-amd64 rules: - if: $BUCKET_BRANCH != "nightly" && $BUCKET_BRANCH != "oldnightly" && $BUCKET_BRANCH != "dev" when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: container_scan tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
scan_nightly-dogstatsd ```diff scan_nightly-dogstatsd: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_dogstatsd_amd64 rules: - if: $BUCKET_BRANCH != "nightly" && $BUCKET_BRANCH != "oldnightly" && $BUCKET_BRANCH != "dev" when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: container_scan tags: - arch:amd64 variables: IMG_DESTINATIONS: dogstatsd-scan:${BUCKET_BRANCH} IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_SOURCES: ${SRC_DSD}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-amd64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
single_machine_performance-amd64-a7 ```diff single_machine_performance-amd64-a7: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent7 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - when: on_success script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: container_build tags: - arch:amd64 variables: IMG_DESTINATIONS: 08450328-agent:${CI_COMMIT_SHA}-7-amd64 IMG_REGISTRIES: internal-aws-smp IMG_SIGNING: '' IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-amd64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
single_machine_performance-nightly-amd64-a7 ```diff single_machine_performance-nightly-amd64-a7: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_agent7 rules: - if: $CI_PIPELINE_SOURCE == "schedule" && $CI_COMMIT_BRANCH == "main" script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref - main --timeout 1800 --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable ? --------------- + main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES ? ++++++++++++ - IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS ? ------------ + --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable ? +++++++++++ - --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV ? ----------- + BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable ? +++++++++++ - --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS ? ----------- + DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_DESTINATIONS: 08450328-agent:nightly-${CI_COMMIT_BRANCH}-${CI_COMMIT_SHA}-7-amd64 IMG_REGISTRIES: internal-aws-smp IMG_SIGNING: '' IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-amd64 IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
test_install_script ```diff test_install_script: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - deploy_deb_testing-a6_x64 - deploy_rpm_testing-a6_x64 - deploy_suse_rpm_testing_x64-a6 - deploy_deb_testing-a7_x64 - deploy_rpm_testing-a7_x64 - deploy_suse_rpm_testing_x64-a7 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - if: $RELEASE_VERSION_6 == "" when: never - if: $RELEASE_VERSION_7 == "" when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null script: - source /root/.bashrc - set +x - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - export TESTING_APT_URL=$DEB_TESTING_S3_BUCKET - export TESTING_YUM_URL=$RPM_TESTING_S3_BUCKET - export TEST_PIPELINE_ID=$CI_PIPELINE_ID - inv pipeline.trigger-child-pipeline --project-name DataDog/agent-linux-install-script - --git-ref main --timeout 5400 --variable TESTING_APT_URL --variable TESTING_YUM_URL ? --------------- + --git-ref main --variable TESTING_APT_URL --variable TESTING_YUM_URL --variable ? +++++++++++ - --variable TEST_PIPELINE_ID ? ----------- + TEST_PIPELINE_ID stage: install_script_testing tags: - arch:amd64 ```

Added Jobs
datadog-ot-agent-7-arm64 ```yaml datadog-ot-agent-7-arm64: artifacts: expire_in: 2 weeks paths: - $OMNIBUS_PACKAGE_DIR before_script: - export RELEASE_VERSION=$RELEASE_VERSION_7 cache: - key: files: - omnibus/Gemfile - release.json prefix: omnibus-deps-$CI_JOB_NAME-$OMNIBUS_RUBY_VERSION-$OMNIBUS_SOFTWARE paths: - omnibus/vendor/bundle image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_arm64$DATADOG_AGENT_ARMBUILDIMAGES_SUFFIX:$DATADOG_AGENT_ARMBUILDIMAGES needs: - go_mod_tidy_check - build_system-probe-arm64 - go_deps - generate_minimized_btfs_arm64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - when: on_success script: - source /root/.bashrc - echo "About to build for $RELEASE_VERSION" - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_RUBY}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export BUNDLE_MIRROR__RUBYGEMS__ORG=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_GEMS_PATH}; fi - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_PYTHON}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export PIP_INDEX_URL=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_PYPI_PATH}; fi - mkdir -p $GOPATH/pkg/mod && tar xJf modcache.tar.xz -C $GOPATH/pkg/mod - rm -f modcache.tar.xz - pushd omnibus && bundle config set --local path 'vendor/bundle' && popd - rm -rf $OMNIBUS_PACKAGE_DIR/* - tar -xf $CI_PROJECT_DIR/sysprobe-build-outputs.tar.xz - mkdir -p /tmp/system-probe - $S3_CP_CMD $S3_PERMANENT_ARTIFACTS_URI/clang-$CLANG_LLVM_VER.${PACKAGE_ARCH} /tmp/system-probe/clang-bpf - $S3_CP_CMD $S3_PERMANENT_ARTIFACTS_URI/llc-$CLANG_LLVM_VER.${PACKAGE_ARCH} /tmp/system-probe/llc-bpf - cp $CI_PROJECT_DIR/minimized-btfs.tar.xz /tmp/system-probe/minimized-btfs.tar.xz - chmod 0744 /tmp/system-probe/clang-bpf /tmp/system-probe/llc-bpf - inv -e omnibus.build --release-version "$RELEASE_VERSION" --major-version "$AGENT_MAJOR_VERSION" --python-runtimes "$PYTHON_RUNTIMES" --base-dir $OMNIBUS_BASE_DIR ${USE_S3_CACHING} --skip-deps --go-mod-cache="$GOPATH/pkg/mod" --system-probe-bin=/tmp/system-probe --flavor "$FLAVOR" - ls -la $OMNIBUS_PACKAGE_DIR - $S3_CP_CMD $OMNIBUS_PACKAGE_DIR/version-manifest.json $S3_SBOM_STORAGE_URI/$CI_JOB_NAME/version-manifest.json stage: package_build tags: - arch:arm64 variables: AGENT_MAJOR_VERSION: 7 FLAVOR: ot KUBERNETES_CPU_REQUEST: 16 KUBERNETES_MEMORY_LIMIT: 32Gi KUBERNETES_MEMORY_REQUEST: 32Gi PACKAGE_ARCH: arm64 PYTHON_RUNTIMES: '3' ```
datadog-ot-agent-7-x64 ```yaml datadog-ot-agent-7-x64: artifacts: expire_in: 2 weeks paths: - $OMNIBUS_PACKAGE_DIR before_script: - export RELEASE_VERSION=$RELEASE_VERSION_7 cache: - key: files: - omnibus/Gemfile - release.json prefix: omnibus-deps-$CI_JOB_NAME-$OMNIBUS_RUBY_VERSION-$OMNIBUS_SOFTWARE paths: - omnibus/vendor/bundle image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/rpm_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - go_mod_tidy_check - build_system-probe-x64 - go_deps - generate_minimized_btfs_x64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - when: on_success script: - source /root/.bashrc - echo "About to build for $RELEASE_VERSION" - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_RUBY}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export BUNDLE_MIRROR__RUBYGEMS__ORG=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_GEMS_PATH}; fi - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_PYTHON}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export PIP_INDEX_URL=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_PYPI_PATH}; fi - mkdir -p $GOPATH/pkg/mod && tar xJf modcache.tar.xz -C $GOPATH/pkg/mod - rm -f modcache.tar.xz - pushd omnibus && bundle config set --local path 'vendor/bundle' && popd - rm -rf $OMNIBUS_PACKAGE_DIR/* - tar -xf $CI_PROJECT_DIR/sysprobe-build-outputs.tar.xz - mkdir -p /tmp/system-probe - $S3_CP_CMD $S3_PERMANENT_ARTIFACTS_URI/clang-$CLANG_LLVM_VER.${PACKAGE_ARCH} /tmp/system-probe/clang-bpf - $S3_CP_CMD $S3_PERMANENT_ARTIFACTS_URI/llc-$CLANG_LLVM_VER.${PACKAGE_ARCH} /tmp/system-probe/llc-bpf - cp $CI_PROJECT_DIR/minimized-btfs.tar.xz /tmp/system-probe/minimized-btfs.tar.xz - chmod 0744 /tmp/system-probe/clang-bpf /tmp/system-probe/llc-bpf - inv -e omnibus.build --release-version "$RELEASE_VERSION" --major-version "$AGENT_MAJOR_VERSION" --python-runtimes "$PYTHON_RUNTIMES" --base-dir $OMNIBUS_BASE_DIR ${USE_S3_CACHING} --skip-deps --go-mod-cache="$GOPATH/pkg/mod" --system-probe-bin=/tmp/system-probe --flavor "$FLAVOR" - ls -la $OMNIBUS_PACKAGE_DIR - $S3_CP_CMD $OMNIBUS_PACKAGE_DIR/version-manifest.json $S3_SBOM_STORAGE_URI/$CI_JOB_NAME/version-manifest.json stage: package_build tags: - arch:amd64 variables: AGENT_MAJOR_VERSION: 7 FLAVOR: ot KUBERNETES_CPU_REQUEST: 16 KUBERNETES_MEMORY_LIMIT: 32Gi KUBERNETES_MEMORY_REQUEST: 32Gi PACKAGE_ARCH: amd64 PYTHON_RUNTIMES: '3' ```
dev_branch-ot ```yaml dev_branch-ot: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_ot_agent7 - docker_build_ot_agent7_jmx - docker_build_ot_agent7_arm64 - docker_build_ot_agent7_jmx_arm64 parallel: matrix: - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG}-7-ot IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-ot-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-ot-arm64 - IMG_DESTINATIONS: agent-dev:${CI_COMMIT_REF_SLUG}-7-ot-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-ot-jmx-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-ot-jmx-arm64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - allow_failure: true when: manual script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
dev_nightly-ot-a7 ```yaml dev_nightly-ot-a7: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - docker_build_ot_agent7 - docker_build_ot_agent7_jmx - docker_build_ot_agent7_arm64 - docker_build_ot_agent7_jmx_arm64 parallel: matrix: - IMG_DESTINATIONS: agent-dev:nightly-ot-${CI_COMMIT_REF_SLUG} IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-ot-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-ot-arm64 - IMG_DESTINATIONS: agent-dev:nightly-ot-${CI_COMMIT_REF_SLUG}-jmx IMG_SOURCES: ${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-ot-jmx-amd64,${SRC_AGENT}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}-7-ot-jmx-arm64 rules: - if: $BUCKET_BRANCH != "nightly" && $BUCKET_BRANCH != "oldnightly" && $BUCKET_BRANCH != "dev" when: never - if: $DEPLOY_AGENT == "true" || $DDR_WORKFLOW_ID != null script: - source /root/.bashrc - export GITLAB_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $GITLAB_SCHEDULER_TOKEN_SSM_NAME) - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMG_SOURCES\" =~ \"$SRC_AGENT\"\ \ || \"$IMG_SOURCES\" =~ \"$SRC_DCA\" || \"$IMG_SOURCES\" =~ \"$SRC_CWS_INSTRUMENTATION\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_AGENT\" || \"$IMG_VARIABLES\" =~ \"$SRC_DCA\"\ \ || \"$IMG_VARIABLES\" =~ \"$SRC_CWS_INSTRUMENTATION\" ) ]]; then\n export ECR_RELEASE_SUFFIX=\"\ -nightly\"\nelse\n export ECR_RELEASE_SUFFIX=\"${CI_COMMIT_TAG+-release}\"\n\ fi\n" - IMG_VARIABLES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_VARIABLES")" - IMG_SOURCES="$(sed -E "s#(${SRC_AGENT}|${SRC_DSD}|${SRC_DCA}|${SRC_CWS_INSTRUMENTATION})#\1${ECR_RELEASE_SUFFIX}#g" <<<"$IMG_SOURCES")" - inv pipeline.trigger-child-pipeline --project-name DataDog/public-images --git-ref main --variable IMG_VARIABLES --variable IMG_REGISTRIES --variable IMG_SOURCES --variable IMG_DESTINATIONS --variable IMG_SIGNING --variable APPS --variable BAZEL_TARGET --variable DDR --variable DDR_WORKFLOW_ID --variable TARGET_ENV --variable DYNAMIC_BUILD_RENDER_TARGET_FORWARD_PARAMETERS stage: dev_container_deploy tags: - arch:amd64 variables: IMG_REGISTRIES: dev IMG_SIGNING: '' IMG_VARIABLES: '' SRC_AGENT: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent SRC_CWS_INSTRUMENTATION: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cws-instrumentation SRC_DCA: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/cluster-agent SRC_DSD: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/dogstatsd ```
docker_build_ot_agent7 ```yaml docker_build_ot_agent7: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/docker_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - artifacts: false job: ot_agent_deb-x64-a7 retry: 2 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - when: on_success script: - aws s3 sync --only-show-errors $S3_ARTIFACTS_URI $BUILD_CONTEXT - TAG_SUFFIX=${TAG_SUFFIX:-} - BUILD_ARG=${BUILD_ARG:-} - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMAGE\" =~ \"ci/datadog-agent/agent\"\ \ || \"$IMAGE\" =~ \"ci/datadog-agent/cluster-agent\" || \"$IMAGE\" =~ \"ci/datadog-agent/cws-instrumentation\"\ \ ) ]]; then\n export ECR_RELEASE_SUFFIX=\"-nightly\"\nelse\n export ECR_RELEASE_SUFFIX=${CI_COMMIT_TAG+-release}\n\ fi\n" - TARGET_TAG=${IMAGE}${ECR_RELEASE_SUFFIX}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}$TAG_SUFFIX-$ARCH - DOCKER_REGISTRY_LOGIN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $DOCKER_REGISTRY_LOGIN_SSM_KEY) - $CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $DOCKER_REGISTRY_PWD_SSM_KEY | docker login --username "$DOCKER_REGISTRY_LOGIN" --password-stdin "$DOCKER_REGISTRY_URL" - docker buildx build --no-cache --push --pull --platform linux/$ARCH --build-arg CIBUILD=true --build-arg GENERAL_ARTIFACTS_CACHE_BUCKET_URL=${GENERAL_ARTIFACTS_CACHE_BUCKET_URL} $BUILD_ARG --file $BUILD_CONTEXT/Dockerfile --tag ${TARGET_TAG} --label "org.opencontainers.image.created=$(date --rfc-3339=seconds)" --label "org.opencontainers.image.authors=Datadog " --label "org.opencontainers.image.source=https://github.com/DataDog/datadog-agent" --label "org.opencontainers.image.version=$(inv agent.version)" --label "org.opencontainers.image.revision=${CI_COMMIT_SHA}" --label "org.opencontainers.image.vendor=Datadog, Inc." $BUILD_CONTEXT - crane flatten -t ${TARGET_TAG} ${TARGET_TAG} stage: container_build tags: - arch:amd64 variables: ARCH: amd64 BUILD_ARG: --target test --build-arg PYTHON_VERSION=3 --build-arg DD_AGENT_ARTIFACT=datadog-ot-agent_7*_amd64.deb BUILD_CONTEXT: Dockerfiles/agent CI_ENABLE_CONTAINER_IMAGE_BUILDS: 'true' IMAGE: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent TAG_SUFFIX: -7-ot-beta ```
docker_build_ot_agent7_arm64 ```yaml docker_build_ot_agent7_arm64: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/docker_arm64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - artifacts: false job: ot_agent_deb-arm64-a7 retry: 2 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - when: on_success script: - aws s3 sync --only-show-errors $S3_ARTIFACTS_URI $BUILD_CONTEXT - TAG_SUFFIX=${TAG_SUFFIX:-} - BUILD_ARG=${BUILD_ARG:-} - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMAGE\" =~ \"ci/datadog-agent/agent\"\ \ || \"$IMAGE\" =~ \"ci/datadog-agent/cluster-agent\" || \"$IMAGE\" =~ \"ci/datadog-agent/cws-instrumentation\"\ \ ) ]]; then\n export ECR_RELEASE_SUFFIX=\"-nightly\"\nelse\n export ECR_RELEASE_SUFFIX=${CI_COMMIT_TAG+-release}\n\ fi\n" - TARGET_TAG=${IMAGE}${ECR_RELEASE_SUFFIX}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}$TAG_SUFFIX-$ARCH - DOCKER_REGISTRY_LOGIN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $DOCKER_REGISTRY_LOGIN_SSM_KEY) - $CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $DOCKER_REGISTRY_PWD_SSM_KEY | docker login --username "$DOCKER_REGISTRY_LOGIN" --password-stdin "$DOCKER_REGISTRY_URL" - docker buildx build --no-cache --push --pull --platform linux/$ARCH --build-arg CIBUILD=true --build-arg GENERAL_ARTIFACTS_CACHE_BUCKET_URL=${GENERAL_ARTIFACTS_CACHE_BUCKET_URL} $BUILD_ARG --file $BUILD_CONTEXT/Dockerfile --tag ${TARGET_TAG} --label "org.opencontainers.image.created=$(date --rfc-3339=seconds)" --label "org.opencontainers.image.authors=Datadog " --label "org.opencontainers.image.source=https://github.com/DataDog/datadog-agent" --label "org.opencontainers.image.version=$(inv agent.version)" --label "org.opencontainers.image.revision=${CI_COMMIT_SHA}" --label "org.opencontainers.image.vendor=Datadog, Inc." $BUILD_CONTEXT - crane flatten -t ${TARGET_TAG} ${TARGET_TAG} stage: container_build tags: - arch:arm64 variables: ARCH: arm64 BUILD_ARG: --target test --build-arg PYTHON_VERSION=3 --build-arg DD_AGENT_ARTIFACT=datadog-ot-agent_7*_arm64.deb BUILD_CONTEXT: Dockerfiles/agent CI_ENABLE_CONTAINER_IMAGE_BUILDS: 'true' IMAGE: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent TAG_SUFFIX: -7-ot-beta ```
docker_build_ot_agent7_jmx ```yaml docker_build_ot_agent7_jmx: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/docker_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - artifacts: false job: ot_agent_deb-x64-a7 retry: 2 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - when: on_success script: - aws s3 sync --only-show-errors $S3_ARTIFACTS_URI $BUILD_CONTEXT - TAG_SUFFIX=${TAG_SUFFIX:-} - BUILD_ARG=${BUILD_ARG:-} - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMAGE\" =~ \"ci/datadog-agent/agent\"\ \ || \"$IMAGE\" =~ \"ci/datadog-agent/cluster-agent\" || \"$IMAGE\" =~ \"ci/datadog-agent/cws-instrumentation\"\ \ ) ]]; then\n export ECR_RELEASE_SUFFIX=\"-nightly\"\nelse\n export ECR_RELEASE_SUFFIX=${CI_COMMIT_TAG+-release}\n\ fi\n" - TARGET_TAG=${IMAGE}${ECR_RELEASE_SUFFIX}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}$TAG_SUFFIX-$ARCH - DOCKER_REGISTRY_LOGIN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $DOCKER_REGISTRY_LOGIN_SSM_KEY) - $CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $DOCKER_REGISTRY_PWD_SSM_KEY | docker login --username "$DOCKER_REGISTRY_LOGIN" --password-stdin "$DOCKER_REGISTRY_URL" - docker buildx build --no-cache --push --pull --platform linux/$ARCH --build-arg CIBUILD=true --build-arg GENERAL_ARTIFACTS_CACHE_BUCKET_URL=${GENERAL_ARTIFACTS_CACHE_BUCKET_URL} $BUILD_ARG --file $BUILD_CONTEXT/Dockerfile --tag ${TARGET_TAG} --label "org.opencontainers.image.created=$(date --rfc-3339=seconds)" --label "org.opencontainers.image.authors=Datadog " --label "org.opencontainers.image.source=https://github.com/DataDog/datadog-agent" --label "org.opencontainers.image.version=$(inv agent.version)" --label "org.opencontainers.image.revision=${CI_COMMIT_SHA}" --label "org.opencontainers.image.vendor=Datadog, Inc." $BUILD_CONTEXT - crane flatten -t ${TARGET_TAG} ${TARGET_TAG} stage: container_build tags: - arch:amd64 variables: ARCH: amd64 BUILD_ARG: --target test --build-arg WITH_JMX=true --build-arg PYTHON_VERSION=3 --build-arg DD_AGENT_ARTIFACT=datadog-ot-agent_7*_amd64.deb BUILD_CONTEXT: Dockerfiles/agent CI_ENABLE_CONTAINER_IMAGE_BUILDS: 'true' IMAGE: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent TAG_SUFFIX: -7-ot-beta-jmx ```
docker_build_ot_agent7_jmx_arm64 ```yaml docker_build_ot_agent7_jmx_arm64: image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/docker_arm64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - artifacts: false job: ot_agent_deb-arm64-a7 retry: 2 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - when: on_success script: - aws s3 sync --only-show-errors $S3_ARTIFACTS_URI $BUILD_CONTEXT - TAG_SUFFIX=${TAG_SUFFIX:-} - BUILD_ARG=${BUILD_ARG:-} - "if [[ \"$BUCKET_BRANCH\" == \"nightly\" && ( \"$IMAGE\" =~ \"ci/datadog-agent/agent\"\ \ || \"$IMAGE\" =~ \"ci/datadog-agent/cluster-agent\" || \"$IMAGE\" =~ \"ci/datadog-agent/cws-instrumentation\"\ \ ) ]]; then\n export ECR_RELEASE_SUFFIX=\"-nightly\"\nelse\n export ECR_RELEASE_SUFFIX=${CI_COMMIT_TAG+-release}\n\ fi\n" - TARGET_TAG=${IMAGE}${ECR_RELEASE_SUFFIX}:v${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}$TAG_SUFFIX-$ARCH - DOCKER_REGISTRY_LOGIN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $DOCKER_REGISTRY_LOGIN_SSM_KEY) - $CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $DOCKER_REGISTRY_PWD_SSM_KEY | docker login --username "$DOCKER_REGISTRY_LOGIN" --password-stdin "$DOCKER_REGISTRY_URL" - docker buildx build --no-cache --push --pull --platform linux/$ARCH --build-arg CIBUILD=true --build-arg GENERAL_ARTIFACTS_CACHE_BUCKET_URL=${GENERAL_ARTIFACTS_CACHE_BUCKET_URL} $BUILD_ARG --file $BUILD_CONTEXT/Dockerfile --tag ${TARGET_TAG} --label "org.opencontainers.image.created=$(date --rfc-3339=seconds)" --label "org.opencontainers.image.authors=Datadog " --label "org.opencontainers.image.source=https://github.com/DataDog/datadog-agent" --label "org.opencontainers.image.version=$(inv agent.version)" --label "org.opencontainers.image.revision=${CI_COMMIT_SHA}" --label "org.opencontainers.image.vendor=Datadog, Inc." $BUILD_CONTEXT - crane flatten -t ${TARGET_TAG} ${TARGET_TAG} stage: container_build tags: - arch:arm64 variables: ARCH: arm64 BUILD_ARG: --target test --build-arg WITH_JMX=true --build-arg PYTHON_VERSION=3 --build-arg DD_AGENT_ARTIFACT=datadog-ot-agent_7*_arm64.deb BUILD_CONTEXT: Dockerfiles/agent CI_ENABLE_CONTAINER_IMAGE_BUILDS: 'true' IMAGE: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent/agent TAG_SUFFIX: -7-ot-beta-jmx ```
ot_agent_deb-arm64-a7 ```yaml ot_agent_deb-arm64-a7: artifacts: expire_in: 2 weeks paths: - $OMNIBUS_PACKAGE_DIR cache: - key: files: - omnibus/Gemfile - release.json prefix: omnibus-deps-$CI_JOB_NAME-$OMNIBUS_RUBY_VERSION-$OMNIBUS_SOFTWARE paths: - omnibus/vendor/bundle image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_arm64$DATADOG_AGENT_ARMBUILDIMAGES_SUFFIX:$DATADOG_AGENT_ARMBUILDIMAGES needs: - datadog-ot-agent-7-arm64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - when: on_success script: - source /root/.bashrc - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_RUBY}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export BUNDLE_MIRROR__RUBYGEMS__ORG=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_GEMS_PATH}; fi - pushd omnibus && bundle config set --local path 'vendor/bundle' && popd - echo "About to package for $RELEASE_VERSION" - set +x - DEB_GPG_KEY=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $DEB_GPG_KEY_SSM_NAME) - printf -- "${DEB_GPG_KEY}" | gpg --import --batch - export DEB_SIGNING_PASSPHRASE=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $DEB_SIGNING_PASSPHRASE_SSM_NAME) - inv -e omnibus.build --release-version "$RELEASE_VERSION" --major-version "$AGENT_MAJOR_VERSION" --base-dir $OMNIBUS_BASE_DIR --skip-deps --target-project ${DD_PROJECT} --flavor ot ${OMNIBUS_EXTRA_ARGS} - curl -sSL "https://dd-package-tools.s3.amazonaws.com/dd-pkg/${DD_PKG_VERSION}/dd-pkg_Linux_${DD_PKG_ARCH}.tar.gz" | tar -xz -C /usr/local/bin dd-pkg - find $OMNIBUS_PACKAGE_DIR -iregex '.*\.\(deb\|rpm\)' | xargs dd-pkg lint - $S3_CP_CMD $OMNIBUS_PACKAGE_DIR/datadog-ot-agent_*_${PACKAGE_ARCH}.deb $S3_ARTIFACTS_URI/$DESTINATION_DEB stage: packaging tags: - arch:arm64 variables: AGENT_MAJOR_VERSION: 7 DD_PKG_ARCH: arm64 DD_PROJECT: agent DESTINATION_DEB: datadog-ot-agent_7_arm64.deb KUBERNETES_CPU_REQUEST: 16 KUBERNETES_MEMORY_LIMIT: 32Gi KUBERNETES_MEMORY_REQUEST: 32Gi OMNIBUS_PACKAGE_ARTIFACT_DIR: $OMNIBUS_PACKAGE_DIR PACKAGE_ARCH: arm64 RELEASE_VERSION: $RELEASE_VERSION_7 ```
ot_agent_deb-x64-a7 ```yaml ot_agent_deb-x64-a7: artifacts: expire_in: 2 weeks paths: - $OMNIBUS_PACKAGE_DIR cache: - key: files: - omnibus/Gemfile - release.json prefix: omnibus-deps-$CI_JOB_NAME-$OMNIBUS_RUBY_VERSION-$OMNIBUS_SOFTWARE paths: - omnibus/vendor/bundle image: 486234852809.dkr.ecr.us-east-1.amazonaws.com/ci/datadog-agent-buildimages/deb_x64$DATADOG_AGENT_BUILDIMAGES_SUFFIX:$DATADOG_AGENT_BUILDIMAGES needs: - datadog-ot-agent-7-x64 rules: - if: $CI_COMMIT_BRANCH =~ /^mq-working-branch-/ when: never - when: on_success script: - source /root/.bashrc - ARTIFACTORY_BYPASS=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_BYPASS_SSM_NAME) - if [ "${ARTIFACTORY_BYPASS}" = "true" ]; then echo "Bypassing Artifactory"; fi - set +x - ARTIFACTORY_TOKEN=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $ARTIFACTORY_TOKEN_SSM_NAME) - if [ "${USE_CACHING_PROXY_RUBY}" = "true" ] && [ "${ARTIFACTORY_BYPASS}" = "false" ]; then export BUNDLE_MIRROR__RUBYGEMS__ORG=https://${ARTIFACTORY_USERNAME}:${ARTIFACTORY_TOKEN}@${ARTIFACTORY_URL}/${ARTIFACTORY_GEMS_PATH}; fi - pushd omnibus && bundle config set --local path 'vendor/bundle' && popd - echo "About to package for $RELEASE_VERSION" - set +x - DEB_GPG_KEY=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $DEB_GPG_KEY_SSM_NAME) - printf -- "${DEB_GPG_KEY}" | gpg --import --batch - export DEB_SIGNING_PASSPHRASE=$($CI_PROJECT_DIR/tools/ci/aws_ssm_get_wrapper.sh $DEB_SIGNING_PASSPHRASE_SSM_NAME) - inv -e omnibus.build --release-version "$RELEASE_VERSION" --major-version "$AGENT_MAJOR_VERSION" --base-dir $OMNIBUS_BASE_DIR --skip-deps --target-project ${DD_PROJECT} --flavor ot ${OMNIBUS_EXTRA_ARGS} - curl -sSL "https://dd-package-tools.s3.amazonaws.com/dd-pkg/${DD_PKG_VERSION}/dd-pkg_Linux_${DD_PKG_ARCH}.tar.gz" | tar -xz -C /usr/local/bin dd-pkg - find $OMNIBUS_PACKAGE_DIR -iregex '.*\.\(deb\|rpm\)' | xargs dd-pkg lint - $S3_CP_CMD $OMNIBUS_PACKAGE_DIR/datadog-ot-agent_*_${PACKAGE_ARCH}.deb $S3_ARTIFACTS_URI/$DESTINATION_DEB stage: packaging tags: - arch:amd64 variables: AGENT_MAJOR_VERSION: 7 DD_PKG_ARCH: x86_64 DD_PROJECT: agent DESTINATION_DEB: datadog-ot-agent_7_amd64.deb KUBERNETES_CPU_REQUEST: 16 KUBERNETES_MEMORY_LIMIT: 32Gi KUBERNETES_MEMORY_REQUEST: 32Gi OMNIBUS_PACKAGE_ARTIFACT_DIR: $OMNIBUS_PACKAGE_DIR PACKAGE_ARCH: amd64 RELEASE_VERSION: $RELEASE_VERSION_7 ```

Changes

Removed Modified Added Renamed
0 63 10 0
KSerrania commented 2 months ago

As discussed offline, I think we should test what happens if a very large number of jobs is modified. If this makes the message hard to read, we'll want to show a summary only (to not pollute the PR).

CelianR commented 2 months ago

/merge

dd-devflow[bot] commented 2 months ago

:steam_locomotive: MergeQueue: pull request added to the queue

The median merge time in main is 26m.

Use /merge -c to cancel this operation!