vishnued
commented
1 week ago @Rishab9991 got the same issue, have you resolved this issue?
Open Rishab9991 opened 1 month ago
vishnued
commented
1 week ago @Rishab9991 got the same issue, have you resolved this issue?
Hi MG I am trying to re-produce your Automated Training with CI Pipeline by going through your videos. However, the training model step is failing with the configuration you have used. The only change I have made is using Ubuntu-20.04 as Ubuntu-16.04 was not available. PFB the Log for the same. Kindly help me in resolving this issue
2024-09-16T14:47:19.8932421Z ##[section]Starting: Training Model 2024-09-16T14:47:19.8937907Z ============================================================================== 2024-09-16T14:47:19.8938060Z Task : Azure CLI 2024-09-16T14:47:19.8938147Z Description : Run Azure CLI commands against an Azure subscription in a PowerShell Core/Shell script when running on Linux agent or PowerShell/PowerShell Core/Batch script when running on Windows agent. 2024-09-16T14:47:19.8938378Z Version : 2.245.5 2024-09-16T14:47:19.8938468Z Author : Microsoft Corporation 2024-09-16T14:47:19.8938559Z Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/deploy/azure-cli 2024-09-16T14:47:19.8938700Z ============================================================================== 2024-09-16T14:47:20.1568256Z [command]/opt/hostedtoolcache/Python/3.6.15/x64/bin/az --version 2024-09-16T14:47:21.0521653Z azure-cli 2.39.0 2024-09-16T14:47:21.0522278Z 2024-09-16T14:47:21.0522630Z core 2.39.0 2024-09-16T14:47:21.0523202Z telemetry 1.0.6 * 2024-09-16T14:47:21.0525571Z 2024-09-16T14:47:21.0525866Z Extensions: 2024-09-16T14:47:21.0526296Z azure-cli-ml 1.41.0 2024-09-16T14:47:21.0526689Z azure-devops 1.0.1 2024-09-16T14:47:21.0557418Z WARNING: You have 3 updates available. Consider updating your CLI installation with 'az upgrade' 2024-09-16T14:47:21.0557656Z 2024-09-16T14:47:21.0557816Z Dependencies: 2024-09-16T14:47:21.0558008Z msal 1.18.0b1 2024-09-16T14:47:21.0558277Z azure-mgmt-resource 21.1.0b1 2024-09-16T14:47:21.0558383Z 2024-09-16T14:47:21.0558689Z Python location '/opt/hostedtoolcache/Python/3.6.15/x64/bin/python' 2024-09-16T14:47:21.0559021Z Extensions directory '/opt/az/azcliextensions' 2024-09-16T14:47:21.0559120Z 2024-09-16T14:47:21.0559371Z Python (Linux) 3.6.15 (default, Sep 6 2021, 07:07:23) 2024-09-16T14:47:21.0559590Z [GCC 9.3.0] 2024-09-16T14:47:21.0559671Z 2024-09-16T14:47:21.0559865Z Legal docs and information: aka.ms/AzureCliLegal 2024-09-16T14:47:21.0559966Z 2024-09-16T14:47:21.0560034Z 2024-09-16T14:47:21.0560998Z 2024-09-16T14:47:21.0561467Z Please let us know how we are doing: https://aka.ms/azureclihats 2024-09-16T14:47:21.0561965Z and let us know if you're interested in trying out our newest features: https://aka.ms/CLIUXstudy 2024-09-16T14:47:21.0580300Z Setting AZURE_CONFIG_DIR env variable to: /home/vsts/work/_temp/.azclitask 2024-09-16T14:47:21.0587244Z Setting active cloud to: AzureCloud 2024-09-16T14:47:21.0588993Z [command]/opt/hostedtoolcache/Python/3.6.15/x64/bin/az cloud set -n AzureCloud 2024-09-16T14:47:21.3317073Z [command]/opt/hostedtoolcache/Python/3.6.15/x64/bin/az login --service-principal -u --password= --tenant 66dc01f7-14e9-452c-90bc-1ce4a8b4f81b --allow-no-subscriptions 2024-09-16T14:47:22.2354878Z [ 2024-09-16T14:47:22.2355515Z { 2024-09-16T14:47:22.2356212Z "cloudName": "AzureCloud", 2024-09-16T14:47:22.2359492Z "homeTenantId": "66dc01f7-14e9-452c-90bc-1ce4a8b4f81b", 2024-09-16T14:47:22.2359945Z "id": "71e511f6-a23a-426e-a272-a3fa9884509e", 2024-09-16T14:47:22.2360375Z "isDefault": true, 2024-09-16T14:47:22.2361189Z "managedByTenants": [], 2024-09-16T14:47:22.2361533Z "name": "Free Trial", 2024-09-16T14:47:22.2361920Z "state": "Enabled", 2024-09-16T14:47:22.2362474Z "tenantId": "66dc01f7-14e9-452c-90bc-1ce4a8b4f81b", 2024-09-16T14:47:22.2362832Z "user": { 2024-09-16T14:47:22.2363426Z "name": "*", 2024-09-16T14:47:22.2363736Z "type": "servicePrincipal" 2024-09-16T14:47:22.2364224Z } 2024-09-16T14:47:22.2367192Z } 2024-09-16T14:47:22.2367548Z ] 2024-09-16T14:47:22.2368278Z [command]/opt/hostedtoolcache/Python/3.6.15/x64/bin/az account set --subscription 71e511f6-a23a-426e-a272-a3fa9884509e 2024-09-16T14:47:22.5228567Z [command]/usr/bin/bash /home/vsts/work/_temp/azureclitaskscript1726498040152.sh 2024-09-16T14:47:40.4322210Z RunId: insurance_classification_1726498047_47775b73 2024-09-16T14:47:40.4324295Z Web View: https://ml.azure.com/runs/insurance_classification_1726498047_47775b73?wsid=/subscriptions/71e511f6-a23a-426e-a272-a3fa9884509e/resourcegroups/mlops-test-rg-1/workspaces/mlops-test-aml-1&tid=66dc01f7-14e9-452c-90bc-1ce4a8b4f81b 2024-09-16T14:47:45.7170194Z 2024-09-16T14:47:45.7171583Z Streaming azureml-logs/20_image_build_log.txt 2024-09-16T14:47:46.5538868Z ============================================= 2024-09-16T14:47:47.5544721Z 2024-09-16T14:52:11.7972593Z ======Starting Image Build on Serverless Compute====== 2024-09-16T14:52:11.7973510Z The run ID for the image build on serverless compute is imgbldrun_d1b28c3 2024-09-16T14:52:11.7974899Z Additional logs for the run: https://ml.azure.com/experiments/id/prepare_image/runs/imgbldrun_d1b28c3?wsid=/subscriptions/71e511f6-a23a-426e-a272-a3fa9884509e/resourcegroups/mlops-test-rg-1/workspaces/mlops-test-aml-1&tid=66dc01f7-14e9-452c-90bc-1ce4a8b4f81b 2024-09-16T14:54:17.8053884Z 2024-09-16T14:52:50: Logging into Docker registry: mlopstest1amlcr.azurecr.io 2024-09-16T14:54:17.8054796Z 2024-09-16T14:52:50: WARNING! Using --password via the CLI is insecure. Use --password-stdin. 2024-09-16T14:54:17.8056906Z 2024-09-16T14:52:51: WARNING! Your password will be stored unencrypted in /root/.docker/config.json. 2024-09-16T14:54:17.8057587Z 2024-09-16T14:52:51: Configure a credential helper to remove this warning. See 2024-09-16T14:54:17.8058754Z 2024-09-16T14:52:51: https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-09-16T14:54:17.8059051Z 2024-09-16T14:54:17.8059367Z 2024-09-16T14:52:51: Login Succeeded 2024-09-16T14:54:17.8059483Z 2024-09-16T14:54:17.8059548Z 2024-09-16T14:54:17.8060350Z 2024-09-16T14:52:51: Running: ['docker', 'build', '-f', 'azureml-environment-setup/Dockerfile', '.', '-t', 'mlopstest1amlcr.azurecr.io/azureml/azureml_7a41b39b23b7d6edf44ec05ac079bd4f', '-t', 'mlopstest1amlcr.azurecr.io/azureml/azureml_7a41b39b23b7d6edf44ec05ac079bd4f:3'] 2024-09-16T14:54:17.8061084Z 2024-09-16T14:52:51: DEPRECATED: The legacy builder is deprecated and will be removed in a future release. 2024-09-16T14:54:17.8061603Z 2024-09-16T14:52:51: Install the buildx component to build images with BuildKit: 2024-09-16T14:54:17.8062044Z 2024-09-16T14:52:51: https://docs.docker.com/go/buildx/ 2024-09-16T14:54:17.8062196Z 2024-09-16T14:54:17.8062550Z 2024-09-16T14:52:51: Sending build context to Docker daemon 71.17kB 2024-09-16T14:54:17.8067098Z 2024-09-16T14:52:51: Step 1/17 : FROM mcr.microsoft.com/azureml/lightgbm-3.2-ubuntu18.04-py37-cpu-inference:latest@sha256:8c113d05a2f905969214f272835844f2f59d03f131ed054c23ac2dafc2f0cb11 2024-09-16T14:54:17.8068219Z 2024-09-16T14:52:51: mcr.microsoft.com/azureml/lightgbm-3.2-ubuntu18.04-py37-cpu-inference:latest@sha256:8c113d05a2f905969214f272835844f2f59d03f131ed054c23ac2dafc2f0cb11: Pulling from azureml/lightgbm-3.2-ubuntu18.04-py37-cpu-inference 2024-09-16T14:54:17.8068834Z 2024-09-16T14:52:51: a404e5416296: Pulling fs layer 2024-09-16T14:54:17.8069337Z 2024-09-16T14:52:51: aadcad350b29: Pulling fs layer 2024-09-16T14:54:17.8069731Z 2024-09-16T14:52:51: 18cf0ecbcc4c: Pulling fs layer 2024-09-16T14:54:17.8070127Z 2024-09-16T14:52:51: d770ba5245d3: Pulling fs layer 2024-09-16T14:54:17.8070504Z 2024-09-16T14:52:51: 516e284cb9f5: Pulling fs layer 2024-09-16T14:54:17.8070889Z 2024-09-16T14:52:51: 426c8112ec69: Pulling fs layer 2024-09-16T14:54:17.8071283Z 2024-09-16T14:52:51: b3494fb855b7: Pulling fs layer 2024-09-16T14:54:17.8071675Z 2024-09-16T14:52:51: 268a6e115509: Pulling fs layer 2024-09-16T14:54:17.8072065Z 2024-09-16T14:52:51: 791daa6ac24e: Pulling fs layer 2024-09-16T14:54:17.8072449Z 2024-09-16T14:52:51: c7256d5b9820: Pulling fs layer 2024-09-16T14:54:17.8072825Z 2024-09-16T14:52:51: e179b8530bb3: Pulling fs layer 2024-09-16T14:54:17.8073211Z 2024-09-16T14:52:51: 10fe4cf24d28: Pulling fs layer 2024-09-16T14:54:17.8073588Z 2024-09-16T14:52:51: 0547551e4dad: Pulling fs layer 2024-09-16T14:54:17.8073961Z 2024-09-16T14:52:51: b60c470e6c10: Pulling fs layer 2024-09-16T14:54:17.8074504Z 2024-09-16T14:52:51: e4dd6447d0ae: Pulling fs layer 2024-09-16T14:54:17.8074882Z 2024-09-16T14:52:51: 07b0081c9f5f: Pulling fs layer 2024-09-16T14:54:17.8075251Z 2024-09-16T14:52:51: d770ba5245d3: Waiting 2024-09-16T14:54:17.8076047Z 2024-09-16T14:52:51: c7256d5b9820: Waiting 2024-09-16T14:54:17.8076419Z 2024-09-16T14:52:51: e179b8530bb3: Waiting 2024-09-16T14:54:17.8076780Z 2024-09-16T14:52:51: 10fe4cf24d28: Waiting 2024-09-16T14:54:17.8077144Z 2024-09-16T14:52:51: 0547551e4dad: Waiting 2024-09-16T14:54:17.8077501Z 2024-09-16T14:52:51: b60c470e6c10: Waiting 2024-09-16T14:54:17.8077857Z 2024-09-16T14:52:51: e4dd6447d0ae: Waiting 2024-09-16T14:54:17.8078210Z 2024-09-16T14:52:51: 07b0081c9f5f: Waiting 2024-09-16T14:54:17.8078562Z 2024-09-16T14:52:51: 516e284cb9f5: Waiting 2024-09-16T14:54:17.8078915Z 2024-09-16T14:52:51: 268a6e115509: Waiting 2024-09-16T14:54:17.8079267Z 2024-09-16T14:52:51: 791daa6ac24e: Waiting 2024-09-16T14:54:17.8079618Z 2024-09-16T14:52:51: b3494fb855b7: Waiting 2024-09-16T14:54:17.8079975Z 2024-09-16T14:52:51: 426c8112ec69: Waiting 2024-09-16T14:54:17.8080351Z 2024-09-16T14:52:51: 18cf0ecbcc4c: Verifying Checksum 2024-09-16T14:54:17.8080744Z 2024-09-16T14:52:51: 18cf0ecbcc4c: Download complete 2024-09-16T14:54:17.8081122Z 2024-09-16T14:52:51: d770ba5245d3: Verifying Checksum 2024-09-16T14:54:17.8081516Z 2024-09-16T14:52:51: d770ba5245d3: Download complete 2024-09-16T14:54:17.8081905Z 2024-09-16T14:52:51: a404e5416296: Verifying Checksum 2024-09-16T14:54:17.8082304Z 2024-09-16T14:52:51: a404e5416296: Download complete 2024-09-16T14:54:17.8082709Z 2024-09-16T14:52:51: 516e284cb9f5: Download complete 2024-09-16T14:54:17.8083103Z 2024-09-16T14:52:51: 426c8112ec69: Verifying Checksum 2024-09-16T14:54:17.8083493Z 2024-09-16T14:52:51: 426c8112ec69: Download complete 2024-09-16T14:54:17.8083882Z 2024-09-16T14:52:51: b3494fb855b7: Verifying Checksum 2024-09-16T14:54:17.8084270Z 2024-09-16T14:52:51: b3494fb855b7: Download complete 2024-09-16T14:54:17.8084661Z 2024-09-16T14:52:51: 268a6e115509: Verifying Checksum 2024-09-16T14:54:17.8085049Z 2024-09-16T14:52:51: 268a6e115509: Download complete 2024-09-16T14:54:17.8085435Z 2024-09-16T14:52:51: 791daa6ac24e: Verifying Checksum 2024-09-16T14:54:17.8085915Z 2024-09-16T14:52:51: 791daa6ac24e: Download complete 2024-09-16T14:54:17.8086254Z 2024-09-16T14:52:51: e179b8530bb3: Verifying Checksum 2024-09-16T14:54:17.8086592Z 2024-09-16T14:52:51: e179b8530bb3: Download complete 2024-09-16T14:54:17.8087048Z 2024-09-16T14:52:52: 10fe4cf24d28: Verifying Checksum 2024-09-16T14:54:17.8087385Z 2024-09-16T14:52:52: 10fe4cf24d28: Download complete 2024-09-16T14:54:17.8087873Z 2024-09-16T14:52:52: aadcad350b29: Verifying Checksum 2024-09-16T14:54:17.8088222Z 2024-09-16T14:52:52: aadcad350b29: Download complete 2024-09-16T14:54:17.8088564Z 2024-09-16T14:52:52: b60c470e6c10: Verifying Checksum 2024-09-16T14:54:17.8088898Z 2024-09-16T14:52:52: b60c470e6c10: Download complete 2024-09-16T14:54:17.8089236Z 2024-09-16T14:52:52: e4dd6447d0ae: Verifying Checksum 2024-09-16T14:54:17.8089579Z 2024-09-16T14:52:52: e4dd6447d0ae: Download complete 2024-09-16T14:54:17.8089932Z 2024-09-16T14:52:52: c7256d5b9820: Verifying Checksum 2024-09-16T14:54:17.8090269Z 2024-09-16T14:52:52: c7256d5b9820: Download complete 2024-09-16T14:54:17.8090603Z 2024-09-16T14:52:52: 07b0081c9f5f: Verifying Checksum 2024-09-16T14:54:17.8090937Z 2024-09-16T14:52:52: 07b0081c9f5f: Download complete 2024-09-16T14:54:17.8091269Z 2024-09-16T14:52:52: a404e5416296: Pull complete 2024-09-16T14:54:17.8091592Z 2024-09-16T14:52:53: 0547551e4dad: Verifying Checksum 2024-09-16T14:54:17.8091933Z 2024-09-16T14:52:53: 0547551e4dad: Download complete 2024-09-16T14:54:17.8092258Z 2024-09-16T14:53:00: aadcad350b29: Pull complete 2024-09-16T14:54:17.8092582Z 2024-09-16T14:53:00: 18cf0ecbcc4c: Pull complete 2024-09-16T14:54:17.8092906Z 2024-09-16T14:53:00: d770ba5245d3: Pull complete 2024-09-16T14:54:17.8093231Z 2024-09-16T14:53:00: 516e284cb9f5: Pull complete 2024-09-16T14:54:17.8093554Z 2024-09-16T14:53:00: 426c8112ec69: Pull complete 2024-09-16T14:54:17.8093966Z 2024-09-16T14:53:00: b3494fb855b7: Pull complete 2024-09-16T14:54:17.8094291Z 2024-09-16T14:53:00: 268a6e115509: Pull complete 2024-09-16T14:54:17.8094616Z 2024-09-16T14:53:00: 791daa6ac24e: Pull complete 2024-09-16T14:54:17.8094939Z 2024-09-16T14:53:04: c7256d5b9820: Pull complete 2024-09-16T14:54:17.8095263Z 2024-09-16T14:53:04: e179b8530bb3: Pull complete 2024-09-16T14:54:17.8095590Z 2024-09-16T14:53:04: 10fe4cf24d28: Pull complete 2024-09-16T14:54:17.8095913Z 2024-09-16T14:53:14: 0547551e4dad: Pull complete 2024-09-16T14:54:17.8096233Z 2024-09-16T14:53:14: b60c470e6c10: Pull complete 2024-09-16T14:54:17.8096555Z 2024-09-16T14:53:14: e4dd6447d0ae: Pull complete 2024-09-16T14:54:17.8096877Z 2024-09-16T14:53:14: 07b0081c9f5f: Pull complete 2024-09-16T14:54:17.8097313Z 2024-09-16T14:53:14: Digest: sha256:8c113d05a2f905969214f272835844f2f59d03f131ed054c23ac2dafc2f0cb11 2024-09-16T14:54:17.8098010Z 2024-09-16T14:53:14: Status: Downloaded newer image for mcr.microsoft.com/azureml/lightgbm-3.2-ubuntu18.04-py37-cpu-inference:latest@sha256:8c113d05a2f905969214f272835844f2f59d03f131ed054c23ac2dafc2f0cb11 2024-09-16T14:54:17.8098476Z 2024-09-16T14:53:14: ---> 4f68225a06da 2024-09-16T14:54:17.8098784Z 2024-09-16T14:53:14: Step 2/17 : USER root 2024-09-16T14:54:17.8099109Z 2024-09-16T14:53:14: ---> Running in f3f745736b04 2024-09-16T14:54:17.8099466Z 2024-09-16T14:53:15: Removing intermediate container f3f745736b04 2024-09-16T14:54:17.8099780Z 2024-09-16T14:53:15: ---> 398e053a5229 2024-09-16T14:54:17.8100113Z 2024-09-16T14:53:15: Step 3/17 : RUN mkdir -p $HOME/.cache 2024-09-16T14:54:17.8100450Z 2024-09-16T14:53:15: ---> Running in 29c813fcd8f8 2024-09-16T14:54:17.8100807Z 2024-09-16T14:53:17: Removing intermediate container 29c813fcd8f8 2024-09-16T14:54:17.8101132Z 2024-09-16T14:53:17: ---> 352795afec7e 2024-09-16T14:54:17.8101436Z 2024-09-16T14:53:17: Step 4/17 : WORKDIR / 2024-09-16T14:54:17.8101762Z 2024-09-16T14:53:17: ---> Running in 2e3cd9f30cd0 2024-09-16T14:54:17.8102124Z 2024-09-16T14:53:18: Removing intermediate container 2e3cd9f30cd0 2024-09-16T14:54:17.8102445Z 2024-09-16T14:53:18: ---> ff97c3ad25c4 2024-09-16T14:54:17.8102843Z 2024-09-16T14:53:18: Step 5/17 : COPY azureml-environment-setup/99brokenproxy /etc/apt/apt.conf.d/ 2024-09-16T14:54:17.8103190Z 2024-09-16T14:53:19: ---> 6cd33e630efb 2024-09-16T14:54:17.8103686Z 2024-09-16T14:53:19: Step 6/17 : RUN if dpkg --compare-versions
2024-09-16T14:54:17.8146694Z docker_utilities._docker_build_or_error(
2024-09-16T14:54:17.8147055Z File "/mnt/azureml/cr/j/f9a3d6cc1e604562b2f01aebe4b291d7/exe/wd/docker_utilities.py", line 156, in _docker_build_or_error
2024-09-16T14:54:17.8147377Z _write_error_and_exit(error_msg, error_file_path=error_file_path)
2024-09-16T14:54:17.8147699Z File "/mnt/azureml/cr/j/f9a3d6cc1e604562b2f01aebe4b291d7/exe/wd/docker_utilities.py", line 217, in _write_error_and_exit
2024-09-16T14:54:17.8147959Z sys.exit(1)
2024-09-16T14:54:17.8148132Z SystemExit: 1
2024-09-16T14:54:17.8148202Z
2024-09-16T14:55:20.5956669Z /opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/jwt/utils.py:7: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2024-09-16T14:55:20.5957813Z from cryptography.hazmat.primitives.asymmetric.ec import EllipticCurve
2024-09-16T14:55:20.5959857Z /opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azureml/_cli/cli_command.py:11: FutureWarning: azureml.core: AzureML support for Python 3.6 is deprecated and will be dropped in an upcoming release. At that point, existing Python 3.6 workflows that use AzureML will continue to work without modification, but Python 3.6 users will no longer get access to the latest AzureML features and bugfixes. We recommend that you upgrade to Python 3.7 or newer. To disable SDK V1 deprecation warning set the environment variable AZUREML_DEPRECATE_WARNING to 'False'
2024-09-16T14:55:20.5960801Z from azureml.core import get_run
2024-09-16T14:55:20.5961627Z WARNING: Auto upgrade failed. name 'exit_code' is not defined
2024-09-16T14:55:20.6423823Z
2024-09-16T14:55:20.6424872Z Execution Summary
2024-09-16T14:55:20.6425473Z =================
2024-09-16T14:55:20.6425910Z RunId: insurance_classification_1726498047_47775b73
2024-09-16T14:55:20.6427178Z Web View: https://ml.azure.com/runs/insurance_classification_1726498047_47775b73?wsid=/subscriptions/71e511f6-a23a-426e-a272-a3fa9884509e/resourcegroups/mlops-test-rg-1/workspaces/mlops-test-aml-1&tid=66dc01f7-14e9-452c-90bc-1ce4a8b4f81b
2024-09-16T14:55:20.6427844Z Traceback (most recent call last):
2024-09-16T14:55:20.6428598Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azure/cli/core/commands/init.py", line 697, in _run_job
2024-09-16T14:55:20.6429121Z result = cmd_copy(params)
2024-09-16T14:55:20.6429739Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azure/cli/core/commands/init.py", line 333, in call
2024-09-16T14:55:20.6430183Z return self.handler( args, kwargs)
2024-09-16T14:55:20.6430824Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
2024-09-16T14:55:20.6431254Z return op(command_args)
2024-09-16T14:55:20.6431859Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azureml/_cli/cli_command.py", line 305, in command_wrapper
2024-09-16T14:55:20.6432320Z retval = function(*args, kwargs)
2024-09-16T14:55:20.6432916Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azureml/_cli/run/run_commands.py", line 542, in submit_run
2024-09-16T14:55:20.6433398Z run.wait_for_completion(show_output=True, wait_post_processing=True)
2024-09-16T14:55:20.6434040Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azureml/core/run.py", line 846, in wait_for_completion
2024-09-16T14:55:20.6434453Z raise_on_error=raise_on_error)
2024-09-16T14:55:20.6435076Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azureml/core/run.py", line 1096, in _stream_run_output
2024-09-16T14:55:20.6435527Z raise ActivityFailedException(error_details=json.dumps(error, indent=4))
2024-09-16T14:55:20.6436179Z azureml.exceptions._azureml_exception.ActivityFailedException: ActivityFailedException:
2024-09-16T14:55:20.6436581Z Message: Activity Failed:
2024-09-16T14:55:20.6436854Z {
2024-09-16T14:55:20.6437437Z "error": {
2024-09-16T14:55:20.6437718Z "code": "UserError",
2024-09-16T14:55:20.6438312Z "message": "Image build failed. For more details, check log file azureml-logs/20_image_build_log.txt.",
2024-09-16T14:55:20.6438790Z "messageFormat": "Image build failed. For more details, check log file {ArtifactPath}.",
2024-09-16T14:55:20.6439146Z "messageParameters": {
2024-09-16T14:55:20.6439600Z "ArtifactPath": "azureml-logs/20_image_build_log.txt"
2024-09-16T14:55:20.6439926Z },
2024-09-16T14:55:20.6440231Z "details": [],
2024-09-16T14:55:20.6440525Z "innerError": {
2024-09-16T14:55:20.6440811Z "code": "BadArgument",
2024-09-16T14:55:20.6441131Z "innerError": {
2024-09-16T14:55:20.6441429Z "code": "ImageBuildFailure"
2024-09-16T14:55:20.6441739Z }
2024-09-16T14:55:20.6441988Z }
2024-09-16T14:55:20.6442271Z },
2024-09-16T14:55:20.6442558Z "correlation": {
2024-09-16T14:55:20.6442884Z "operation": "db4feb974143cbcc7d39edb57d97ae69",
2024-09-16T14:55:20.6443233Z "request": "1ce7931a0ccf2b28"
2024-09-16T14:55:20.6443543Z },
2024-09-16T14:55:20.6443832Z "environment": "eastus",
2024-09-16T14:55:20.6444125Z "location": "eastus",
2024-09-16T14:55:20.6444609Z "time": "2024-09-16T14:55:03.847546Z",
2024-09-16T14:55:20.6444940Z "componentName": "RunHistory"
2024-09-16T14:55:20.6445247Z }
2024-09-16T14:55:20.6445514Z InnerException None
2024-09-16T14:55:20.6445811Z ErrorResponse
2024-09-16T14:55:20.6446259Z {
2024-09-16T14:55:20.6446524Z "error": {
2024-09-16T14:55:20.6448713Z "message": "Activity Failed:\n{\n \"error\": {\n \"code\": \"UserError\",\n \"message\": \"Image build failed. For more details, check log file azureml-logs/20_image_build_log.txt.\",\n \"messageFormat\": \"Image build failed. For more details, check log file {ArtifactPath}.\",\n \"messageParameters\": {\n \"ArtifactPath\": \"azureml-logs/20_image_build_log.txt\"\n },\n \"details\": [],\n \"innerError\": {\n \"code\": \"BadArgument\",\n \"innerError\": {\n \"code\": \"ImageBuildFailure\"\n }\n }\n },\n \"correlation\": {\n \"operation\": \"db4feb974143cbcc7d39edb57d97ae69\",\n \"request\": \"1ce7931a0ccf2b28\"\n },\n \"environment\": \"eastus\",\n \"location\": \"eastus\",\n \"time\": \"2024-09-16T14:55:03.847546Z\",\n \"componentName\": \"RunHistory\"\n}"
2024-09-16T14:55:20.6449878Z }
2024-09-16T14:55:20.6450146Z }
2024-09-16T14:55:20.6450295Z
2024-09-16T14:55:20.6450627Z During handling of the above exception, another exception occurred:
2024-09-16T14:55:20.6450846Z
2024-09-16T14:55:20.6451139Z Traceback (most recent call last):
2024-09-16T14:55:20.6451716Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/knack/cli.py", line 233, in invoke
2024-09-16T14:55:20.6452145Z cmd_result = self.invocation.execute(args)
2024-09-16T14:55:20.6452771Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azure/cli/core/commands/init.py", line 663, in execute
2024-09-16T14:55:20.6453178Z raise ex
2024-09-16T14:55:20.6453788Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azure/cli/core/commands/init.py", line 726, in _run_jobs_serially
2024-09-16T14:55:20.6454375Z results.append(self._run_job(expanded_arg, cmd_copy))
2024-09-16T14:55:20.6455033Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azure/cli/core/commands/init.py", line 718, in _run_job
2024-09-16T14:55:20.6455481Z return cmd_copy.exception_handler(ex)
2024-09-16T14:55:20.6456151Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azureml/_base_sdk_common/cli_wrapper/_common.py", line 98, in cli_exception_handler
2024-09-16T14:55:20.6456611Z raise CLIError(ex)
2024-09-16T14:55:20.6456953Z knack.util.CLIError: ActivityFailedException:
2024-09-16T14:55:20.6457396Z Message: Activity Failed:
2024-09-16T14:55:20.6457685Z {
2024-09-16T14:55:20.6457954Z "error": {
2024-09-16T14:55:20.6458234Z "code": "UserError",
2024-09-16T14:55:20.6458806Z "message": "Image build failed. For more details, check log file azureml-logs/20_image_build_log.txt.",
2024-09-16T14:55:20.6459277Z "messageFormat": "Image build failed. For more details, check log file {ArtifactPath}.",
2024-09-16T14:55:20.6459633Z "messageParameters": {
2024-09-16T14:55:20.6460098Z "ArtifactPath": "azureml-logs/20_image_build_log.txt"
2024-09-16T14:55:20.6460426Z },
2024-09-16T14:55:20.6460708Z "details": [],
2024-09-16T14:55:20.6461109Z "innerError": {
2024-09-16T14:55:20.6461376Z "code": "BadArgument",
2024-09-16T14:55:20.6461645Z "innerError": {
2024-09-16T14:55:20.6461902Z "code": "ImageBuildFailure"
2024-09-16T14:55:20.6462174Z }
2024-09-16T14:55:20.6462408Z }
2024-09-16T14:55:20.6462638Z },
2024-09-16T14:55:20.6462888Z "correlation": {
2024-09-16T14:55:20.6463166Z "operation": "db4feb974143cbcc7d39edb57d97ae69",
2024-09-16T14:55:20.6463486Z "request": "1ce7931a0ccf2b28"
2024-09-16T14:55:20.6463742Z },
2024-09-16T14:55:20.6463996Z "environment": "eastus",
2024-09-16T14:55:20.6464267Z "location": "eastus",
2024-09-16T14:55:20.6464641Z "time": "2024-09-16T14:55:03.847546Z",
2024-09-16T14:55:20.6464928Z "componentName": "RunHistory"
2024-09-16T14:55:20.6465278Z }
2024-09-16T14:55:20.6465527Z InnerException None
2024-09-16T14:55:20.6465770Z ErrorResponse
2024-09-16T14:55:20.6466029Z {
2024-09-16T14:55:20.6466261Z "error": {
2024-09-16T14:55:20.6468163Z "message": "Activity Failed:\n{\n \"error\": {\n \"code\": \"UserError\",\n \"message\": \"Image build failed. For more details, check log file azureml-logs/20_image_build_log.txt.\",\n \"messageFormat\": \"Image build failed. For more details, check log file {ArtifactPath}.\",\n \"messageParameters\": {\n \"ArtifactPath\": \"azureml-logs/20_image_build_log.txt\"\n },\n \"details\": [],\n \"innerError\": {\n \"code\": \"BadArgument\",\n \"innerError\": {\n \"code\": \"ImageBuildFailure\"\n }\n }\n },\n \"correlation\": {\n \"operation\": \"db4feb974143cbcc7d39edb57d97ae69\",\n \"request\": \"1ce7931a0ccf2b28\"\n },\n \"environment\": \"eastus\",\n \"location\": \"eastus\",\n \"time\": \"2024-09-16T14:55:03.847546Z\",\n \"componentName\": \"RunHistory\"\n}"
2024-09-16T14:55:20.6469192Z }
2024-09-16T14:55:20.6469431Z }
2024-09-16T14:55:20.6469561Z
2024-09-16T14:55:20.6469868Z During handling of the above exception, another exception occurred:
2024-09-16T14:55:20.6470057Z
2024-09-16T14:55:20.6470297Z Traceback (most recent call last):
2024-09-16T14:55:20.6470672Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/runpy.py", line 193, in _run_module_as_main
2024-09-16T14:55:20.6471023Z "main", mod_spec)
2024-09-16T14:55:20.6471341Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/runpy.py", line 85, in _run_code
2024-09-16T14:55:20.6471683Z exec(code, run_globals)
2024-09-16T14:55:20.6472171Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azure/cli/main.py", line 48, in
2024-09-16T14:55:20.6472557Z exit_code = cli_main(az_cli, sys.argv[1:])
2024-09-16T14:55:20.6473070Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azure/cli/main.py", line 35, in cli_main
2024-09-16T14:55:20.6473420Z return cli.invoke(args)
2024-09-16T14:55:20.6473887Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/knack/cli.py", line 245, in invoke
2024-09-16T14:55:20.6474265Z exit_code = self.exception_handler(ex)
2024-09-16T14:55:20.6474805Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azure/cli/core/init.py", line 135, in exception_handler
2024-09-16T14:55:20.6475255Z return handle_exception(ex)
2024-09-16T14:55:20.6476866Z File "/opt/hostedtoolcache/Python/3.6.15/x64/lib/python3.6/site-packages/azure/cli/core/util.py", line 64, in handle_exception
2024-09-16T14:55:20.6477219Z from msal_extensions.persistence import PersistenceError
2024-09-16T14:55:20.6477563Z ImportError: cannot import name 'PersistenceError'
2024-09-16T14:55:20.9583145Z
2024-09-16T14:55:20.9603682Z ##[error]Script failed with exit code: 1
2024-09-16T14:55:20.9606893Z [command]/opt/hostedtoolcache/Python/3.6.15/x64/bin/az account clear
2024-09-16T14:55:21.2649632Z ##[section]Finishing: Training Model
conda --version | grep -oE '[^ ]+$'lt 4.4.11; then conda install conda==4.4.11; fi 2024-09-16T14:54:17.8104165Z 2024-09-16T14:53:19: ---> Running in cfd491506e93 2024-09-16T14:54:17.8104521Z 2024-09-16T14:53:21: Removing intermediate container cfd491506e93 2024-09-16T14:54:17.8104851Z 2024-09-16T14:53:21: ---> 5913e66065a9 2024-09-16T14:54:17.8105355Z 2024-09-16T14:53:21: Step 7/17 : COPY azureml-environment-setup/mutated_conda_dependencies.yml azureml-environment-setup/mutated_conda_dependencies.yml 2024-09-16T14:54:17.8105753Z 2024-09-16T14:53:22: ---> 43915c86df00 2024-09-16T14:54:17.8106695Z 2024-09-16T14:53:22: Step 8/17 : RUN ldconfig /usr/local/cuda/lib64/stubs && conda env create -p /azureml-envs/azureml_6b839dc49ef134e2f2b24646b3fdad9b -f azureml-environment-setup/mutated_conda_dependencies.yml && rm -rf "$HOME/.cache/pip" && conda clean -aqy && CONDA_ROOT_DIR=$(conda info --root) && rm -rf "$CONDA_ROOT_DIR/pkgs" && find "$CONDA_ROOT_DIR" -type d -name pycache -exec rm -rf {} + && ldconfig 2024-09-16T14:54:17.8107326Z 2024-09-16T14:53:22: ---> Running in a3915151b6a4 2024-09-16T14:54:17.8107717Z 2024-09-16T14:53:30: Collecting package metadata (repodata.json): ...working... done 2024-09-16T14:54:17.8108095Z 2024-09-16T14:53:30: Solving environment: ...working... done 2024-09-16T14:54:17.8108392Z 2024-09-16T14:53:30: [91m 2024-09-16T14:54:17.8108481Z 2024-09-16T14:54:17.8108801Z 2024-09-16T14:53:30: ==> WARNING: A newer version of conda exists. <== 2024-09-16T14:54:17.8109139Z 2024-09-16T14:53:30: current version: 4.11.0 2024-09-16T14:54:17.8109529Z 2024-09-16T14:53:30: latest version: 24.7.1 2024-09-16T14:54:17.8109649Z 2024-09-16T14:54:17.8109913Z 2024-09-16T14:53:30: Please update conda by running 2024-09-16T14:54:17.8110037Z 2024-09-16T14:54:17.8110334Z 2024-09-16T14:53:30: $ conda update -n base -c defaults conda 2024-09-16T14:54:17.8110449Z 2024-09-16T14:54:17.8110505Z 2024-09-16T14:54:17.8110736Z 2024-09-16T14:53:30: [0m 2024-09-16T14:54:17.8111053Z 2024-09-16T14:53:30: Downloading and Extracting Packages 2024-09-16T14:54:17.8111431Z 2024-09-16T14:53:30: sqlite-3.45.3 | 1.2 MB | ########## | 100% 2024-09-16T14:54:17.8111791Z 2024-09-16T14:53:30: xz-5.4.6 | 643 KB | ########## | 100% 2024-09-16T14:54:17.8112152Z 2024-09-16T14:53:30: certifi-2022.12.7 | 150 KB | ########## | 100% 2024-09-16T14:54:17.8112517Z 2024-09-16T14:53:30: libstdcxx-ng-11.2.0 | 4.7 MB | ########## | 100% 2024-09-16T14:54:17.8112881Z 2024-09-16T14:53:31: setuptools-65.6.3 | 1.1 MB | ########## | 100% 2024-09-16T14:54:17.8113254Z 2024-09-16T14:53:31: _openmp_mutex-5.1 | 21 KB | ########## | 100% 2024-09-16T14:54:17.8113610Z 2024-09-16T14:53:31: wheel-0.38.4 | 63 KB | ########## | 100% 2024-09-16T14:54:17.8113969Z 2024-09-16T14:53:31: ca-certificates-2024 | 127 KB | ########## | 100% 2024-09-16T14:54:17.8114331Z 2024-09-16T14:53:31: pip-20.2.4 | 1.7 MB | ########## | 100% 2024-09-16T14:54:17.8114687Z 2024-09-16T14:53:31: libgcc-ng-11.2.0 | 5.3 MB | ########## | 100% 2024-09-16T14:54:17.8115045Z 2024-09-16T14:53:31: libgomp-11.2.0 | 474 KB | ########## | 100% 2024-09-16T14:54:17.8115399Z 2024-09-16T14:53:31: readline-8.2 | 357 KB | ########## | 100% 2024-09-16T14:54:17.8116078Z 2024-09-16T14:53:31: _libgcc_mutex-0.1 | 3 KB | ########## | 100% 2024-09-16T14:54:17.8116445Z 2024-09-16T14:53:31: zlib-1.2.13 | 111 KB | ########## | 100% 2024-09-16T14:54:17.8116814Z 2024-09-16T14:53:31: openssl-1.1.1w | 3.7 MB | ########## | 100% 2024-09-16T14:54:17.8117183Z 2024-09-16T14:53:31: ncurses-6.4 | 914 KB | ########## | 100% 2024-09-16T14:54:17.8117544Z 2024-09-16T14:53:31: ld_impl_linux-64-2.3 | 654 KB | ########## | 100% 2024-09-16T14:54:17.8117904Z 2024-09-16T14:53:32: python-3.7.16 | 44.8 MB | ########## | 100% 2024-09-16T14:54:17.8118265Z 2024-09-16T14:53:32: libffi-3.4.4 | 141 KB | ########## | 100% 2024-09-16T14:54:17.8118714Z 2024-09-16T14:53:32: tk-8.6.14 | 3.4 MB | ########## | 100% 2024-09-16T14:54:17.8119065Z 2024-09-16T14:53:33: Preparing transaction: ...working... done 2024-09-16T14:54:17.8119428Z 2024-09-16T14:53:33: Verifying transaction: ...working... done 2024-09-16T14:54:17.8119787Z 2024-09-16T14:53:34: Executing transaction: ...working... done 2024-09-16T14:54:17.8120203Z 2024-09-16T14:53:42: Installing pip dependencies: ...working... [91mPip subprocess error: 2024-09-16T14:54:17.8121351Z 2024-09-16T14:53:42: ERROR: Could not find a version that satisfies the requirement azureml-inference-server-http~=1.3 (from azureml-defaults->-r /azureml-environment-setup/condaenv.bonmruq8.requirements.txt (line 2)) (from versions: 0.1.5, 0.1.9, 0.1.10, 0.2.0, 0.3.0, 0.3.1, 0.3.2, 0.4.0, 0.4.1, 0.4.2, 0.4.9, 0.4.10, 0.4.11, 0.4.13, 0.4.14, 0.5.0, 0.5.1, 0.5.2, 0.5.3, 0.5.4, 0.6.0, 0.6.1, 0.7.1, 0.7.2, 0.7.3, 0.7.4, 0.7.5, 0.7.6, 0.7.7, 0.8.0, 0.8.1, 0.8.2, 0.8.3, 0.8.4, 0.8.4.1, 0.8.4.2) 2024-09-16T14:54:17.8122307Z 2024-09-16T14:53:42: ERROR: No matching distribution found for azureml-inference-server-http~=1.3 (from azureml-defaults->-r /azureml-environment-setup/condaenv.bonmruq8.requirements.txt (line 2)) 2024-09-16T14:54:17.8122538Z 2024-09-16T14:54:17.8122838Z 2024-09-16T14:53:42: [0mRan pip subprocess with arguments: 2024-09-16T14:54:17.8123428Z 2024-09-16T14:53:42: ['/azureml-envs/azureml_6b839dc49ef134e2f2b24646b3fdad9b/bin/python', '-m', 'pip', 'install', '-U', '-r', '/azureml-environment-setup/condaenv.bonmruq8.requirements.txt'] 2024-09-16T14:54:17.8123868Z 2024-09-16T14:53:42: Pip subprocess output: 2024-09-16T14:54:17.8124261Z 2024-09-16T14:53:42: Collecting azureml-sdk 2024-09-16T14:54:17.8124646Z 2024-09-16T14:53:42: Downloading azureml_sdk-1.55.0-py3-none-any.whl (2.7 kB) 2024-09-16T14:54:17.8125003Z 2024-09-16T14:53:42: Collecting azureml-defaults 2024-09-16T14:54:17.8125411Z 2024-09-16T14:53:42: Downloading azureml_defaults-1.57.0.post1-py3-none-any.whl (2.0 kB) 2024-09-16T14:54:17.8125764Z 2024-09-16T14:53:42: Collecting scikit-learn 2024-09-16T14:54:17.8126228Z 2024-09-16T14:53:42: Downloading scikit_learn-1.0.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (24.8 MB) 2024-09-16T14:54:17.8126642Z 2024-09-16T14:53:42: Collecting inference-schema[numpy-support] 2024-09-16T14:54:17.8127040Z 2024-09-16T14:53:42: Downloading inference_schema-1.7-py3-none-any.whl (21 kB) 2024-09-16T14:54:17.8127403Z 2024-09-16T14:53:42: Collecting azure-storage-blob 2024-09-16T14:54:17.8127803Z 2024-09-16T14:53:42: Downloading azure_storage_blob-12.19.1-py3-none-any.whl (394 kB) 2024-09-16T14:54:17.8128150Z 2024-09-16T14:53:42: Collecting lightgbm 2024-09-16T14:54:17.8128517Z 2024-09-16T14:53:42: Downloading lightgbm-4.5.0.tar.gz (1.7 MB) 2024-09-16T14:54:17.8128881Z 2024-09-16T14:53:42: Installing build dependencies: started 2024-09-16T14:54:17.8129270Z 2024-09-16T14:53:42: Installing build dependencies: finished with status 'done' 2024-09-16T14:54:17.8129649Z 2024-09-16T14:53:42: Getting requirements to build wheel: started 2024-09-16T14:54:17.8130056Z 2024-09-16T14:53:42: Getting requirements to build wheel: finished with status 'done' 2024-09-16T14:54:17.8130440Z 2024-09-16T14:53:42: Installing backend dependencies: started 2024-09-16T14:54:17.8130832Z 2024-09-16T14:53:42: Installing backend dependencies: finished with status 'done' 2024-09-16T14:54:17.8131198Z 2024-09-16T14:53:42: Preparing wheel metadata: started 2024-09-16T14:54:17.8131576Z 2024-09-16T14:53:42: Preparing wheel metadata: finished with status 'done' 2024-09-16T14:54:17.8131908Z 2024-09-16T14:53:42: Collecting joblib 2024-09-16T14:54:17.8132258Z 2024-09-16T14:53:42: Downloading joblib-1.3.2-py3-none-any.whl (302 kB) 2024-09-16T14:54:17.8132602Z 2024-09-16T14:53:42: Collecting pandas==1.1.3 2024-09-16T14:54:17.8133003Z 2024-09-16T14:53:42: Downloading pandas-1.1.3-cp37-cp37m-manylinux1_x86_64.whl (9.5 MB) 2024-09-16T14:54:17.8133402Z 2024-09-16T14:53:42: Collecting azureml-train-automl-client~=1.55.0 2024-09-16T14:54:17.8133909Z 2024-09-16T14:53:42: Downloading azureml_train_automl_client-1.55.0.post1-py3-none-any.whl (137 kB) 2024-09-16T14:54:17.8134295Z 2024-09-16T14:53:42: Collecting azureml-core~=1.55.0 2024-09-16T14:54:17.8134693Z 2024-09-16T14:53:42: Downloading azureml_core-1.55.0.post2-py3-none-any.whl (3.3 MB) 2024-09-16T14:54:17.8135070Z 2024-09-16T14:53:42: Collecting azureml-pipeline~=1.55.0 2024-09-16T14:54:17.8135472Z 2024-09-16T14:53:42: Downloading azureml_pipeline-1.55.0-py3-none-any.whl (2.4 kB) 2024-09-16T14:54:17.8135895Z 2024-09-16T14:53:42: Collecting azureml-dataset-runtime[fuse]~=1.55.0 2024-09-16T14:54:17.8136331Z 2024-09-16T14:53:42: Downloading azureml_dataset_runtime-1.55.0-py3-none-any.whl (2.3 kB) 2024-09-16T14:54:17.8136712Z 2024-09-16T14:53:42: Collecting azureml-train-core~=1.55.0 2024-09-16T14:54:17.8137110Z 2024-09-16T14:53:42: Downloading azureml_train_core-1.55.0-py3-none-any.whl (8.6 MB) 2024-09-16T14:54:17.8137248Z 2024-09-16T14:54:17.8137486Z 2024-09-16T14:53:42: failed 2024-09-16T14:54:17.8137759Z 2024-09-16T14:53:42: [91m 2024-09-16T14:54:17.8138073Z 2024-09-16T14:53:42: CondaEnvException: Pip failed 2024-09-16T14:54:17.8138181Z 2024-09-16T14:54:17.8139133Z 2024-09-16T14:53:46: The command '/bin/sh -c ldconfig /usr/local/cuda/lib64/stubs && conda env create -p /azureml-envs/azureml_6b839dc49ef134e2f2b24646b3fdad9b -f azureml-environment-setup/mutated_conda_dependencies.yml && rm -rf "$HOME/.cache/pip" && conda clean -aqy && CONDA_ROOT_DIR=$(conda info --root) && rm -rf "$CONDA_ROOT_DIR/pkgs" && find "$CONDA_ROOT_DIR" -type d -name pycache -exec rm -rf {} + && ldconfig' returned a non-zero code: 1 2024-09-16T14:54:17.8139629Z 2024-09-16T14:54:17.8139868Z 2024-09-16T14:53:46: [0m 2024-09-16T14:54:17.8139956Z 2024-09-16T14:54:17.8140673Z 2024-09-16T14:53:46: CalledProcessError(1, ['docker', 'build', '-f', 'azureml-environment-setup/Dockerfile', '.', '-t', 'mlopstest1amlcr.azurecr.io/azureml/azureml_7a41b39b23b7d6edf44ec05ac079bd4f', '-t', 'mlopstest1amlcr.azurecr.io/azureml/azureml_7a41b39b23b7d6edf44ec05ac079bd4f:3']) 2024-09-16T14:54:17.8141011Z 2024-09-16T14:54:17.8141302Z 2024-09-16T14:53:46: Building docker image failed with exit code: 1 2024-09-16T14:54:17.8141438Z 2024-09-16T14:54:17.8141760Z 2024-09-16T14:53:46: Logging out of Docker registry: mlopstest1amlcr.azurecr.io 2024-09-16T14:54:17.8142165Z 2024-09-16T14:53:46: Removing login credentials for https://index.docker.io/v1/ 2024-09-16T14:54:17.8142294Z 2024-09-16T14:54:17.8142350Z 2024-09-16T14:54:17.8142642Z 2024-09-16T14:53:46: Traceback (most recent call last): 2024-09-16T14:54:17.8142964Z File "/mnt/azureml/cr/j/f9a3d6cc1e604562b2f01aebe4b291d7/exe/wd/docker_utilities.py", line 152, in _docker_build_or_error 2024-09-16T14:54:17.8143297Z docker_execute_function(docker_command, build_command, print_command_args=True) 2024-09-16T14:54:17.8143625Z File "/mnt/azureml/cr/j/f9a3d6cc1e604562b2f01aebe4b291d7/exe/wd/docker_utilities.py", line 23, in docker_execute_function 2024-09-16T14:54:17.8143944Z return killable_subprocess.check_call(command_args, popen_args, 2024-09-16T14:54:17.8144255Z File "/mnt/azureml/cr/j/f9a3d6cc1e604562b2f01aebe4b291d7/exe/wd/killable_subprocess.py", line 261, in check_call 2024-09-16T14:54:17.8144559Z raise subprocess.CalledProcessError(process.returncode, cmd) 2024-09-16T14:54:17.8145381Z subprocess.CalledProcessError: Command '['docker', 'build', '-f', 'azureml-environment-setup/Dockerfile', '.', '-t', 'mlopstest1amlcr.azurecr.io/azureml/azureml_7a41b39b23b7d6edf44ec05ac079bd4f', '-t', 'mlopstest1amlcr.azurecr.io/azureml/azureml_7a41b39b23b7d6edf44ec05ac079bd4f:3']' returned non-zero exit status 1. 2024-09-16T14:54:17.8145736Z 2024-09-16T14:54:17.8145951Z During handling of the above exception, another exception occurred: 2024-09-16T14:54:17.8146071Z 2024-09-16T14:54:17.8146250Z Traceback (most recent call last): 2024-09-16T14:54:17.8146466Z File "script.py", line 110, in