search

MicrosoftDocs / azure-docs

Open source documentation of Microsoft Azure
https://docs.microsoft.com/azure
Creative Commons Attribution 4.0 International
10.12k stars 21.19k forks source link

Registry reference for environments is not supported for K8SDeployment #110475

Open adriantorrie opened 1 year ago

adriantorrie commented 1 year ago

[Enter feedback here]

Original error from Azure DevOps build agent

2023-06-05T11:06:42.4825109Z ##[section]Starting: az_ml_online_deployment_create_or_update
2023-06-05T11:06:42.4831228Z ==============================================================================
2023-06-05T11:06:42.4831459Z Task         : Azure CLI
2023-06-05T11:06:42.4831606Z Description  : Run Azure CLI commands against an Azure subscription in a PowerShell Core/Shell script when running on Linux agent or PowerShell/PowerShell Core/Batch script when running on Windows agent.
2023-06-05T11:06:42.4832102Z Version      : 2.220.0
2023-06-05T11:06:42.4832229Z Author       : Microsoft Corporation
2023-06-05T11:06:42.4832389Z Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/deploy/azure-cli
2023-06-05T11:06:42.4832611Z ==============================================================================
2023-06-05T11:06:42.7924667Z [command]/usr/bin/az --version
2023-06-05T11:06:43.5091033Z azure-cli                         2.48.1 *
2023-06-05T11:06:43.5091675Z 
2023-06-05T11:06:43.5092272Z core                              2.48.1 *
2023-06-05T11:06:43.5093096Z telemetry                          1.0.8
2023-06-05T11:06:43.5095290Z 
2023-06-05T11:06:43.5095819Z Extensions:
2023-06-05T11:06:43.5096447Z azure-devops                      0.26.0
2023-06-05T11:06:43.5142844Z WARNING: You have 2 update(s) available. Consider updating your CLI installation with 'az upgrade'
2023-06-05T11:06:43.5143411Z ml                                2.17.2
2023-06-05T11:06:43.5143850Z 
2023-06-05T11:06:43.5144385Z Dependencies:
2023-06-05T11:06:43.5144966Z msal                              1.20.0
2023-06-05T11:06:43.5145719Z azure-mgmt-resource               22.0.0
2023-06-05T11:06:43.5146039Z 
2023-06-05T11:06:43.5146674Z Python location '/opt/az/bin/python3'
2023-06-05T11:06:43.5147330Z Extensions directory '/opt/az/azcliextensions'
2023-06-05T11:06:43.5147627Z 
2023-06-05T11:06:43.5221807Z Python (Linux) 3.10.10 (main, Apr 25 2023, 04:23:10) [GCC 11.3.0]
2023-06-05T11:06:43.5222070Z 
2023-06-05T11:06:43.5222428Z Legal docs and information: aka.ms/AzureCliLegal
2023-06-05T11:06:43.5222633Z 
2023-06-05T11:06:43.5222746Z 
2023-06-05T11:06:43.5224686Z Setting AZURE_CONFIG_DIR env variable to: /home/vsts/work/_temp/.azclitask
2023-06-05T11:06:43.5225943Z Setting active cloud to: AzureCloud
2023-06-05T11:06:43.5233194Z [command]/usr/bin/az cloud set -n AzureCloud
2023-06-05T11:06:43.8440135Z [command]/usr/bin/az login --service-principal -u *** --password=*** --tenant *** --allow-no-subscriptions
2023-06-05T11:06:44.6610254Z [
2023-06-05T11:06:44.6611070Z   {
2023-06-05T11:06:44.6611591Z     "cloudName": "***",
2023-06-05T11:06:44.6612544Z     "homeTenantId": "***",,
2023-06-05T11:06:44.6613267Z     "id": "***",,
2023-06-05T11:06:44.6613811Z     "isDefault": true,
2023-06-05T11:06:44.6614341Z     "managedByTenants": [
2023-06-05T11:06:44.6614978Z       {
2023-06-05T11:06:44.6615603Z         "tenantId": "***",
2023-06-05T11:06:44.6616097Z       }
2023-06-05T11:06:44.6616508Z     ],
2023-06-05T11:06:44.6617012Z     "name": "***",,
2023-06-05T11:06:44.6617487Z     "state": "Enabled",
2023-06-05T11:06:44.6618092Z     "tenantId": "***",
2023-06-05T11:06:44.6618583Z     "user": {
2023-06-05T11:06:44.6619267Z       "name": "***",
2023-06-05T11:06:44.6619743Z       "type": "servicePrincipal"
2023-06-05T11:06:44.6620194Z     }
2023-06-05T11:06:44.6620599Z   },
2023-06-05T11:06:44.6621009Z   {
2023-06-05T11:06:44.6621437Z     "cloudName": "***",,
2023-06-05T11:06:44.6622069Z     "homeTenantId": "***",,
2023-06-05T11:06:44.6622707Z     "id": "***",
2023-06-05T11:06:44.6623209Z     "isDefault": false,
2023-06-05T11:06:44.6623661Z     "managedByTenants": [
2023-06-05T11:06:44.6624097Z       {
2023-06-05T11:06:44.6624693Z         "tenantId": "***",
2023-06-05T11:06:44.6625171Z       }
2023-06-05T11:06:44.6625976Z     ],
2023-06-05T11:06:44.6626508Z     "name": "***",
2023-06-05T11:06:44.6626983Z     "state": "Enabled",
2023-06-05T11:06:44.6627581Z     "tenantId": "***",,
2023-06-05T11:06:44.6628081Z     "user": {
2023-06-05T11:06:44.6628688Z       "name": "***",
2023-06-05T11:06:44.6629169Z       "type": "servicePrincipal"
2023-06-05T11:06:44.6629761Z     }
2023-06-05T11:06:44.6630162Z   }
2023-06-05T11:06:44.6630558Z ]
2023-06-05T11:06:44.6641582Z [command]/usr/bin/az account set --subscription ***
2023-06-05T11:06:45.0144693Z [command]/usr/bin/bash /home/vsts/work/_temp/azureclitaskscript1685963202781.sh
2023-06-05T11:06:45.0205503Z + az ml online-deployment list --endpoint-name *** --resource-group *** --workspace-name *** --subscription *** -o table
2023-06-05T11:06:47.4084739Z 
2023-06-05T11:06:47.7687476Z ++ az ml online-deployment list --endpoint-name *** -o tsv --query '[?name=='\''blue'\''][name]' --resource-group *** --workspace-name *** --subscription ***
2023-06-05T11:06:47.7692628Z ++ wc -l
2023-06-05T11:06:50.1940548Z + deployment_exists=0
2023-06-05T11:06:50.1942238Z + echo 'Deployment exists for Endpoint: ***'
2023-06-05T11:06:50.1943051Z + echo 'Exists: 0'
2023-06-05T11:06:50.1943807Z + cat src/assets/online_deployment_kubernetes.yml
2023-06-05T11:06:50.1944596Z Deployment exists for Endpoint: ***
2023-06-05T11:06:50.1945203Z Exists: 0
2023-06-05T11:06:50.1955789Z # Purpose
2023-06-05T11:06:50.1956546Z # -------
2023-06-05T11:06:50.1957145Z # Deploy to an ARC joined Kubernetes cluster
2023-06-05T11:06:50.1957875Z #
2023-06-05T11:06:50.1958848Z # Notes
2023-06-05T11:06:50.1959326Z # -----
2023-06-05T11:06:50.1959745Z # - Do NOT modify the DevOps Standards section
2023-06-05T11:06:50.1960289Z # - DevOps pipelines will modify this file and create the deployment
2023-06-05T11:06:50.1960841Z # - Expects the DevOps pipeline has created the ARC kubernetes endpoint
2023-06-05T11:06:50.1961382Z # - Expects the DevOps pipeline has created the shared environment
2023-06-05T11:06:50.1961893Z # - Expects that DevOps pipeline has registered the model in the shared
2023-06-05T11:06:50.1962272Z #   registry
2023-06-05T11:06:50.1962734Z # - Deployment name: max 32 characters, only letters/numbers/hyphens
2023-06-05T11:06:50.1963275Z # - Endpoint name: max 32 characters, only letters/numbers/hyphens
2023-06-05T11:06:50.1963959Z # - For MLFlow model deployment, the resource request require at least
2023-06-05T11:06:50.1964393Z #   2 CPU and 4 GB memory, otherwise the deployment will fail
2023-06-05T11:06:50.1964927Z # - Instance types are available from Platform Team, resource requests
2023-06-05T11:06:50.1965409Z #   and limits cannot exceed the instance type resources
2023-06-05T11:06:50.1965772Z #
2023-06-05T11:06:50.1966044Z # References
2023-06-05T11:06:50.1966363Z # ----------
2023-06-05T11:06:50.1966868Z # - Azure ML: CLI (v2) Azure Arc-enabled Kubernetes online deployment YAML schema
2023-06-05T11:06:50.1967541Z #   - https://learn.microsoft.com/en-us/azure/machine-learning/reference-yaml-deployment-kubernetes-online?view=azureml-api-2
2023-06-05T11:06:50.1968090Z # - Azure ML: Resource section validation
2023-06-05T11:06:50.1969069Z #   - https://learn.microsoft.com/en-us/azure/machine-learning/how-to-manage-kubernetes-instance-types?view=azureml-api-2&tabs=select-instancetype-to-trainingjob-with-cli%2Cselect-instancetype-to-modeldeployment-with-cli%2Cdefine-resource-to-modeldeployment-with-sdk#resource-section-validation
2023-06-05T11:06:50.1969910Z # - Azure ML: Deploy model from registry to online endpoint in workspace
2023-06-05T11:06:50.1970750Z #   - https://learn.microsoft.com/en-us/azure/machine-learning/how-to-share-models-pipelines-across-workspaces-with-registries?view=azureml-api-2&tabs=cli#deploy-model-from-registry-to-online-endpoint-in-workspace
2023-06-05T11:06:50.1971381Z # - Azure ML: Deployment name rules
2023-06-05T11:06:50.1972057Z #   - https://learn.microsoft.com/en-us/azure/machine-learning/how-to-manage-quotas?view=azureml-api-2#azure-machine-learning-managed-online-endpoints
2023-06-05T11:06:50.1972941Z # - Azure ML: Create and manage isntance types
2023-06-05T11:06:50.1973863Z #   - https://learn.microsoft.com/en-us/azure/machine-learning/how-to-manage-kubernetes-instance-types?view=azureml-api-2&tabs=select-instancetype-to-trainingjob-with-cli%2Cselect-instancetype-to-modeldeployment-with-cli%2Cdefine-resource-to-modeldeployment-with-cli
2023-06-05T11:06:50.1974671Z # - Azure ML: Scale settings for target utilisation
2023-06-05T11:06:50.1975357Z #   - https://learn.microsoft.com/en-us/azure/machine-learning/reference-yaml-deployment-kubernetes-online?view=azureml-api-2#targetutilizationscalesettings
2023-06-05T11:06:50.1975954Z # - Azure ML: Container resource requests
2023-06-05T11:06:50.1976726Z #   - https://learn.microsoft.com/en-us/azure/machine-learning/reference-yaml-deployment-kubernetes-online?view=azureml-api-2#containerresourcerequests
2023-06-05T11:06:50.1977304Z # - Azure ML: Container resource limits
2023-06-05T11:06:50.1977968Z #   - https://learn.microsoft.com/en-us/azure/machine-learning/reference-yaml-deployment-kubernetes-online?view=azureml-api-2#containerresourcelimits
2023-06-05T11:06:50.1978544Z # - Azure ML: Liveness/Readiness probes
2023-06-05T11:06:50.1979215Z #   - https://learn.microsoft.com/en-us/azure/machine-learning/reference-yaml-deployment-kubernetes-online?view=azureml-api-2#probesettings
2023-06-05T11:06:50.1979502Z 
2023-06-05T11:06:50.1979918Z $schema: https://azuremlschemas.azureedge.net/latest/kubernetesOnlineDeployment.schema.json
2023-06-05T11:06:50.1980330Z type: kubernetes
2023-06-05T11:06:50.1980463Z 
2023-06-05T11:06:50.1980784Z # DevOps standards (i.e. do NOT change)
2023-06-05T11:06:50.1981125Z name: blue
2023-06-05T11:06:50.1981500Z endpoint_name: ***
2023-06-05T11:06:50.1981856Z app_insights_enabled: true
2023-06-05T11:06:50.1982521Z environment: azureml://registries/***/environments/***/versions/***
2023-06-05T11:06:50.1983156Z model: azureml://registries/***/models/***/versions/***
2023-06-05T11:06:50.1983570Z environment_variables:
2023-06-05T11:06:50.1983884Z   BUILD_ID: 25083
2023-06-05T11:06:50.1984232Z   CONFIG_INSTANCE_NAME: ***
2023-06-05T11:06:50.1984589Z   CONFIG_INSTANCE_MODEL_NAME: ***
2023-06-05T11:06:50.1984948Z   CONFIG_INSTANCE_MODEL_VERSION: ***
2023-06-05T11:06:50.1985297Z   ENV_LOG_LEVEL: ***
2023-06-05T11:06:50.1985603Z   ENV_NAME: ***
2023-06-05T11:06:50.1985988Z   FULL_SEMVER: ***
2023-06-05T11:06:50.1986353Z   REPO_NAME: ***
2023-06-05T11:06:50.1986681Z   SEMVER: ***
2023-06-05T11:06:50.1986985Z   ***: ***
2023-06-05T11:06:50.1987332Z   ***: ***
2023-06-05T11:06:50.1987665Z   ***: ***
2023-06-05T11:06:50.1987968Z tags:
2023-06-05T11:06:50.1988261Z   BUILD_ID: 25083
2023-06-05T11:06:50.1988591Z   CONFIG_INSTANCE_MODEL_NAME: ***
2023-06-05T11:06:50.1988956Z   CONFIG_INSTANCE_MODEL_VERSION: ***
2023-06-05T11:06:50.1989300Z   CONFIG_INSTANCE_NAME: ***
2023-06-05T11:06:50.1989627Z   ENV_LOG_LEVEL: ***
2023-06-05T11:06:50.1989941Z   ENV_NAME: ***
2023-06-05T11:06:50.1990328Z   FULL_SEMVER: ***
2023-06-05T11:06:50.1990699Z   REPO_NAME: ***
2023-06-05T11:06:50.1991026Z   SEMVER: ***
2023-06-05T11:06:50.1991377Z   SITE_NAME: ***
2023-06-05T11:06:50.1991712Z   SITE_TZ: ***
2023-06-05T11:06:50.1992043Z   ZONE_NAME: ***
2023-06-05T11:06:50.1992359Z code_configuration:
2023-06-05T11:06:50.1992677Z   code: ../../src
2023-06-05T11:06:50.1992996Z   scoring_script: score.py
2023-06-05T11:06:50.1993142Z 
2023-06-05T11:06:50.1993502Z # Instance configuration (make changes below here as needed)
2023-06-05T11:06:50.1993920Z instance_type: defaultinstancetype
2023-06-05T11:06:50.1994249Z instance_count: 1
2023-06-05T11:06:50.1994389Z 
2023-06-05T11:06:50.1994670Z scale_settings:
2023-06-05T11:06:50.1994996Z   type: target_utilization
2023-06-05T11:06:50.1995453Z   min_instances: 1
2023-06-05T11:06:50.1995756Z   max_instances: 2
2023-06-05T11:06:50.1996097Z   target_utilization_percentage: 95
2023-06-05T11:06:50.1996436Z   polling_interval: 30
2023-06-05T11:06:50.1996574Z 
2023-06-05T11:06:50.1996852Z resources:
2023-06-05T11:06:50.1997166Z   requests:
2023-06-05T11:06:50.1997468Z     cpu: "100m"
2023-06-05T11:06:50.1997840Z     memory: "100Mi"
2023-06-05T11:06:50.1998154Z   limits:
2023-06-05T11:06:50.1998439Z     cpu: "2"
2023-06-05T11:06:50.1998730Z     memory: "4Gi"
2023-06-05T11:06:50.1998863Z 
2023-06-05T11:06:50.1999165Z request_settings:
2023-06-05T11:06:50.1999479Z   request_timeout_ms: 3000
2023-06-05T11:06:50.1999808Z   max_queue_wait_ms: 3000
2023-06-05T11:06:50.1999950Z 
2023-06-05T11:06:50.2000237Z readiness_probe:
2023-06-05T11:06:50.2000537Z   period: 10
2023-06-05T11:06:50.2000841Z   initial_delay: 10
2023-06-05T11:06:50.2001174Z   timeout: 10
2023-06-05T11:06:50.2001493Z   success_threshold: 1
2023-06-05T11:06:50.2001808Z   failure_threshold: 3
2023-06-05T11:06:50.2001947Z 
2023-06-05T11:06:50.2002227Z liveness_probe:
2023-06-05T11:06:50.2002526Z   period: 10
2023-06-05T11:06:50.2002821Z   initial_delay: 30
2023-06-05T11:06:50.2003134Z   timeout: 10
2023-06-05T11:06:50.2003439Z   success_threshold: 1
2023-06-05T11:06:50.2003967Z   failure_threshold: 3
2023-06-05T11:06:50.2004321Z Creating deployment...
2023-06-05T11:06:50.2004727Z + [[ 0 -ne 1 ]]
2023-06-05T11:06:50.2005100Z + echo 'Creating deployment...'
2023-06-05T11:06:50.2005967Z + az ml online-deployment create -f src/assets/online_deployment_kubernetes.yml --subscription *** --resource-group *** --workspace-name *** --all-traffic --debug
2023-06-05T11:06:50.4014995Z DEBUG: cli.knack.cli: Command arguments: ['ml', 'online-deployment', 'create', '-f', 'src/assets/online_deployment_kubernetes.yml', '--subscription', '***', '--resource-group', '***', '--workspace-name', '***', '--all-traffic', '--debug']
2023-06-05T11:06:50.4016221Z DEBUG: cli.knack.cli: __init__ debug log:
2023-06-05T11:06:50.4016949Z Cannot enable color.
2023-06-05T11:06:50.4017574Z DEBUG: cli.knack.cli: Event: Cli.PreExecute []
2023-06-05T11:06:50.4018478Z DEBUG: cli.knack.cli: Event: CommandParser.OnGlobalArgumentsCreate [<function CLILogging.on_global_arguments at 0x7f9a7c7913f0>, <function OutputProducer.on_global_arguments at 0x7f9a7c6b0040>, <function CLIQuery.on_global_arguments at 0x7f9a7c6e1240>]
2023-06-05T11:06:50.4025460Z DEBUG: cli.knack.cli: Event: CommandInvoker.OnPreCommandTableCreate []
2023-06-05T11:06:50.4031749Z DEBUG: cli.azure.cli.core: Modules found from index for 'ml': ['azext_mlv2']
2023-06-05T11:06:50.4032546Z DEBUG: cli.azure.cli.core: Loading command modules:
2023-06-05T11:06:50.4033224Z DEBUG: cli.azure.cli.core: Name                  Load Time    Groups  Commands
2023-06-05T11:06:50.4034095Z DEBUG: cli.azure.cli.core: Total (0)                 0.000         0         0
2023-06-05T11:06:50.4043361Z DEBUG: cli.azure.cli.core: These extensions are not installed and will be skipped: ['azext_ai_examples', 'azext_next']
2023-06-05T11:06:50.4044463Z DEBUG: cli.azure.cli.core: Loading extensions:
2023-06-05T11:06:50.4045152Z DEBUG: cli.azure.cli.core: Name                  Load Time    Groups  Commands  Directory
2023-06-05T11:06:51.0566601Z DEBUG: azext_mlv2.manual.vendored_curated_sdk.azure.ai.ml._azure_environments: Using the default cloud configuration: 'AzureCloud'.
2023-06-05T11:06:51.5911416Z DEBUG: azext_mlv2.manual.vendored_curated_sdk.azure.ai.ml._azure_environments: Using the default cloud configuration: 'AzureCloud'.
2023-06-05T11:06:51.5912365Z DEBUG: azext_mlv2.manual.vendored_curated_sdk.azure.ai.ml._azure_environments: Using the default cloud configuration: 'AzureCloud'.
2023-06-05T11:06:51.9353945Z DEBUG: cli.azure.cli.core: ml                        1.519        20       138  /opt/az/azcliextensions/ml
2023-06-05T11:06:51.9452997Z DEBUG: cli.azure.cli.core: Total (1)                 1.519        20       138  
2023-06-05T11:06:51.9453509Z DEBUG: cli.azure.cli.core: Loaded 20 groups, 138 commands.
2023-06-05T11:06:51.9454204Z DEBUG: cli.azure.cli.core: Found a match in the command table.
2023-06-05T11:06:51.9454905Z DEBUG: cli.azure.cli.core: Raw command  : ml online-deployment create
2023-06-05T11:06:51.9455409Z DEBUG: cli.azure.cli.core: Command table: ml online-deployment create
2023-06-05T11:06:51.9455957Z DEBUG: cli.knack.cli: Event: CommandInvoker.OnPreCommandTableTruncate [<function AzCliLogging.init_command_file_logging at 0x7f9a7b516c20>]
2023-06-05T11:06:51.9456935Z DEBUG: cli.azure.cli.core.azlogging: metadata file logging enabled - writing logs to '/home/vsts/work/_temp/.azclitask/commands/2023-06-05.21-06-51.ml_online-deployment_create.2150.log'.
2023-06-05T11:06:51.9508065Z INFO: az_command_data_logger: command args: ml online-deployment create -f {} --subscription {} --resource-group {} --workspace-name {} --all-traffic --debug
2023-06-05T11:06:51.9508822Z DEBUG: cli.knack.cli: Event: CommandInvoker.OnPreArgumentLoad [<function register_global_subscription_argument.<locals>.add_subscription_parameter at 0x7f9a7b53b760>]
2023-06-05T11:06:51.9509436Z DEBUG: cli.knack.cli: Event: CommandInvoker.OnPostArgumentLoad []
2023-06-05T11:06:51.9510122Z DEBUG: cli.knack.cli: Event: CommandInvoker.OnPostCommandTableCreate [<function register_ids_argument.<locals>.add_ids_arguments at 0x7f9a7b5716c0>, <function register_cache_arguments.<locals>.add_cache_arguments at 0x7f9a7b5717e0>]
2023-06-05T11:06:51.9510783Z DEBUG: cli.knack.cli: Event: CommandInvoker.OnCommandTableLoaded []
2023-06-05T11:06:51.9511240Z DEBUG: cli.knack.cli: Event: CommandInvoker.OnPreParseArgs []
2023-06-05T11:06:51.9511926Z DEBUG: cli.knack.cli: Event: CommandInvoker.OnPostParseArgs [<function OutputProducer.handle_output_argument at 0x7f9a7c6b00d0>, <function CLIQuery.handle_query_parameter at 0x7f9a7c6e12d0>, <function register_ids_argument.<locals>.parse_ids_arguments at 0x7f9a7b571750>]
2023-06-05T11:06:51.9512606Z INFO: az_command_data_logger: extension name: ml
2023-06-05T11:06:51.9513014Z INFO: az_command_data_logger: extension version: 2.17.2
2023-06-05T11:06:51.9513532Z DEBUG: cli.azure.cli.core.commands.client_factory: Getting management service client client_type=AzureMachineLearningWorkspaces
2023-06-05T11:06:51.9530560Z DEBUG: cli.azure.cli.core.auth.persistence: build_persistence: location='/home/vsts/work/_temp/.azclitask/service_principal_entries.json', encrypt=False
2023-06-05T11:06:51.9531395Z DEBUG: cli.azure.cli.core.auth.persistence: build_persistence: location='/home/vsts/work/_temp/.azclitask/msal_token_cache.json', encrypt=False
2023-06-05T11:06:51.9532031Z DEBUG: cli.azure.cli.core.auth.binary_cache: load: /home/vsts/work/_temp/.azclitask/msal_http_cache.bin
2023-06-05T11:06:51.9540614Z DEBUG: urllib3.util.retry: Converted retries value: 1 -> Retry(total=1, connect=None, read=None, redirect=None, status=None)
2023-06-05T11:06:51.9544916Z DEBUG: msal.authority: openid_config = {'token_endpoint': ***, 'token_endpoint_auth_methods_supported': ['client_secret_post', 'private_key_jwt', 'client_secret_basic'], 'jwks_uri': ***, 'response_modes_supported': ['query', 'fragment', 'form_post'], 'subject_types_supported': ['pairwise'], 'id_token_signing_alg_values_supported': ['RS256'], 'response_types_supported': ['code', 'id_token', 'code id_token', 'id_token token'], 'scopes_supported': ['openid', 'profile', 'email', 'offline_access'], 'issuer': 'https://login.microsoftonline.com/***/v2.0', 'request_uri_parameter_supported': False, 'userinfo_endpoint': 'https://graph.microsoft.com/oidc/userinfo', 'authorization_endpoint': 'https://login.microsoftonline.com/***/oauth2/v2.0/authorize', 'device_authorization_endpoint': 'https://login.microsoftonline.com/***/oauth2/v2.0/devicecode', 'http_logout_supported': True, 'frontchannel_logout_supported': True, 'end_session_endpoint': 'https://login.microsoftonline.com/***/oauth2/v2.0/logout', 'claims_supported': ['sub', 'iss', 'cloud_instance_name', 'cloud_instance_host_name', 'cloud_graph_host_name', 'msgraph_host', 'aud', 'exp', 'iat', 'auth_time', 'acr', 'nonce', 'preferred_username', 'name', 'tid', 'ver', 'at_hash', 'c_hash', 'email'], 'kerberos_endpoint': 'https://login.microsoftonline.com/***/kerberos', 'tenant_region_scope': 'OC', 'cloud_instance_name': 'microsoftonline.com', 'cloud_graph_host_name': 'graph.windows.net', 'msgraph_host': 'graph.microsoft.com', 'rbac_url': 'https://pas.windows.net'}
2023-06-05T11:06:51.9547868Z DEBUG: msal.application: Broker enabled? False
2023-06-05T11:06:51.9548256Z DEBUG: msal.application: Region to be used: None
2023-06-05T11:06:51.9571353Z DEBUG: cli.azure.cli.core.commands.client_factory: Getting management service client client_type=_ml_client_cli
2023-06-05T11:06:51.9572264Z DEBUG: urllib3.util.retry: Converted retries value: 1 -> Retry(total=1, connect=None, read=None, redirect=None, status=None)
2023-06-05T11:06:51.9576518Z DEBUG: msal.authority: openid_config = {'token_endpoint': ***, 'token_endpoint_auth_methods_supported': ['client_secret_post', 'private_key_jwt', 'client_secret_basic'], 'jwks_uri': ***, 'response_modes_supported': ['query', 'fragment', 'form_post'], 'subject_types_supported': ['pairwise'], 'id_token_signing_alg_values_supported': ['RS256'], 'response_types_supported': ['code', 'id_token', 'code id_token', 'id_token token'], 'scopes_supported': ['openid', 'profile', 'email', 'offline_access'], 'issuer': 'https://login.microsoftonline.com/***/v2.0', 'request_uri_parameter_supported': False, 'userinfo_endpoint': 'https://graph.microsoft.com/oidc/userinfo', 'authorization_endpoint': 'https://login.microsoftonline.com/***/oauth2/v2.0/authorize', 'device_authorization_endpoint': 'https://login.microsoftonline.com/***/oauth2/v2.0/devicecode', 'http_logout_supported': True, 'frontchannel_logout_supported': True, 'end_session_endpoint': 'https://login.microsoftonline.com/***/oauth2/v2.0/logout', 'claims_supported': ['sub', 'iss', 'cloud_instance_name', 'cloud_instance_host_name', 'cloud_graph_host_name', 'msgraph_host', 'aud', 'exp', 'iat', 'auth_time', 'acr', 'nonce', 'preferred_username', 'name', 'tid', 'ver', 'at_hash', 'c_hash', 'email'], 'kerberos_endpoint': 'https://login.microsoftonline.com/***/kerberos', 'tenant_region_scope': 'OC', 'cloud_instance_name': 'microsoftonline.com', 'cloud_graph_host_name': 'graph.windows.net', 'msgraph_host': 'graph.microsoft.com', 'rbac_url': 'https://pas.windows.net'}
2023-06-05T11:06:51.9579098Z DEBUG: msal.application: Broker enabled? False
2023-06-05T11:06:51.9579504Z DEBUG: msal.application: Region to be used: None
2023-06-05T11:06:51.9810661Z Traceback (most recent call last):
2023-06-05T11:06:51.9811359Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_util.py", line 144, in load_from_dict
2023-06-05T11:06:51.9811985Z     return schema(context=context).load(data, **kwargs)
2023-06-05T11:06:51.9812515Z   File "/opt/az/azcliextensions/ml/marshmallow/schema.py", line 722, in load
2023-06-05T11:06:51.9812981Z     return self._do_load(
2023-06-05T11:06:51.9813450Z   File "/opt/az/azcliextensions/ml/marshmallow/schema.py", line 909, in _do_load
2023-06-05T11:06:51.9813899Z     raise exc
2023-06-05T11:06:51.9814773Z marshmallow.exceptions.ValidationError: {'_schema': ['Registry reference for environments is not supported for K8SDeployment']}
2023-06-05T11:06:51.9832129Z 
2023-06-05T11:06:51.9832711Z During handling of the above exception, another exception occurred:
2023-06-05T11:06:51.9833184Z 
2023-06-05T11:06:51.9833551Z Traceback (most recent call last):
2023-06-05T11:06:51.9834139Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/custom/online_deployment.py", line 72, in ml_online_deployment_create
2023-06-05T11:06:51.9834777Z     deployment = load_online_deployment(source=file, params_override=params_override)
2023-06-05T11:06:51.9835575Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 521, in load_online_deployment
2023-06-05T11:06:51.9836236Z     return load_common(OnlineDeployment, source, relative_origin, **kwargs)
2023-06-05T11:06:51.9836874Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 112, in load_common
2023-06-05T11:06:51.9837395Z     raise e
2023-06-05T11:06:51.9837928Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 96, in load_common
2023-06-05T11:06:51.9838629Z     return _load_common_raising_marshmallow_error(cls, yaml_dict, relative_origin, params_override, **kwargs)
2023-06-05T11:06:51.9839347Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 146, in _load_common_raising_marshmallow_error
2023-06-05T11:06:51.9840086Z     return cls._load(data=yaml_dict, yaml_path=relative_origin, params_override=params_override, **kwargs)
2023-06-05T11:06:51.9840781Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_deployment/online_deployment.py", line 352, in _load
2023-06-05T11:06:51.9841449Z     return load_from_dict(KubernetesOnlineDeploymentSchema, data, context, **kwargs)
2023-06-05T11:06:51.9842143Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_util.py", line 147, in load_from_dict
2023-06-05T11:06:51.9842691Z     raise ValidationError(decorate_validation_error(schema, pretty_error, additional_message))
2023-06-05T11:06:51.9843224Z marshmallow.exceptions.ValidationError: Validation for KubernetesOnlineDeploymentSchema failed:
2023-06-05T11:06:51.9843467Z 
2023-06-05T11:06:51.9843977Z  {
2023-06-05T11:06:51.9844265Z   "_schema": [
2023-06-05T11:06:51.9844668Z     "Registry reference for environments is not supported for K8SDeployment"
2023-06-05T11:06:51.9845032Z   ]
2023-06-05T11:06:51.9845309Z } 
2023-06-05T11:06:51.9845408Z 
2023-06-05T11:06:51.9845680Z  
2023-06-05T11:06:51.9845788Z 
2023-06-05T11:06:51.9846508Z Visit this link to refer to the KubernetesOnlineDeployment schema if needed: https://aka.ms/ml-cli-v2-deployment-kubernetes-online-yaml-reference.
2023-06-05T11:06:51.9847565Z The easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://docs.microsoft.com/azure/machine-learning/how-to-setup-vs-code
2023-06-05T11:06:51.9848199Z ERROR: cli: None
2023-06-05T11:06:51.9848541Z DEBUG: cli: Traceback (most recent call last):
2023-06-05T11:06:51.9849055Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_util.py", line 144, in load_from_dict
2023-06-05T11:06:51.9849569Z     return schema(context=context).load(data, **kwargs)
2023-06-05T11:06:51.9850024Z   File "/opt/az/azcliextensions/ml/marshmallow/schema.py", line 722, in load
2023-06-05T11:06:51.9850426Z     return self._do_load(
2023-06-05T11:06:51.9850827Z   File "/opt/az/azcliextensions/ml/marshmallow/schema.py", line 909, in _do_load
2023-06-05T11:06:51.9851213Z     raise exc
2023-06-05T11:06:51.9851801Z marshmallow.exceptions.ValidationError: {'_schema': ['Registry reference for environments is not supported for K8SDeployment']}
2023-06-05T11:06:51.9852081Z 
2023-06-05T11:06:51.9852448Z During handling of the above exception, another exception occurred:
2023-06-05T11:06:51.9852656Z 
2023-06-05T11:06:51.9852965Z Traceback (most recent call last):
2023-06-05T11:06:51.9853605Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/custom/online_deployment.py", line 72, in ml_online_deployment_create
2023-06-05T11:06:51.9854163Z     deployment = load_online_deployment(source=file, params_override=params_override)
2023-06-05T11:06:51.9854763Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 521, in load_online_deployment
2023-06-05T11:06:51.9855401Z     return load_common(OnlineDeployment, source, relative_origin, **kwargs)
2023-06-05T11:06:51.9856035Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 112, in load_common
2023-06-05T11:06:51.9856467Z     raise e
2023-06-05T11:06:51.9856938Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 96, in load_common
2023-06-05T11:06:51.9857528Z     return _load_common_raising_marshmallow_error(cls, yaml_dict, relative_origin, params_override, **kwargs)
2023-06-05T11:06:51.9858150Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 146, in _load_common_raising_marshmallow_error
2023-06-05T11:06:51.9858772Z     return cls._load(data=yaml_dict, yaml_path=relative_origin, params_override=params_override, **kwargs)
2023-06-05T11:06:51.9859373Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_deployment/online_deployment.py", line 352, in _load
2023-06-05T11:06:51.9859956Z     return load_from_dict(KubernetesOnlineDeploymentSchema, data, context, **kwargs)
2023-06-05T11:06:51.9860507Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_util.py", line 147, in load_from_dict
2023-06-05T11:06:51.9861056Z     raise ValidationError(decorate_validation_error(schema, pretty_error, additional_message))
2023-06-05T11:06:51.9861587Z marshmallow.exceptions.ValidationError: Validation for KubernetesOnlineDeploymentSchema failed:
2023-06-05T11:06:51.9861827Z 
2023-06-05T11:06:51.9862086Z  {
2023-06-05T11:06:51.9862364Z   "_schema": [
2023-06-05T11:06:51.9862762Z     "Registry reference for environments is not supported for K8SDeployment"
2023-06-05T11:06:51.9863116Z   ]
2023-06-05T11:06:51.9863390Z } 
2023-06-05T11:06:51.9863489Z 
2023-06-05T11:06:51.9863761Z  
2023-06-05T11:06:51.9863868Z 
2023-06-05T11:06:51.9864476Z Visit this link to refer to the KubernetesOnlineDeployment schema if needed: https://aka.ms/ml-cli-v2-deployment-kubernetes-online-yaml-reference.
2023-06-05T11:06:51.9865528Z The easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://docs.microsoft.com/azure/machine-learning/how-to-setup-vs-code
2023-06-05T11:06:51.9865997Z 
2023-06-05T11:06:51.9866592Z DEBUG: cli.azure.cli.core.azclierror: Traceback (most recent call last):
2023-06-05T11:06:51.9867144Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_util.py", line 144, in load_from_dict
2023-06-05T11:06:51.9867654Z     return schema(context=context).load(data, **kwargs)
2023-06-05T11:06:51.9868112Z   File "/opt/az/azcliextensions/ml/marshmallow/schema.py", line 722, in load
2023-06-05T11:06:51.9868504Z     return self._do_load(
2023-06-05T11:06:51.9868905Z   File "/opt/az/azcliextensions/ml/marshmallow/schema.py", line 909, in _do_load
2023-06-05T11:06:51.9869291Z     raise exc
2023-06-05T11:06:51.9869883Z marshmallow.exceptions.ValidationError: {'_schema': ['Registry reference for environments is not supported for K8SDeployment']}
2023-06-05T11:06:51.9870164Z 
2023-06-05T11:06:51.9870533Z During handling of the above exception, another exception occurred:
2023-06-05T11:06:51.9870739Z 
2023-06-05T11:06:51.9871064Z Traceback (most recent call last):
2023-06-05T11:06:51.9871574Z   File "/opt/az/lib/python3.10/site-packages/knack/cli.py", line 233, in invoke
2023-06-05T11:06:51.9872105Z     cmd_result = self.invocation.execute(args)
2023-06-05T11:06:51.9872680Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 663, in execute
2023-06-05T11:06:51.9873070Z     raise ex
2023-06-05T11:06:51.9873626Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
2023-06-05T11:06:51.9874212Z     results.append(self._run_job(expanded_arg, cmd_copy))
2023-06-05T11:06:51.9874793Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 697, in _run_job
2023-06-05T11:06:51.9875234Z     result = cmd_copy(params)
2023-06-05T11:06:51.9875772Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 333, in __call__
2023-06-05T11:06:51.9876214Z     return self.handler(*args, **kwargs)
2023-06-05T11:06:51.9876783Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
2023-06-05T11:06:51.9877227Z     return op(**command_args)
2023-06-05T11:06:51.9877717Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/custom/online_deployment.py", line 125, in ml_online_deployment_create
2023-06-05T11:06:51.9878216Z     log_and_raise_error(err, debug, yaml_operation=yaml_operation)
2023-06-05T11:06:51.9878724Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/custom/raise_error.py", line 181, in log_and_raise_error
2023-06-05T11:06:51.9879149Z     raise cli_error
2023-06-05T11:06:51.9879594Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/custom/online_deployment.py", line 72, in ml_online_deployment_create
2023-06-05T11:06:51.9880139Z     deployment = load_online_deployment(source=file, params_override=params_override)
2023-06-05T11:06:51.9880714Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 521, in load_online_deployment
2023-06-05T11:06:51.9881276Z     return load_common(OnlineDeployment, source, relative_origin, **kwargs)
2023-06-05T11:06:51.9881828Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 112, in load_common
2023-06-05T11:06:51.9882271Z     raise e
2023-06-05T11:06:51.9882741Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 96, in load_common
2023-06-05T11:06:51.9883324Z     return _load_common_raising_marshmallow_error(cls, yaml_dict, relative_origin, params_override, **kwargs)
2023-06-05T11:06:51.9884093Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 146, in _load_common_raising_marshmallow_error
2023-06-05T11:06:51.9884729Z     return cls._load(data=yaml_dict, yaml_path=relative_origin, params_override=params_override, **kwargs)
2023-06-05T11:06:51.9885345Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_deployment/online_deployment.py", line 352, in _load
2023-06-05T11:06:51.9885901Z     return load_from_dict(KubernetesOnlineDeploymentSchema, data, context, **kwargs)
2023-06-05T11:06:51.9886483Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_util.py", line 147, in load_from_dict
2023-06-05T11:06:51.9887043Z     raise ValidationError(decorate_validation_error(schema, pretty_error, additional_message))
2023-06-05T11:06:51.9887565Z marshmallow.exceptions.ValidationError: Validation for KubernetesOnlineDeploymentSchema failed:
2023-06-05T11:06:51.9887799Z 
2023-06-05T11:06:51.9888084Z  {
2023-06-05T11:06:51.9888365Z   "_schema": [
2023-06-05T11:06:51.9888757Z     "Registry reference for environments is not supported for K8SDeployment"
2023-06-05T11:06:51.9889134Z   ]
2023-06-05T11:06:51.9889395Z } 
2023-06-05T11:06:51.9889505Z 
2023-06-05T11:06:51.9889763Z  
2023-06-05T11:06:51.9889872Z 
2023-06-05T11:06:51.9890489Z Visit this link to refer to the KubernetesOnlineDeployment schema if needed: https://aka.ms/ml-cli-v2-deployment-kubernetes-online-yaml-reference.
2023-06-05T11:06:51.9891656Z The easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://docs.microsoft.com/azure/machine-learning/how-to-setup-vs-code
2023-06-05T11:06:51.9892158Z 
2023-06-05T11:06:51.9892566Z ERROR: cli.azure.cli.core.azclierror: The command failed with an unexpected error. Here is the traceback:
2023-06-05T11:06:51.9893118Z ERROR: az_command_data_logger: The command failed with an unexpected error. Here is the traceback:
2023-06-05T11:06:51.9893634Z ERROR: cli.azure.cli.core.azclierror: Validation for KubernetesOnlineDeploymentSchema failed:
2023-06-05T11:06:51.9893853Z 
2023-06-05T11:06:51.9894116Z  {
2023-06-05T11:06:51.9894411Z   "_schema": [
2023-06-05T11:06:51.9894797Z     "Registry reference for environments is not supported for K8SDeployment"
2023-06-05T11:06:51.9895175Z   ]
2023-06-05T11:06:51.9895438Z } 
2023-06-05T11:06:51.9895549Z 
2023-06-05T11:06:51.9895808Z  
2023-06-05T11:06:51.9895917Z 
2023-06-05T11:06:51.9896524Z Visit this link to refer to the KubernetesOnlineDeployment schema if needed: https://aka.ms/ml-cli-v2-deployment-kubernetes-online-yaml-reference.
2023-06-05T11:06:51.9897591Z The easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://docs.microsoft.com/azure/machine-learning/how-to-setup-vs-code
2023-06-05T11:06:51.9898221Z Traceback (most recent call last):
2023-06-05T11:06:51.9898724Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_util.py", line 144, in load_from_dict
2023-06-05T11:06:51.9899229Z     return schema(context=context).load(data, **kwargs)
2023-06-05T11:06:51.9899681Z   File "/opt/az/azcliextensions/ml/marshmallow/schema.py", line 722, in load
2023-06-05T11:06:51.9900083Z     return self._do_load(
2023-06-05T11:06:51.9900491Z   File "/opt/az/azcliextensions/ml/marshmallow/schema.py", line 909, in _do_load
2023-06-05T11:06:51.9900878Z     raise exc
2023-06-05T11:06:51.9901457Z marshmallow.exceptions.ValidationError: {'_schema': ['Registry reference for environments is not supported for K8SDeployment']}
2023-06-05T11:06:51.9901739Z 
2023-06-05T11:06:51.9902109Z During handling of the above exception, another exception occurred:
2023-06-05T11:06:51.9902310Z 
2023-06-05T11:06:51.9902621Z Traceback (most recent call last):
2023-06-05T11:06:51.9903146Z   File "/opt/az/lib/python3.10/site-packages/knack/cli.py", line 233, in invoke
2023-06-05T11:06:51.9903569Z     cmd_result = self.invocation.execute(args)
2023-06-05T11:06:51.9904139Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 663, in execute
2023-06-05T11:06:51.9904540Z     raise ex
2023-06-05T11:06:51.9905081Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
2023-06-05T11:06:51.9905569Z     results.append(self._run_job(expanded_arg, cmd_copy))
2023-06-05T11:06:51.9906150Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 697, in _run_job
2023-06-05T11:06:51.9906588Z     result = cmd_copy(params)
2023-06-05T11:06:51.9907125Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 333, in __call__
2023-06-05T11:06:51.9907552Z     return self.handler(*args, **kwargs)
2023-06-05T11:06:51.9908132Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
2023-06-05T11:06:51.9908559Z     return op(**command_args)
2023-06-05T11:06:51.9909048Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/custom/online_deployment.py", line 125, in ml_online_deployment_create
2023-06-05T11:06:51.9909568Z     log_and_raise_error(err, debug, yaml_operation=yaml_operation)
2023-06-05T11:06:51.9910144Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/custom/raise_error.py", line 181, in log_and_raise_error
2023-06-05T11:06:51.9910577Z     raise cli_error
2023-06-05T11:06:51.9911031Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/custom/online_deployment.py", line 72, in ml_online_deployment_create
2023-06-05T11:06:51.9911646Z     deployment = load_online_deployment(source=file, params_override=params_override)
2023-06-05T11:06:51.9912234Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 521, in load_online_deployment
2023-06-05T11:06:51.9912811Z     return load_common(OnlineDeployment, source, relative_origin, **kwargs)
2023-06-05T11:06:51.9913369Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 112, in load_common
2023-06-05T11:06:51.9913812Z     raise e
2023-06-05T11:06:51.9914302Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 96, in load_common
2023-06-05T11:06:51.9914877Z     return _load_common_raising_marshmallow_error(cls, yaml_dict, relative_origin, params_override, **kwargs)
2023-06-05T11:06:51.9915509Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 146, in _load_common_raising_marshmallow_error
2023-06-05T11:06:51.9916135Z     return cls._load(data=yaml_dict, yaml_path=relative_origin, params_override=params_override, **kwargs)
2023-06-05T11:06:51.9916750Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_deployment/online_deployment.py", line 352, in _load
2023-06-05T11:06:51.9917319Z     return load_from_dict(KubernetesOnlineDeploymentSchema, data, context, **kwargs)
2023-06-05T11:06:51.9917858Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_util.py", line 147, in load_from_dict
2023-06-05T11:06:51.9918429Z     raise ValidationError(decorate_validation_error(schema, pretty_error, additional_message))
2023-06-05T11:06:51.9918943Z marshmallow.exceptions.ValidationError: Validation for KubernetesOnlineDeploymentSchema failed:
2023-06-05T11:06:51.9919173Z 
2023-06-05T11:06:51.9919453Z  {
2023-06-05T11:06:51.9919730Z   "_schema": [
2023-06-05T11:06:51.9920122Z     "Registry reference for environments is not supported for K8SDeployment"
2023-06-05T11:06:51.9920499Z   ]
2023-06-05T11:06:51.9920765Z } 
2023-06-05T11:06:51.9920878Z 
2023-06-05T11:06:51.9921137Z  
2023-06-05T11:06:51.9921244Z 
2023-06-05T11:06:51.9921855Z Visit this link to refer to the KubernetesOnlineDeployment schema if needed: https://aka.ms/ml-cli-v2-deployment-kubernetes-online-yaml-reference.
2023-06-05T11:06:51.9922920Z The easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://docs.microsoft.com/azure/machine-learning/how-to-setup-vs-code
2023-06-05T11:06:51.9923775Z ERROR: az_command_data_logger: Validation for KubernetesOnlineDeploymentSchema failed:
2023-06-05T11:06:51.9924118Z 
2023-06-05T11:06:51.9924402Z  {
2023-06-05T11:06:51.9924682Z   "_schema": [
2023-06-05T11:06:51.9925085Z     "Registry reference for environments is not supported for K8SDeployment"
2023-06-05T11:06:51.9925458Z   ]
2023-06-05T11:06:51.9925724Z } 
2023-06-05T11:06:51.9925834Z 
2023-06-05T11:06:51.9926092Z  
2023-06-05T11:06:51.9926201Z 
2023-06-05T11:06:51.9926818Z Visit this link to refer to the KubernetesOnlineDeployment schema if needed: https://aka.ms/ml-cli-v2-deployment-kubernetes-online-yaml-reference.
2023-06-05T11:06:51.9927886Z The easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://docs.microsoft.com/azure/machine-learning/how-to-setup-vs-code
2023-06-05T11:06:51.9928656Z Traceback (most recent call last):
2023-06-05T11:06:51.9929171Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_util.py", line 144, in load_from_dict
2023-06-05T11:06:51.9929676Z     return schema(context=context).load(data, **kwargs)
2023-06-05T11:06:51.9930216Z   File "/opt/az/azcliextensions/ml/marshmallow/schema.py", line 722, in load
2023-06-05T11:06:51.9930612Z     return self._do_load(
2023-06-05T11:06:51.9931019Z   File "/opt/az/azcliextensions/ml/marshmallow/schema.py", line 909, in _do_load
2023-06-05T11:06:51.9931408Z     raise exc
2023-06-05T11:06:51.9931997Z marshmallow.exceptions.ValidationError: {'_schema': ['Registry reference for environments is not supported for K8SDeployment']}
2023-06-05T11:06:51.9932277Z 
2023-06-05T11:06:51.9932650Z During handling of the above exception, another exception occurred:
2023-06-05T11:06:51.9932851Z 
2023-06-05T11:06:51.9933175Z Traceback (most recent call last):
2023-06-05T11:06:51.9933718Z   File "/opt/az/lib/python3.10/site-packages/knack/cli.py", line 233, in invoke
2023-06-05T11:06:51.9934142Z     cmd_result = self.invocation.execute(args)
2023-06-05T11:06:51.9934718Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 663, in execute
2023-06-05T11:06:51.9935113Z     raise ex
2023-06-05T11:06:51.9935664Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
2023-06-05T11:06:51.9936144Z     results.append(self._run_job(expanded_arg, cmd_copy))
2023-06-05T11:06:51.9936728Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 697, in _run_job
2023-06-05T11:06:51.9937153Z     result = cmd_copy(params)
2023-06-05T11:06:51.9937695Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 333, in __call__
2023-06-05T11:06:51.9938147Z     return self.handler(*args, **kwargs)
2023-06-05T11:06:51.9938726Z   File "/opt/az/lib/python3.10/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
2023-06-05T11:06:51.9939169Z     return op(**command_args)
2023-06-05T11:06:51.9939663Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/custom/online_deployment.py", line 125, in ml_online_deployment_create
2023-06-05T11:06:51.9940176Z     log_and_raise_error(err, debug, yaml_operation=yaml_operation)
2023-06-05T11:06:51.9940684Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/custom/raise_error.py", line 181, in log_and_raise_error
2023-06-05T11:06:51.9941103Z     raise cli_error
2023-06-05T11:06:51.9941559Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/custom/online_deployment.py", line 72, in ml_online_deployment_create
2023-06-05T11:06:51.9942106Z     deployment = load_online_deployment(source=file, params_override=params_override)
2023-06-05T11:06:51.9942684Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 521, in load_online_deployment
2023-06-05T11:06:51.9943269Z     return load_common(OnlineDeployment, source, relative_origin, **kwargs)
2023-06-05T11:06:51.9943823Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 112, in load_common
2023-06-05T11:06:51.9944289Z     raise e
2023-06-05T11:06:51.9944760Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 96, in load_common
2023-06-05T11:06:51.9945346Z     return _load_common_raising_marshmallow_error(cls, yaml_dict, relative_origin, params_override, **kwargs)
2023-06-05T11:06:51.9945992Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_load_functions.py", line 146, in _load_common_raising_marshmallow_error
2023-06-05T11:06:51.9946624Z     return cls._load(data=yaml_dict, yaml_path=relative_origin, params_override=params_override, **kwargs)
2023-06-05T11:06:51.9947321Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_deployment/online_deployment.py", line 352, in _load
2023-06-05T11:06:51.9947897Z     return load_from_dict(KubernetesOnlineDeploymentSchema, data, context, **kwargs)
2023-06-05T11:06:51.9948456Z   File "/opt/az/azcliextensions/ml/azext_mlv2/manual/vendored_curated_sdk/azure/ai/ml/entities/_util.py", line 147, in load_from_dict
2023-06-05T11:06:51.9949086Z     raise ValidationError(decorate_validation_error(schema, pretty_error, additional_message))
2023-06-05T11:06:51.9949620Z marshmallow.exceptions.ValidationError: Validation for KubernetesOnlineDeploymentSchema failed:
2023-06-05T11:06:51.9949846Z 
2023-06-05T11:06:51.9950124Z  {
2023-06-05T11:06:51.9950403Z   "_schema": [
2023-06-05T11:06:51.9950795Z     "Registry reference for environments is not supported for K8SDeployment"
2023-06-05T11:06:51.9951169Z   ]
2023-06-05T11:06:51.9951430Z } 
2023-06-05T11:06:51.9951546Z 
2023-06-05T11:06:51.9951806Z  
2023-06-05T11:06:51.9951916Z 
2023-06-05T11:06:51.9952547Z Visit this link to refer to the KubernetesOnlineDeployment schema if needed: https://aka.ms/ml-cli-v2-deployment-kubernetes-online-yaml-reference.
2023-06-05T11:06:51.9953619Z The easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://docs.microsoft.com/azure/machine-learning/how-to-setup-vs-code
2023-06-05T11:06:51.9954461Z To check existing issues, please visit: https://github.com/Azure/azure-cli/issues
2023-06-05T11:06:51.9954906Z To open a new issue, please run `az feedback`
2023-06-05T11:06:51.9955396Z DEBUG: cli.knack.cli: Event: Cli.PostExecute [<function AzCliLogging.deinit_cmd_metadata_logging at 0x7f9a7b516e60>]
2023-06-05T11:06:51.9955888Z INFO: az_command_data_logger: exit code: 1
2023-06-05T11:06:51.9956325Z INFO: cli.__main__: Command ran in 1.763 seconds (init: 0.181, invoke: 1.582)
2023-06-05T11:06:52.0493976Z INFO: telemetry.main: Begin splitting cli events and extra events, total events: 1
2023-06-05T11:06:52.0495219Z INFO: telemetry.client: Accumulated 0 events. Flush the clients.
2023-06-05T11:06:52.0498307Z INFO: telemetry.main: Finish splitting cli events and extra events, cli events: 1
2023-06-05T11:06:52.0502902Z INFO: telemetry.save: Save telemetry record of length 8592 in cache
2023-06-05T11:06:52.0506142Z WARNING: telemetry.check: Negative: The /home/vsts/work/_temp/.azclitask/telemetry.txt was modified at 2023-06-05 21:05:55.616008, which in less than 600.000000 s
2023-06-05T11:06:52.4722629Z ##[error]Script failed with exit code: 1
2023-06-05T11:06:52.4736459Z [command]/usr/bin/az account clear
2023-06-05T11:06:52.8828974Z ##[section]Finishing: az_ml_online_deployment_create_or_update

Document Details

⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

adriantorrie commented 1 year ago

After updating to not use a shared registry environment, I've now found out a shared registry model cannot be used either.

 {
  "_schema": [
    "Registry reference for models is not supported for K8SDeployment"
  ]
}
RamanathanChinnappan-MSFT commented 1 year ago

@adriantorrie Thanks for your feedback! We will investigate and update as appropriate.

Naveenommi-MSFT commented 1 year ago

@adriantorrie Thank you for bringing this to our attention. I've delegated this to content author @fkriti, who will review it and offer their insightful opinions.

Naveenommi-MSFT commented 1 year ago

@fkriti Could you please review add comments on this, update as appropriate.