search

MicrosoftDocs / pipelines-azureml

Example Azure Pipeline to train and deploy a machine learning model using the Azure Machine Learning service
Creative Commons Attribution 4.0 International
114 stars 513 forks source link

Issue with model train command . #10

Open charanreddypruthvi opened 4 years ago

charanreddypruthvi commented 4 years ago

Hi,

We are getting error when running the below command . az ml run submit-script -c config/train --ct $(ml-ct) -e $(ml-exp) -t run.json train.py

charanreddypruthvi commented 4 years ago

Attaching the error from the above command.

RunId: exp-test_1585213050_4dffac55 Web View:

Streaming azureml-logs/20_image_build_log.txt

Execution Summary

RunId: exp-test_1585213050_4dffac55 Web View: ActivityFailedException: Message: Activity Failed: { "error": { "code": "UserError", "message": "Unauthorized error encountered while attempting to connect to the container registry. Please try running resync keys on your workspace and retry.", "details": [] }, "correlation": { "operation": null, "request": "55bbc7080497519c" }, "environment": "westeurope", "location": "westeurope", "time": "2020-03-26T08:57:37.197425Z" } InnerException None ErrorResponse { "error": { "message": "Activity Failed:\n{\n \"error\": {\n \"code\": \"UserError\",\n \"message\": \"Unauthorized error encountered while attempting to connect to the container registry. Please try running resync keys on your workspace and retry.\",\n \"details\": []\n },\n \"correlation\": {\n \"operation\": null,\n \"request\": \"55bbc7080497519c\"\n },\n \"environment\": \"westeurope\",\n \"location\": \"westeurope\",\n \"time\": \"2020-03-26T08:57:37.197425Z\"\n}" } }

csiebler commented 4 years ago

Looks like a permission problem with the Service Connection in Azure DevOps. Can you check if the connection is functioning?

charanreddypruthvi commented 4 years ago

Do we need to create any service connection for pulling the base image as well ?

jpe316 commented 4 years ago

Looks like a transient issue to me - can you try resync of keys? @akshaya-a / @keriehm ideas?

mkrdip commented 4 years ago

@charanreddypruthvi I have faced the same issue. From where are you pulling the base image? You can have a look at my self-closed issue https://github.com/MicrosoftDocs/pipelines-azureml/issues/12.