Azure / azure-sdk-for-python

This repository is for active development of the Azure SDK for Python. For consumers of the SDK we recommend visiting our public developer docs at https://learn.microsoft.com/python/azure/ or our versioned developer docs at https://azure.github.io/azure-sdk-for-python.
MIT License
4.56k stars 2.78k forks source link

Job permanently running in 'preparing' status regardless of job or compute (cluster + instance) #30340

Open VEshelbyMTT opened 1 year ago

VEshelbyMTT commented 1 year ago

Describe the bug

Running lab 2 from the course material in git (https://github.com/MicrosoftLearning/mslearn-azure-ml) which highlighted the issue. Tested it out using my own scripts. Lab is in perpetual status along with any other jobs proceeding it regardless of compute, or region (see image) or job command

Evidence this worked in the past: image

To Reproduce Steps to reproduce the behavior:

  1. import the git repo shared in the 'describe the bug' and run lab 2 in Azure Machine learning
  2. Create a storage account that matches the assets described in the jupyter notebook or clone directly from the instructions

Expected behavior job should run and complete after 20-60 seconds

Screenshots image

Additional context Azure status declare AML to up and running. Is there something up with the compute?

github-actions[bot] commented 1 year ago

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @azureml-github @Azure/azure-ml-sdk.

diondrapeck commented 1 year ago

@rytsang Could you please look into this for Execution Service?

uberj commented 1 year ago

I'm also seeing jobs perpetually "Preparing". Eventually the job fails. No logs are produced: image