search

Azure / MachineLearningNotebooks

Python notebooks with ML and deep learning examples with Azure Machine Learning Python SDK | Microsoft
https://docs.microsoft.com/azure/machine-learning/service/
MIT License
4.05k stars 2.51k forks source link

Azure AutoML not working properly in Tutorial-NYCTaxi python notebook #1760

Open joslat opened 2 years ago

joslat commented 2 years ago

Hi, the sample on https://github.com/Azure/MachineLearningNotebooks/tree/master/tutorials/regression-automl-nyc-taxi-data Seems not to be working now "out of the box" and failing when invoking AutoML...

Concretely, when on the step "Train the automatic regression model" right on submitting the AutoML experiment - it was working before, so seems recent/due to some changes), upon executing this cell:

from azureml.core.experiment import Experiment
experiment = Experiment(ws, "Tutorial-NYCTaxi")
local_run = experiment.submit(automl_config, show_output=True)

theres happens a ValidationException "ValidationException: ValidationException: Message: Install the required versions of packages using the requirements file. Requirements file location: /anaconda/envs/azureml_py38/lib/python3.8/site-packages/azureml/automl/core/validated_linux_requirements.txt. Alternatively, use remote target to avoid dependency management. Package name/Required version/Installed version azureml-automl-runtime/scipy<=1.5.2,>=1.0.0/scipy 1.5.3 azureml-automl-runtime/scikit-learn<0.23.0,>=0.19.0/scikit-learn 1.0.2 azureml-train-automl-runtime/scipy<=1.5.2,>=1.0.0/scipy 1.5.3 azureml-train-automl-runtime/scikit-learn<0.23.0,>=0.19.0/scikit-learn 1.0.2 InnerException: None ErrorResponse { "error": { "code": "UserError", "message": "Install the required versions of packages using the requirements file. Requirements file location: /anaconda/envs/azureml_py38/lib/python3.8/site-packages/azureml/automl/core/validated_linux_requirements.txt. Alternatively, use remote target to avoid dependency management. \nPackage name/Required version/Installed version\nazureml-automl-runtime/scipy<=1.5.2,>=1.0.0/scipy 1.5.3\nazureml-automl-runtime/scikit-learn<0.23.0,>=0.19.0/scikit-learn 1.0.2\nazureml-train-automl-runtime/scipy<=1.5.2,>=1.0.0/scipy 1.5.3\nazureml-train-automl-runtime/scikit-learn<0.23.0,>=0.19.0/scikit-learn 1.0.2", "target": "azureml-automl-runtime,azureml-train-automl-runtime", "inner_error": { "code": "NotSupported", "inner_error": { "code": "IncompatibleOrMissingDependency" } }, "reference_code": "435ab938-fd87-49bc-932e-6eec0d6aee4f" } }"

I am executing this using a default compute instance and the Python 3.8 kernel with AzureML. It fails with the experiment.submit, experiment.submit(automl_config, show_output=True)

I tried to install the referred requirements file, but cannot be found "pip install -r /anaconda/envs/azureml_py38/lib/python3.8/site-packages/azureml/automl/core/validated_linux_requirements.tx"

How can I resolve the dependencies properly? Earlier times it worked as a charm, without issues...

joslat commented 2 years ago

Note: This is fixed by opening the terminal *Open terminal " on the toolbar in the left-hand pane of the Notebook section in Azure Machine Learning which opens a command window and then I execute the following command:

pip install -r /anaconda/envs/azureml_py38/lib/python3.8/site-packages/azureml/automl/core/validated_linux_requirements.txt I then reset the kernel and rerun the notebook, and it works.