search

Azure / azure-sdk-for-python

This repository is for active development of the Azure SDK for Python. For consumers of the SDK we recommend visiting our public developer docs at https://learn.microsoft.com/python/azure/ or our versioned developer docs at https://azure.github.io/azure-sdk-for-python.
MIT License
4.65k stars 2.84k forks source link

[BUG Bash] Azure ML Model Local Deployment #20149

Closed nikhilmundhra closed 2 years ago

nikhilmundhra commented 3 years ago

Describe the bug While deploying ML Model to Local, getting the error as:- ModuleNotFoundError: No module named 'azureml.api' and ModuleNotFoundError: No module named 'azure.ml'

Exception or Stack Trace PS C:\Users\nikhil.mundhra> docker run -p 6789:80 -it test 2021-08-09T13:15:30,156931600+00:00 - iot-server/run 2021-08-09T13:15:30,157256100+00:00 - rsyslog/run 2021-08-09T13:15:30,157309400+00:00 - gunicorn/run 2021-08-09T13:15:30,158387200+00:00 - nginx/run /usr/sbin/nginx: /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/libcrypto.so.1.0.0: no version information available (required by /usr/sbin/nginx) /usr/sbin/nginx: /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/libcrypto.so.1.0.0: no version information available (required by /usr/sbin/nginx) /usr/sbin/nginx: /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/libssl.so.1.0.0: no version information available (required by /usr/sbin/nginx) /usr/sbin/nginx: /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/libssl.so.1.0.0: no version information available (required by /usr/sbin/nginx) /usr/sbin/nginx: /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/libssl.so.1.0.0: no version information available (required by /usr/sbin/nginx) EdgeHubConnectionString and IOTEDGE_IOTHUBHOSTNAME are not set. Exiting... 2021-08-09T13:15:30,239506000+00:00 - iot-server/finish 1 0 2021-08-09T13:15:30,241673800+00:00 - Exit code 1 is normal. Not restarting iot-server. Starting gunicorn 20.1.0 Listening at: http://127.0.0.1:31311 (13) Using worker: sync worker timeout is set to 300 Booting worker with pid: 55 SPARK_HOME not set. Skipping PySpark Initialization. /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:516: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_qint8 = np.dtype([("qint8", np.int8, 1)]) /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:517: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_quint8 = np.dtype([("quint8", np.uint8, 1)]) /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:518: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_qint16 = np.dtype([("qint16", np.int16, 1)]) /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:519: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_quint16 = np.dtype([("quint16", np.uint16, 1)]) /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:520: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_qint32 = np.dtype([("qint32", np.int32, 1)]) /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:525: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. np_resource = np.dtype([("resource", np.ubyte, 1)]) Generating new fontManager, this may take some time... /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:541: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_qint8 = np.dtype([("qint8", np.int8, 1)]) /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:542: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_quint8 = np.dtype([("quint8", np.uint8, 1)]) /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:543: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_qint16 = np.dtype([("qint16", np.int16, 1)]) /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:544: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_quint16 = np.dtype([("quint16", np.uint16, 1)]) /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:545: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_qint32 = np.dtype([("qint32", np.int32, 1)]) /azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:550: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. np_resource = np.dtype([("resource", np.ubyte, 1)]) Exception in worker process Traceback (most recent call last): File "/var/azureml-server/routes_common.py", line 37, in from azureml.api.exceptions.ClientSideException import ClientSideException ModuleNotFoundError: No module named 'azureml.api'

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker worker.init_process() File "/azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/gunicorn/workers/base.py", line 134, in init_process self.load_wsgi() File "/azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/gunicorn/workers/base.py", line 146, in load_wsgi self.wsgi = self.app.wsgi() File "/azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/gunicorn/app/base.py", line 67, in wsgi self.callable = self.load() File "/azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/gunicorn/app/wsgiapp.py", line 58, in load return self.load_wsgiapp() File "/azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/gunicorn/app/wsgiapp.py", line 48, in load_wsgiapp return util.import_app(self.app_uri) File "/azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/site-packages/gunicorn/util.py", line 359, in import_app mod = importlib.import_module(module) File "/azureml-envs/azureml_750fff264b7151d70362c7892fec63f6/lib/python3.6/importlib/init.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 978, in _gcd_import File "", line 961, in _find_and_load File "", line 950, in _find_and_load_unlocked File "", line 655, in _load_unlocked File "", line 678, in exec_module File "", line 205, in _call_with_frames_removed File "/var/azureml-server/entry.py", line 1, in import create_app File "/var/azureml-server/create_app.py", line 4, in from routes_common import main File "/var/azureml-server/routes_common.py", line 39, in from azure.ml.api.exceptions.ClientSideException import ClientSideException ModuleNotFoundError: No module named 'azure.ml' Worker exiting (pid: 55) Shutting down: Master Reason: Worker failed to boot. 2021-08-09T13:15:32,813319200+00:00 - gunicorn/finish 3 0 2021-08-09T13:15:32,814582400+00:00 - Exit code 3 is not normal. Killing image.

To Reproduce Deploy a Tensorflow Model to local environment

Expected behavior Model gets deployed

Setup (please complete the following information):

luigiw commented 2 years ago

Closing legacy issue.

Please consider upgrading to AzureML v2 CLI/SDK. https://learn.microsoft.com/en-us/azure/machine-learning/concept-v2

eli-halych commented 2 years ago

@luigiw

Facing the same issue. Can't upgrade to v2 CLI/SDK, because I need to use an endpoint in Power BI and Power BI only supports v1 CLI/SDK.

luigiw commented 2 years ago

@eli-halych is there a tutorial you're following on using AzureML endpoints in PowerBI? I want to understand more on why PowerBI doesn't support v2.

eli-halych commented 1 year ago

@eli-halych is there a tutorial you're following on using AzureML endpoints in PowerBI? I want to understand more on why PowerBI doesn't support v2.

https://learn.microsoft.com/en-us/power-bi/connect-data/service-aml-integrate

It says in purple: "Currently, Online endpoints (v2 endpoint) are not supported in Power BI yet. ACI/AKS web services (v1 web services) are only supported."

eli-halych commented 1 year ago

@nikhilmundhra, this is what worked for me:

python==3.8.13 pip==22.3 azureml-defaults<=1.28.0 or azureml-defaults==1.28.0 (try both, sometimes there's weird behavior if it's just ==1.28.0)

azureml-defaults will install azureml-core, don't include it manually.