[AML] Prompt flow to deployment has permission issue

[lzhecheng]

[Enter feedback here]

Hello, I'm tried to turn a prompt flow to a deployment. Somehow it doesn't work to send requests with the deployment. Error logs says:

2024-03-26 05:28:01 +0000      21 execution.flow     INFO     [lookup in line None (index starts from 0)] stdout> [2024-03-26 05:28:01] INFO     azureml.rag.connections - Parsed Connection: /subscriptions/xxx/resourceGroups/zhecheng-ai/providers/Microsoft.MachineLearningServices/workspaces/zhecheng-aml1/connections/aoai-connection (connections.py:257)
2024-03-26 05:28:03 +0000      21 execution          WARNING  [lookup in line None (index starts from 0)] stderr> MSI: Failed to retrieve a token from 'http://10.0.0.4:8911/v1/token/msi/xds' with an error of '405 Client Error: Method Not Allowed for url: http://10.0.0.4:8911/v1/token/msi/xds'. This could be caused by the MSI extension not yet fully provisioned.
2024-03-26 05:28:03 +0000      21 execution.flow     INFO     [lookup in line None (index starts from 0)] stdout> Performing interactive authentication. Please follow the instructions on the terminal.
2024-03-26 05:28:03 +0000      21 execution          WARNING  [lookup in line None (index starts from 0)] stderr> To sign in, use a web browser to open the page https://microsoft.com/devicelogin and enter the code xxx to authenticate.
2024-03-26 05:29:00 +0000      21 execution          WARNING  lookup has been running for 60 seconds, stacktrace of thread 140032845281024:
  File "/azureml-envs/prompt-flow/runtime/lib/python3.9/site-packages/promptflow/tracing/_trace.py", line 352, in wrapped
    output = func(*args, **kwargs)
  File "/azureml-envs/prompt-flow/runtime/lib/python3.9/site-packages/promptflow_vectordb/tool/common_index_lookup.py", line 74, in search
    search_func = _get_search_func(mlindex_content, top_k, query_type)
  File "/azureml-envs/prompt-flow/runtime/lib/python3.9/site-packages/promptflow_vectordb/tool/common_index_lookup.py", line 38, in _get_search_func
    return build_search_func(index, top_k, query_type)
  File "/azureml-envs/prompt-flow/runtime/lib/python3.9/site-packages/promptflow_vectordb/tool/common_index_lookup_extensions/utils.py", line 24, in build_search_func
    store = index.as_langchain_vectorstore()
  File "/azureml-envs/prompt-flow/runtime/lib/python3.9/site-packages/azureml/rag/mlindex.py", line 270, in as_langchain_vectorstore
    fs.download(f"{uri.rstrip('/')}/index.pkl", f"{tmpdir!s}")
  File "/azureml-envs/prompt-flow/runtime/lib/python3.9/site-packages/fsspec/spec.py", line 1546, in download
    return self.get(rpath, lpath, recursive=recursive, **kwargs)
  File "/azureml-envs/prompt-flow/runtime/lib/python3.9/site-packages/azureml/dataprep/api/_loggerfactory.py", line 279, in wrapper
    return func(*args, **kwargs)
  File "/azureml-envs/prompt-flow/runtime/lib/python3.9/site-packages/azureml/fsspec/spec.py", line 529, in get
    return sync(self.loop, self._get, rpath, lpath, recursive, callback, **kwargs)
  File "/azureml-envs/prompt-flow/runtime/lib/python3.9/site-packages/fsspec/asyn.py", line 91, in sync
    if event.wait(1):
  File "/azureml-envs/prompt-flow/runtime/lib/python3.9/threading.py", line 581, in wait
    signaled = self._cond.wait(timeout)
  File "/azureml-envs/prompt-flow/runtime/lib/python3.9/threading.py", line 316, in wait
    gotit = waiter.acquire(True, timeout)

Prompt flow: Q&A on Your Data Endpoint role assignment:

I think it has enough permission according to the doc.

---

Document Details

⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

• ID: 96e1e856-69a8-8496-651c-d0c460992250
• Version Independent ID: 156e113f-5d44-7b90-d1ce-c8cce907964a
• Content: Deploy a flow in prompt flow as a managed online endpoint for real-time inference - Azure Machine Learning
• Content Source: articles/machine-learning/prompt-flow/how-to-deploy-for-real-time-inference.md
• Service: machine-learning
• Sub-service: prompt-flow
• GitHub Login: @likebupt
• Microsoft Alias: keli19

[AjayBathini-MSFT]

@lzhecheng Thanks for your feedback! We will investigate and update as appropriate.

[RamanathanChinnappan-MSFT]

@lzhecheng I've delegated this to @likebupt, a content author, to review and share their valuable insights.

[mmaks74]

Hello, I've got the same issue. Please share the resolution if any.

'MSI: Failed to retrieve a token from 'http://10.0.0.4:8911/v1/token/msi/xds' with an error of '405 Client Error: Method Not Allowed for url: http://10.0.0.4:8911/v1/token/msi/xds'. This could be caused by the MSI extension not yet fully provisioned.'