azure-storage-file-datalake and azureml-mlflow have dependency conflicts

[jinlow]

• Package Name: azure-storage-file-datalake, azureml-mlflow
• Package Version: azure-storage-file-datalake (12.12.0), azureml-mlflow (1.52.0)
• Operating System: Ubuntu 20.04
• Python Version: 3.10

Describe the bug I am attempting to use azure-storage-file-datalake in an environment that I also want to use azureml-mlflow in, inside of azureML. However I am having a hard time creating an environment that uses both of these packages, because azure-storage-file-datalake has the dependency constraint azure-storage-blob<13.0.0,>=12.18.0 but azureml-mlflow has the constraint azure-storage-blob<=12.13.0,>=12.5.0.

To Reproduce Create an environment with the following conda yaml file.

name: test-env
dependencies:
  - python=3.10
  - pip:
    - azure-storage-file-datalake>=12.12.0
    - azureml-mlflow>=1.52.0

The error I receive.

ERROR: ResolutionImpossible
The conflict is caused by:
    azure-storage-file-datalake 12.12.0 depends on azure-storage-blob<13.0.0 and >=12.17.0
    azureml-mlflow 1.52.0 depends on azure-storage-blob<=12.13.0 and >=12.5.0
    azure-storage-file-datalake 12.12.0 depends on azure-storage-blob<13.0.0 and >=12.17.0
    azureml-mlflow 1.51.0 depends on azure-storage-blob<=12.13.0 and >=12.5.0

Expected behavior I want to be able to create an environment with both of these packages.

Screenshots If applicable, add screenshots to help explain your problem.

Additional context Add any other context about the problem here.

[jinlow]

I received an email that the GitHub event processor runs failed, I don’t know if this will impact this issue being seen, because it looks like the automatic labels such as “needs-triage” did not get added.

[jinlow]

Hello, is there any update on this? These are core dependencies of the Azure ecosystem, and are not able to be used together because of this bug.

[jinlow]

@iscai-msft Is there anyway to get this issue in triage? The labels didn't add automatically, and it seems as if no one has seen it. Thanks

[haraldger]

I am also having the same issue as the above, a dependency conflict between the two packages azure-storage-file-datalake and azureml-mlflow, and it's really halting our development. A fix or workaround would be greatly appreciated.

[harrysummer]

I am facing the same issue. My workaround is to explicitly use an earlier version of azure-storage-file-datalake==12.8.0. But the root cause is with the azureml-mlflow package which needs to be updated with the latest azure-storage-blob in its dependency.

[mmershon-pioneer]

Facing the same issue. Azure AI tutorials don't work now: https://github.com/mmershon-pioneer/azureai-samples/blob/main/notebooks/rag/rag-index-creation/create-index-from-various-sources.ipynb.

[jinlow]

Yeah, I cannot get anyone to notice this issue. @azureml-github do you all have any thoughts?

[bensalem22]

Any updates on this?