azureml-fsspec is incompatible with Apple Silicon

[korommatyi]

• Package Name: azureml-fsspec
• Package Version: 1.0.0
• Operating System: MacOS 13.4
• Python Version: 3.8 and 3.10

Describe the bug azureml-fsspec refuses to install on Mac with Apple Silicon

To Reproduce From a fresh virtualenv:

% pip install azureml-fsspec
Collecting azureml-fsspec
  Using cached azureml_fsspec-1.0.0-py3-none-any.whl (11 kB)
Collecting azureml-core (from azureml-fsspec)
  Using cached azureml_core-1.51.0-py3-none-any.whl (3.3 MB)
Collecting azureml-dataprep<4.11.0a,>=4.10.0a (from azureml-fsspec)
  Using cached azureml_dataprep-4.10.7-py3-none-any.whl (38.2 MB)
Collecting fsspec>=2021.6.1 (from azureml-fsspec)
  Using cached fsspec-2023.5.0-py3-none-any.whl (160 kB)
INFO: pip is looking at multiple versions of azureml-dataprep to determine which version is compatible with other requirements. This could take a while.
Collecting azureml-dataprep<4.11.0a,>=4.10.0a (from azureml-fsspec)
  Using cached azureml_dataprep-4.10.6-py3-none-any.whl (38.2 MB)
  Using cached azureml_dataprep-4.10.5-py3-none-any.whl (38.2 MB)
  Using cached azureml_dataprep-4.10.4-py3-none-any.whl (38.2 MB)
  Using cached azureml_dataprep-4.10.1-py3-none-any.whl (38.4 MB)
  Using cached azureml_dataprep-4.10.0-py3-none-any.whl (43.5 MB)
ERROR: Cannot install azureml-fsspec because these package versions have conflicting dependencies.

The conflict is caused by:
    azureml-dataprep 4.10.7 depends on dotnetcore2<4.0.0 and >=3.0.0
    azureml-dataprep 4.10.6 depends on dotnetcore2<4.0.0 and >=3.0.0
    azureml-dataprep 4.10.5 depends on dotnetcore2<4.0.0 and >=3.0.0
    azureml-dataprep 4.10.4 depends on dotnetcore2<4.0.0 and >=3.0.0
    azureml-dataprep 4.10.1 depends on dotnetcore2<4.0.0 and >=3.0.0
    azureml-dataprep 4.10.0 depends on dotnetcore2<4.0.0 and >=3.0.0

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts

Additional context The error is probably due to dotnetcore2 (a transitive dependency of azureml-fsspec) not being released for ARM Macs.

[github-actions[bot]]

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @azureml-github @Azure/azure-ml-sdk.

[kristapratico]

Hi @korommatyi thanks for your feedback, @azureml-github will investigate asap.

[korommatyi]

Hi @kristapratico, I hope you are well. Do you have any news on this issue?

[kristapratico]

@luigiw - can you take a look at this issue and provide an update?

[jzm0144]

still dealing with the issue. any update?

[kristapratico]

@diondrapeck