dask / distributed

A distributed task scheduler for Dask
https://distributed.dask.org
BSD 3-Clause "New" or "Revised" License
1.56k stars 715 forks source link

Broken SSL in MacOS CI #5601

Open crusaderky opened 2 years ago

crusaderky commented 2 years ago

As of this morning, all test suites fail on MacOS github actions, e.g.

https://github.com/dask/distributed/runs/4534704460?check_suite_focus=true

______________ ERROR collecting distributed/comm/tests/test_ws.py ______________
ImportError while importing test module '/Users/runner/work/distributed/distributed/distributed/comm/tests/test_ws.py'.
../../../miniconda3/envs/dask-distributed/lib/python3.7/site-packages/cryptography/hazmat/bindings/openssl/binding.py:14: in <module>
    from cryptography.hazmat.bindings._openssl import ffi, lib
E   ImportError: dlopen(/Users/runner/miniconda3/envs/dask-distributed/lib/python3.7/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so, 2): Library not loaded: @rpath/libssl.1.1.dylib
E     Referenced from: /Users/runner/miniconda3/envs/dask-distributed/lib/python3.7/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so
E     Reason: image not found

The cryptography package hasn't been updated recently.

crusaderky commented 2 years ago

Can anybody with a Intel mac laptop try to reproduce?

jrbourbeau commented 2 years ago

Thanks for surfacing @crusaderky. I was able to reproduce on my Intel mac using the environment file in the mamba export step of that CI build.

FWIW I've seen similar Reason: image not found failures popping up in other projects too. For example over in https://github.com/dask/dask/pull/8472 we're getting (see this CI build):

py.test dask --runslow --cov=dask --cov-report=xml -n4 
ImportError while loading conftest '/Users/runner/work/dask/dask/conftest.py'.
conftest.py:43: in <module>
    import tiledb  # noqa: F401
../../../miniconda3/envs/test-environment/lib/python3.7/site-packages/tiledb/__init__.py:34: in <module>
    ctypes.CDLL(lib_name)
../../../miniconda3/envs/test-environment/lib/python3.7/ctypes/__init__.py:364: in __init__
    self._handle = _dlopen(self._name, mode)
E   OSError: dlopen(libtiledb.dylib, 6): Library not loaded: @rpath/libcrypto.1.1.dylib
E     Referenced from: /Users/runner/miniconda3/envs/test-environment/lib/libtiledb.dylib
E     Reason: image not found

and in https://github.com/coiled/dask-bigquery/pull/31 (see this CI build):

 E            - dlopen(/Users/runner/miniconda3/envs/test-environment/lib/python3.7/site-packages/pyarrow/_parquet.cpython-37m-darwin.so, 2): Library not loaded: @rpath/libssl.1.1.dylib
E             Referenced from: /Users/runner/miniconda3/envs/test-environment/lib/libthrift.0.13.0.dylib
E             Reason: image not found