search

coiled / feedback

A place to provide Coiled feedback
14 stars 3 forks source link

Package sync version mismatch #210

Closed mrocklin closed 1 year ago

mrocklin commented 2 years ago

https://cloud.coiled.io/mrocklin/clusters/101285/details

mport coiled

cluster = coiled.Cluster(
    n_workers=100,
    name="arxiv",
    package_sync=True, 
    backend_options={"region": "us-east-1"},  # faster and cheaper
)
+-------------+-----------+-----------+----------+
| Package     | Client    | Scheduler | Workers  |
+-------------+-----------+-----------+----------+
| dask        | 2022.10.0 | 2022.9.1  | 2022.9.1 |
| distributed | 2022.10.0 | 2022.9.1  | 2022.9.1 |
+-------------+-----------+-----------+----------+

Low urgency, just reporting

ntabris commented 2 years ago

Hm, weird. As far as I can tell 2022.10.0 was installed on the cluster so I'd suspect problem w/ however dask determines versions (that message is from dask, as you probably know).

Logs show:

+ dask                              2022.10.0  pyhd8ed1ab_2         conda-forge/noarch         6kB

[...]

Linking dask-2022.10.0-pyhd8ed1ab_2
micromamba create command ``` [2022-10-26 15:58:47,841][INFO ][cloud-env.subproc] micromamba create -r /opt/coiled/rt -p /opt/coiled/env -y --no-pyc conda-forge::zstd~=1.5.2 conda-forge::zlib~=1.2.12 conda-forge::zipp~=3.8.1 conda-forge::zict~=2.2.0 conda-forge::zeromq~=4.3.4 conda-forge::zarr~=2.13.2 conda-forge::yarl~=1.7.2 conda-forge::yaml~=0.2.5 conda-forge::xz~=5.2.6 conda-forge::xorg-libxdmcp~=1.1.3 conda-forge::xorg-libxau~=1.0.9 conda-forge::wrapt~=1.14.1 conda-forge::widgetsnbextension~=3.6.1 conda-forge::wheel~=0.37.1 conda-forge::webencodings~=0.5.1 conda-forge::wcwidth~=0.2.5 conda-forge::urllib3~=1.26.11 conda-forge::unicodedata2~=14.0.0 conda-forge::tzdata==2022c conda-forge::typing_extensions~=4.3.0 conda-forge::typing-extensions~=4.3.0 conda-forge::traitlets~=5.3.0 conda-forge::tornado==6.1 conda-forge::toolz~=0.12.0 conda-forge::tomli~=2.0.1 conda-forge::tk~=8.6.12 conda-forge::textual~=0.1.18 conda-forge::testpath~=0.6.0 conda-forge::terminado~=0.15.0 conda-forge::tblib~=1.7.0 conda-forge::stack_data~=0.5.0 conda-forge::soupsieve~=2.3.2.post1 conda-forge::sortedcontainers~=2.4.0 conda-forge::snappy~=1.1.9 conda-forge::six~=1.16.0 conda-forge::setuptools~=65.3.0 conda-forge::s3transfer~=0.6.0 conda-forge::s3fs~=2022.8.2 conda-forge::rsa==4.9 conda-forge::rich~=12.5.1 conda-forge::requests-oauthlib~=1.3.1 conda-forge::requests~=2.28.1 conda-forge::readline~=8.1.2 conda-forge::re2~=2022.6.1 conda-forge::pyzmq~=23.2.1 conda-forge::pyu2f~=0.1.5 conda-forge::pytz~=2022.2.1 conda-forge::python_abi==3.10 conda-forge::python-dateutil~=2.8.2 conda-forge::python==3.10.6 conda-forge::pytest-asyncio~=0.19.0 conda-forge::pytest~=7.1.3 conda-forge::pyrsistent~=0.18.1 conda-forge::pyparsing~=3.0.9 conda-forge::pycparser==2.21 conda-forge::pyasn1-modules~=0.2.7 conda-forge::pyasn1~=0.4.8 conda-forge::pyarrow~=9.0.0 conda-forge::pyopenssl~=22.0.0 conda-forge::py~=1.11.0 conda-forge::pure_eval~=0.2.2 conda-forge::ptyprocess~=0.7.0 conda-forge::pthread-stubs==0.4 conda-forge::psutil~=5.9.2 conda-forge::protobuf~=4.21.5 conda-forge::prompt-toolkit~=3.0.31 conda-forge::prometheus_client~=0.14.1 conda-forge::pluggy~=1.0.0 conda-forge::pkgutil-resolve-name~=1.3.10 conda-forge::pip~=22.2.2 conda-forge::pickleshare~=0.7.5 conda-forge::pexpect~=4.8.0 conda-forge::partd~=1.3.0 conda-forge::parso~=0.8.3 conda-forge::parquet-cpp~=1.5.1 conda-forge::pandocfilters~=1.5.0 conda-forge::pandas==1.5.0 conda-forge::packaging==21.3 conda-forge::orc~=1.7.6 conda-forge::openjpeg~=2.5.0 conda-forge::oauthlib~=3.2.1 conda-forge::numpy==1.23.2 conda-forge::numcodecs~=0.10.2 conda-forge::notebook~=6.4.12 conda-forge::nest-asyncio~=1.5.5 conda-forge::ncurses==6.3 conda-forge::nbformat~=5.4.0 conda-forge::nbconvert~=6.4.5 conda-forge::nbclient~=0.5.13 conda-forge::munkres~=1.1.4 conda-forge::multidict~=6.0.2 conda-forge::msgpack-python==1.0.4 conda-forge::mistune~=0.8.4 conda-forge::matplotlib-inline~=0.1.6 conda-forge::matplotlib~=3.6.0 conda-forge::lz4-c~=1.9.3 conda-forge::lz4~=4.0.0 conda-forge::locket~=1.0.0 conda-forge::llvm-openmp~=14.0.4 conda-forge::libzlib~=1.2.12 conda-forge::libxcb==1.13 conda-forge::libwebp-base~=1.2.4 conda-forge::libutf8proc~=2.7.0 conda-forge::libtiff~=4.4.0 conda-forge::libthrift~=0.16.0 conda-forge::libssh2~=1.10.0 conda-forge::libsqlite~=3.39.3 conda-forge::libsodium~=1.0.18 conda-forge::libprotobuf~=3.21.5 conda-forge::libpng~=1.6.37 conda-forge::libopenblas~=0.3.21 conda-forge::libnghttp2~=1.47.0 conda-forge::liblapack~=3.9.0 conda-forge::libgoogle-cloud~=2.2.0 conda-forge::libffi~=3.4.2 conda-forge::libevent~=2.1.10 conda-forge::libev==4.33 conda-forge::libedit~=3.1.20191231 conda-forge::libdeflate==1.13 conda-forge::libcxx~=14.0.6 conda-forge::libcurl~=7.83.1 conda-forge::libcrc32c~=1.1.2 conda-forge::libcblas~=3.9.0 conda-forge::libbrotlienc~=1.0.9 conda-forge::libbrotlidec~=1.0.9 conda-forge::libbrotlicommon~=1.0.9 conda-forge::libblas~=3.9.0 conda-forge::lerc~=4.0.0 conda-forge::lcms2==2.12 conda-forge::krb5~=1.19.3 conda-forge::kiwisolver~=1.4.4 conda-forge::jupyterlab_widgets~=1.1.1 conda-forge::jupyterlab_pygments~=0.2.2 conda-forge::jupyter_core~=4.11.1 conda-forge::jupyter_client~=7.3.4 conda-forge::jsonschema~=4.15.0 conda-forge::jsondiff~=2.0.0 conda-forge::jpeg==9e conda-forge::jmespath~=1.0.1 conda-forge::jedi~=0.18.1 conda-forge::ipywidgets~=7.7.2 conda-forge::ipython_genutils~=0.2.0 conda-forge::ipython~=8.5.0 conda-forge::ipykernel~=6.15.2 conda-forge::innerscope~=0.5.1 conda-forge::iniconfig~=1.1.1 conda-forge::importlib_resources~=5.9.0 conda-forge::importlib-metadata~=4.11.4 conda-forge::idna==3.3 conda-forge::googleapis-common-protos~=1.56.4 conda-forge::google-resumable-media~=2.3.3 conda-forge::google-crc32c~=1.1.2 conda-forge::google-cloud-storage~=2.5.0 conda-forge::google-cloud-core~=2.3.2 conda-forge::google-auth-oauthlib~=0.5.3 conda-forge::google-auth~=2.11.0 conda-forge::google-api-core~=2.10.1 conda-forge::glog~=0.6.0 conda-forge::gflags~=2.2.2 conda-forge::gcsfs~=2022.8.2 conda-forge::future~=0.18.2 conda-forge::fsspec~=2022.8.2 conda-forge::frozenlist~=1.3.1 conda-forge::freetype~=2.12.1 conda-forge::fonttools~=4.37.3 conda-forge::flit-core~=3.7.1 conda-forge::python-fastjsonschema~=2.16.1 conda-forge::fasteners~=0.17.3 conda-forge::executing~=1.0.0 conda-forge::entrypoints==0.4 conda-forge::defusedxml~=0.7.1 conda-forge::decorator~=5.1.1 conda-forge::debugpy~=1.6.3 conda-forge::dataclasses==0.8 conda-forge::dask==2022.10.0 conda-forge::cytoolz~=0.12.0 conda-forge::cycler~=0.11.0 conda-forge::cryptography~=37.0.4 conda-forge::contourpy~=1.0.5 conda-forge::commonmark~=0.9.1 conda-forge::cloudpickle==2.1.0 conda-forge::click~=8.1.3 conda-forge::charset-normalizer~=2.1.1 conda-forge::cffi~=1.15.1 conda-forge::certifi~=2022.9.24 conda-forge::cachetools~=5.2.0 conda-forge::ca-certificates~=2022.9.24 conda-forge::c-ares~=1.18.1 conda-forge::bzip2~=1.0.8 conda-forge::brotlipy~=0.7.0 conda-forge::brotli-bin~=1.0.9 conda-forge::brotli~=1.0.9 conda-forge::botocore~=1.27.59 conda-forge::boto3~=1.24.59 conda-forge::bokeh~=2.4.3 conda-forge::blinker==1.4 conda-forge::bleach~=5.0.1 conda-forge::beautifulsoup4~=4.11.1 conda-forge::backports.functools_lru_cache~=1.6.4 conda-forge::backports==1.0 conda-forge::backoff~=1.11.1 conda-forge::backcall~=0.2.0 conda-forge::aws-sdk-cpp~=1.8.186 conda-forge::aws-checksums~=0.1.11 conda-forge::aws-c-io~=0.10.5 conda-forge::aws-c-event-stream~=0.2.7 conda-forge::aws-c-common~=0.6.2 conda-forge::aws-c-cal~=0.5.11 conda-forge::attrs~=22.1.0 conda-forge::async-timeout~=4.0.2 conda-forge::asttokens~=2.0.8 conda-forge::asciitree~=0.3.3 conda-forge::argon2-cffi-bindings~=21.2.0 conda-forge::argon2-cffi~=21.3.0 conda-forge::appnope~=0.1.3 conda-forge::aiosignal~=1.2.0 conda-forge::aioitertools~=0.10.0 conda-forge::aiohttp~=3.8.1 conda-forge::aiobotocore~=2.4.0 conda-forge::afar~=0.6.1 conda-forge::send2trash~=1.8.0 conda-forge::pygments~=2.13.0 conda-forge::pyyaml==6.0 conda-forge::pysocks~=1.7.1 conda-forge::pyjwt~=2.5.0 conda-forge::pillow~=9.2.0 conda-forge::markupsafe~=2.1.1 conda-forge::jinja2~=3.1.2 conda-forge::heapdict~=1.0.1 ```
shughes-uk commented 1 year ago

This is pretty stale and i haven't seen this in recent times. Reopen if it pops up again