search

GoogleCloudDataproc / initialization-actions

Run in all nodes of your cluster before the cluster starts - lets you customize your cluster
https://cloud.google.com/dataproc/init-actions
Apache License 2.0
588 stars 512 forks source link

[dask] updated dask version to 2022.3 on 2.0 and 2.1, 2024.06 on 2.2 #1194

Closed cjac closed 4 months ago

cjac commented 4 months ago

We re-combined the mamba and conda commands since the python versions resolve on these dask releases.

manual tests performed:

cjac commented 4 months ago

@jankichaudhari226 - please review

prince-cs commented 4 months ago

/gcbrun

prince-cs commented 4 months ago

The presubmits are failing.

https://pantheon.corp.google.com/cloud-build/builds/6e6806c6-3dd8-4fa3-98b0-fc35856c168d;step=5?inv=1&invt=AbVTrA&mods=dataproc_env_image_prod&project=cloud-dataproc-ci

kuldeepkk-dev commented 4 months ago

Build is failing for 2.1. @cjac Have you tested these changes manually? Please confirm.

cjac commented 4 months ago

I have. I think I left test logs in the comments.