search

GoogleCloudDataproc / initialization-actions

Run in all nodes of your cluster before the cluster starts - lets you customize your cluster
https://cloud.google.com/dataproc/init-actions
Apache License 2.0
588 stars 512 forks source link

[general] add a table of supported versions #1094

Open cjac opened 1 year ago

cjac commented 1 year ago

Making note in README.md that no versions of these initialization actions are certified to be in working order.

Let's fill in this table with known good image versions and the initialization actions which work on them.

I'm inviting general participation for this commit, please.

cjac commented 1 year ago

@nvliyuan - can you tell me the latest dataproc image versions your team has checked the rapids/rapids.sh and/or gpu/install_gpu_driver.sh on? Should we also include that recent run of the dask tests?

nvliyuan commented 1 year ago

@nvliyuan - can you tell me the latest dataproc image versions your team has checked the rapids/rapids.sh and/or gpu/install_gpu_driver.sh on? Should we also include that recent run of the dask tests?

Currently we only test spark-rapids/ on dataproc image2.0 and image2.1, we don't test dask/.

cjac commented 1 year ago

Thank you! I'll include that information in the patch this week.

On Sun, Oct 8, 2023, 21:16 liyuan @.***> wrote:

@nvliyuan https://github.com/nvliyuan - can you tell me the latest dataproc image versions your team has checked the rapids/rapids.sh and/or gpu/install_gpu_driver.sh on? Should we also include that recent run of the dask tests?

Currently we only test spark-rapids/ on dataproc image2.0 and image2.1, we don't test dask/.

— Reply to this email directly, view it on GitHub https://github.com/GoogleCloudDataproc/initialization-actions/pull/1094#issuecomment-1752291064, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAAM6UTKGNISAXRVDXMIYRTX6NUAZAVCNFSM6AAAAAA5RRCX4SVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONJSGI4TCMBWGQ . You are receiving this because you authored the thread.Message ID: @.*** com>