search

GoogleCloudDataproc / initialization-actions

Run in all nodes of your cluster before the cluster starts - lets you customize your cluster
https://cloud.google.com/dataproc/init-actions
Apache License 2.0
588 stars 512 forks source link

Fixing rapids test for presubmits #1218

Closed prince-cs closed 3 months ago

prince-cs commented 3 months ago

/gcbrun

prince-cs commented 3 months ago

/gcbrun

prince-cs commented 3 months ago

dependent on https://github.com/GoogleCloudDataproc/initialization-actions/pull/1212

cjac commented 3 months ago

I think we should remove the standalone dask action and move all dask installation instructions into this one. spark-rapids is supposed to be the way to install rapids + spark. We can consider this one dask-rapids but named rapids.

prince-cs commented 3 months ago

Closing this PR as @cjac is taking care of rapids and gpu related init actions.