search

GoogleCloudDataproc / initialization-actions

Run in all nodes of your cluster before the cluster starts - lets you customize your cluster
https://cloud.google.com/dataproc/init-actions
Apache License 2.0
588 stars 512 forks source link

Update spark rapids version to 23.10.0 #1107

Closed SurajAralihalli closed 1 year ago

SurajAralihalli commented 1 year ago

This PR

  1. Updates spark-rapids.sh init script with the latest 23.10.0 (to-date) rapids-4-spark version.
  2. Fixes issue #1109
  3. Installs java ca certificates for deb 10 ahead of driver installation.

signed-off-by: Suraj Aralihalli suraj.ara16@gmail.com

SurajAralihalli commented 1 year ago

@jayadeep-jayaraman The new version of RAPIDS Accelerator is out. Can you review this PR?

FYI @viadea

nvliyuan commented 1 year ago

LGTM

jayadeep-jayaraman commented 1 year ago

/gcbrun

nvliyuan commented 1 year ago

Hi @jayadeep-jayaraman , could you help confirm why the check failed?