radanalyticsio / openshift-spark

72 stars 83 forks source link

Upgrade to Spark 3.2.0 #117

Open rimolive opened 2 years ago

erikerlandson commented 2 years ago

LGTM we aren't using the s2i scripts?

jkremser commented 2 years ago

can this be merged?

mattf commented 2 years ago

@jkremser does it work for you?

jkremser commented 2 years ago

@mattf I didn't test it with the operator, but I trust Ricardo that he knows what he is doing :) There is also this thing that should help to verify if it's going to work https://github.com/jkremser/spark-operator-image-tool I recall, we had some custom bash scripts in the image, but forgot the details