radanalyticsio / spark-operator

Operator for managing the Spark clusters on Kubernetes and OpenShift.
Apache License 2.0
157 stars 61 forks source link

Use radanalyticsio/openshift-spark:2.4-latest or 2.4.5-2 for apps #285

Closed tmckayus closed 4 years ago

tmckayus commented 4 years ago

Description

some of the app examples are using older versions of spark 2.3. on current versions of openshift, spark-on-k8s does not work for spark versions before 2.4.5

Types of changes

:bug: Bug fix (non-breaking change which fixes an issue)

tmckayus commented 4 years ago

@elmiko @jkremser ptal

on recent openshift tests, spark-on-k8s fails with protocal errors talking to the kube master for versions of spark before 2.4.5 (see https://bugzilla.redhat.com/show_bug.cgi?id=1794146)