stackabletech / spark-k8s-operator

Operator for Apache Spark-on-Kubernetes for Stackable Data Platform
https://stackable.tech
Other
52 stars 3 forks source link

Fix the list of supported Spark versions #224

Closed siegfriedweber closed 1 year ago

siegfriedweber commented 1 year ago

The list of supported Spark versions must be adjusted in the documentation, the docker-images repository, and the integration tests. Currently they differ.

Documentation

The documentation states that the following versions are supported:

Docker images

There are only images tagged with

There is no explicit python39 image.

In the next release, there will also be an image tagged with 3.3.0-java17-stackable23.4.0 but only for pyspark, not for spark.

Integration tests

The integration tests only cover 3.3.0-stackable23.1.0. A local test run with 3.2.1-stackable23.1.0 failed.