Move to Apache Spark 3.0.0, Python 3.6 and drop Python 2.7

radanalyticsio / oshinko-s2i

This is a place to put s2i images and utilities for spark application builders for openshift

Apache License 2.0

15 stars 27 forks source link

Move to Apache Spark 3.0.0, Python 3.6 and drop Python 2.7 #301

Closed tmckayus closed 4 years ago

tmckayus commented 4 years ago

This change updates to Apache Spark 3.0.0 and Python 3.6 for the Python images. The "pyspark" and "pysyark-inc" images will now use Python 3.6, there will be no py27 images or templates.

Additionally, support for the sparklyr image has been dropped. The previous sparklyr images for Spark 2.4 will remain.