search

Kotlin / kotlin-spark-api

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x
Apache License 2.0
455 stars 34 forks source link

support Spark 3.2.0 and other patch-versions #166

Closed Jolanrensen closed 2 years ago

Jolanrensen commented 2 years ago

Currently only the latest Spark 3.x.y versions are supported. KotlinReflection.scala is incompatible with other spark versions than its exact own. We need to set up a plan to (probably) be able to release all versions that users might want. I expect that say 3.2.1 and 3.2.0 will work without any code change except for the version number. 3.1.x and 3.2.y will require some code change, so we can still keep separate branches for that.

Jolanrensen commented 2 years ago

Also, Apache also has Scala 2.13 support for Spark, not sure if we also need to support that and all versions...

Jolanrensen commented 2 years ago

Yes we do and yes we will :) Was a large job but https://github.com/Kotlin/kotlin-spark-api/pull/168 is gonna take care of it all