search

Kotlin / kotlin-spark-api

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x
Apache License 2.0
455 stars 34 forks source link

Bump version of spark to 3.4.1 #206

Closed devongleeson closed 11 months ago

devongleeson commented 11 months ago

There is a recent CVE against spark 3.3.x line, CVE-2023-22946, where the suggested mitigation is upgrading to the 3.4.x line.

devongleeson commented 11 months ago

Would it make sense to include 3.4.0 as well?

Jolanrensen commented 11 months ago

Unfortunately, that won't work as expected, as explained in this issue: https://github.com/Kotlin/kotlin-spark-api/issues/195. A simple version bump will most likely cause many unexpected bugs since our hacky implementation (the core scala module of the project) has deviated too much from the original Spark one. Supporting 3.4+ would require a major overhaul.

devongleeson commented 11 months ago

Ah, that's too bad.