search

Kotlin / kotlin-spark-api

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x
Apache License 2.0
464 stars 35 forks source link

Bump version of spark to 3.4.1 #206

Closed devongleeson closed 1 year ago

devongleeson commented 1 year ago

There is a recent CVE against spark 3.3.x line, CVE-2023-22946, where the suggested mitigation is upgrading to the 3.4.x line.

devongleeson commented 1 year ago

Would it make sense to include 3.4.0 as well?

Jolanrensen commented 1 year ago

Unfortunately, that won't work as expected, as explained in this issue: https://github.com/Kotlin/kotlin-spark-api/issues/195. A simple version bump will most likely cause many unexpected bugs since our hacky implementation (the core scala module of the project) has deviated too much from the original Spark one. Supporting 3.4+ would require a major overhaul.

devongleeson commented 1 year ago

Ah, that's too bad.