Kotlin / kotlin-spark-api

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x
Apache License 2.0
456 stars 34 forks source link

Udt support, DF functions, mllib example #162

Closed Jolanrensen closed 2 years ago

Jolanrensen commented 2 years ago

As requested by https://github.com/Kotlin/kotlin-spark-api/issues/29 and needed for https://github.com/Kotlin/kotlin-spark-api/issues/161. Allows the implicit encoder<>() function to get to registered UDTs.

Does still need tests!

Jolanrensen commented 2 years ago

Removing typedCol() again since they already get an overhaul for kotlin 1.7 in https://github.com/Kotlin/kotlin-spark-api/pull/152

Jolanrensen commented 2 years ago

@asm0dey I think we can merge this. I'd prefer this to go first before udf :)