Kotlin / kotlin-spark-api

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x
Apache License 2.0
455 stars 34 forks source link

Explore crossbuild gradle plugin #179

Open Jolanrensen opened 2 years ago

Jolanrensen commented 2 years ago

https://github.com/prokod/gradle-crossbuild-scala/pull/117

asm0dey commented 1 year ago

@Jolanrensen is it implemented on the side of the crossbuild plugin?

Jolanrensen commented 1 year ago

@asm0dey Yes, but I haven't had time to try it in the project here yet, especially since the GH actions approach works so well now

asm0dey commented 1 year ago

Don't you think this could improve the overall performance?

Jolanrensen commented 1 year ago

hmm maybe, but not by much. Only if you want to quickly test a couple of versions locally it would help. There would be no difference with GH actions, since that runs in parallel anyways (and gh actions can also be run locally). Eventually, the crossbuild plugin will be better, but it will cost a lot of time to figure out how to rework the entire build schema again and I'm not sure if that's worth it right now. What do you think?