Publish POM-only artifacts for Jupyter purposes

Kotlin / kotlin-spark-api

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

Apache License 2.0

464 stars 35 forks source link

Publish POM-only artifacts for Jupyter purposes #208

Open ileasile opened 1 year ago

ileasile commented 1 year ago

Now you list all the needed artifacts right in the integration. It is convenient, but not efficient enough. It's better to publish artifacts for each spark/scala variation and use only a single dependency in the integration. It will significantly speed up the resolution process (3-6 times). I will improve the resolution of multiple dependencies on our side too.

Jolanrensen commented 1 year ago

Hmm, that would result in another 20 packages on maven central called org.jetbrains.kotlinx.spark.jupyter-dependencies_x.x.x_2.x. I don't think Sonatype can handle that XD The current 40+ are already an issue