AbsaOSS / spline-spark-agent

Spline agent for Apache Spark
https://absaoss.github.io/spline/
Apache License 2.0
176 stars 90 forks source link

Scala 2.13 Support #717

Open tculshaw opened 1 year ago

tculshaw commented 1 year ago

Hi,

Apache 3.4.0 onwards can also compile against Scala 2.13.

Is there any plan to provide a cross compiled version of spline for this?

wajda commented 1 year ago

Related to #705

wajda commented 1 day ago

The agent-core is compiled against Spark 2.4 that does not support Scala 2.13. To add Scala 2.13 cross-compilation option we need to decouple the agent core from a particular Spark version and make the dependency dynamic. It requires more work, so I'm postponing the ticket for now.