AbsaOSS / spline-spark-agent

Spline agent for Apache Spark
https://absaoss.github.io/spline/
Apache License 2.0
185 stars 95 forks source link

spline agent version required for spark 3.4 #734

Closed SATPARDE closed 1 year ago

SATPARDE commented 1 year ago

we want spline agent version required for spark 3.4.

is it already available or it is yet to release?

If it is not released yet then may i know possible timeline to get is released.

We are eagerly waiting for response from you.

wajda commented 1 year ago

Closing as a duplicate for #705.

@SATPARDE there is no timeline, but the demand is raising, so we'll likely start working on it very soon.

Neelotpaul commented 1 year ago

hi @wajda can you inform when spline agent bundle for spark 3.4 demand is completed. It's impacting our production jobs

wajda commented 1 year ago

I will. But the work hasn't been started yet. I estimate Sep-Oct. The team is currently occupied with other things.

Pull-request are always welcome. If you can adapt the agent so that it works at least on Spark 3.4 alone, even if your change breaks any other Spark versions, please don't hesitate to share a PR with us. It will cirtainly speed up the official release.

SATPARDE commented 1 year ago

we want spline agent version required for spark 3.4.

I saw in above messages estimate from your side was sep-oct. So is it available now? if not then what is the new estimate. We are facing some issue with old version ,so wanted to use new version of spark and its imp issue.

So Can you please provide details on this?it would be helpfull

wajda commented 1 year ago

@SATPARDE, this issue is closed as a duplicate. Please refer to the issue #705