search

JahstreetOrg / spark-on-kubernetes-helm

Spark on Kubernetes infrastructure Helm charts repo
Apache License 2.0
199 stars 75 forks source link

request for Spark Job-Server #40

Closed huangwei0413 closed 1 year ago

huangwei0413 commented 4 years ago

Is it possible to integrate spark job-server as an alternative? I believe most existing clients use spark job-server rather than Livy. I am expecting your reply, thank you.

jahstreet commented 4 years ago

Hi. I think it is possible, the concepts are similar. The Livy has been chosen to make the migration from Azure HDInsight on my project smoother. Also it's almost out of box integrations with Jupyter work like magic. This could be a good alternative, but I do not have in plans supporting it yet (requires quite some research and coding).

jahstreet commented 1 year ago

Closing due to inactivity, @huangwei0413 please let me know if I can help you with anything else 🙏 .