kubeflow / spark-operator

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
Apache License 2.0
2.77k stars 1.38k forks source link

[QUESTION] is it possible to get application status with an api call? #2184

Open matanparker opened 4 weeks ago

matanparker commented 4 weeks ago

Hi,

Is it possible to retrieve the status of Spark applications via an API after the driver service has terminated? I'm looking for something similar to the output of the following kubectl command:

kubectl get sparkapplications [application-name] -n [namespace] -o yaml

jacobsalway commented 3 weeks ago

Hi @matanparker, are you referring to a HTTP API for getting details of or the status of an application? Or about persisting application history after driver termination and being able to query that historical state?