Does this one have a spark UI?

apache-spark-on-k8s / spark

Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/

https://spark.apache.org/

Apache License 2.0

612 stars 118 forks source link

Does this one have a spark UI? #563

Closed leletan closed 6 years ago

leletan commented 6 years ago

It seems the kubernetes dashboard has very limited information about the spark jobs, compared to what spark standalone can provide. Is there such a thing for spark-on-kube?

liyinan926 commented 6 years ago

You can access the Spark web UI using port forwarding. See https://github.com/apache-spark-on-k8s/spark/blob/e2e6fb08414656c6c39efda92fbbce804f93dd59/docs/running-on-kubernetes.md#accessing-driver-ui.

leletan commented 6 years ago

Thanks this is really helpful.

liyinan926 commented 6 years ago

Interesting. This should work as port forwarding is a native Kubernetes feature.

leletan commented 6 years ago

Sorry my bad, this is working.