TIBCOSoftware / snappy-on-k8s

An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes
81 stars 29 forks source link

Access to Zeppelin interpreter logs #5

Closed jramnara closed 6 years ago

jramnara commented 6 years ago

While the stdout, err logging from the zeppelin server is accessible, I don't see how to get the interpreter logs can be accessed (which typically is more valuable ... spark driver failures). Not so familiar with the k8s logging architecture for other options - https://kubernetes.io/docs/concepts/cluster-administration/logging/. Can someone take a look ?

Or, maybe, we re-direct all zeppelin logging also to use the persistent volume, if configured ?

jramnara commented 6 years ago

We do enable spark events logging ... likely some other unrelated problem. Closing.