JahstreetOrg / spark-on-kubernetes-helm

Spark on Kubernetes infrastructure Helm charts repo
Apache License 2.0
199 stars 76 forks source link

MountVolume.SetUp failed for volume for Livy driver pod #64

Open cdesai1406 opened 3 years ago

cdesai1406 commented 3 years ago

Hello

when I install Livy helm chart and create a Livy driver pod, it failed in most volume set up. I am getting this error even if ConfigMap already there "MountVolume.SetUp failed for volume "spark-conf-volume" : configmap "livy-session-0-ee5a9e78150bb674-driver-conf-map" not found"

Thanks

jahstreet commented 3 years ago

Hi, it is a known bug and it happens periodically. To fix it we need to fix Spark code or upgrade Livy to use the latest Spark version (haven't yet checked whether Spark maintainers have already fixed it). I hope to get to the upgrading somewhere this year, but unfortunately doesn't have enough time to maintain this project at the moment.