search

JahstreetOrg / spark-on-kubernetes-helm

Spark on Kubernetes infrastructure Helm charts repo
Apache License 2.0
199 stars 76 forks source link

Sessions dead #85

Open quydx opened 1 year ago

quydx commented 1 year ago

I deploy using default values but after creating session, I get the status of it and got this error message

     "\t container status: ",
        "\t\t container name: spark-kubernetes-driver",
        "\t\t container image: sasnouskikh/livy-spark:0.8.0-incubating-spark_3.0.1_2.12-hadoop_3.2.0_cloud",
        "\t\t container state: waiting",
        "\t\t pending reason: ContainerCreating",
        "23/07/14 08:52:06 INFO LoggingPodStatusWatcherImpl: Deployed Spark application livy-session-0 with submission ID spark-jobs:livy-session-0-1faa39895399a3d2-driver into Kubernetes",
        "23/07/14 08:52:06 INFO ShutdownHookManager: Shutdown hook called",
        "23/07/14 08:52:06 INFO ShutdownHookManager: Deleting directory /tmp/spark-9cdcf0d9-ebca-4548-b591-2e1708c7d050",
        "\nKubernetes Diagnostics: ",
        "Failure executing: GET at: https://kubernetes.default.svc.cluster.local/apis/extensions/v1beta1/namespaces/spark-jobs/ingresses?labelSelector=spark-app-tag%3Dlivy-session-0-Xzo72sxU. Message: 404 page not found\n."
    ]

I see the config of using ingress is set to false but it still seems to try to find ingress. Can you help me ?