-
can mainApplicationFile python file can be fetched from volume mount/S3 checkout instead of local in docker images?
Im using spark opertor in kubernetes, instead of spark submit..
if it is **local:/…
-
Hello, I installed the operator on our cluster, but the mutating admission webhook does not modify the pods (setting the security context, in my case).
## Environment
* Kubernetes v1.16.2
* Spark…
-
I am experiencing an intermittent issue with the Spark Operator's monitoring feature, specifically when it's configured to expose metrics to Prometheus. Occasionally, the Spark driver fails to start d…
-
Spark's kubernetes executor [uses the same value for memory request and memory limit](https://github.com/apache/spark/blob/master/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/depl…
-
Hello There,
Quick problem summary: I'm not able to run the job because the volume is not getting mounted. When described the pod, it can't find the configmap. You'll find the error logs below.
…
-
I'm trying to set some additional ports (trying to get a jupyter notebook as driver) as defined [in driver specs](https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/docs/api-docs…
-
New versions of Spark have better Kubernetes integration: https://kubernetes.io/blog/2018/03/apache-spark-23-with-native-kubernetes/
This [sample chart](https://github.com/jahstreet/spark-on-kubern…
banzo updated
3 years ago
-
There's an older vulnerability from 2021 that gets flagged when we're trying to use the spark-operator:
https://github.com/advisories/GHSA-f5f7-6478-qm6p
I haven't looked into the details of the…
-
### What happened?
Sometimes Spark Jobs are failing, because of OOM (There are other open issues related to the OOM itself, e.g. [this one](https://github.com/jaegertracing/spark-dependencies/issues/…
-
Have you tried to use Kubernetes to your docker-zeppelin instead of docker-compose ? similar to below
http://blog.kubernetes.io/2016/03/using-Spark-and-Zeppelin-to-process-Big-Data-on-Kubernetes.html