-
I am not too sure if this is an issue with Spark/K8S or the entry-point of the image, but the result is that the driver can not access the files passed through `--py-files` and `--files` when these ar…
-
### Description of the problem / feature request:
Bazel query today operates at a target level. It helpfully also includes generator_name, generator_function, and generator_location attributes for…
-
- [ ] ✋ I have searched the open/closed issues and my issue is not listed.
I am trying to deploy a Spark application on Kubernetes using the Spark Operator, but I'm encountering an issue related to…
-
## Description
A clear and concise description of the new feature. It can include what the problem is and what you want to happen, and is preferably focused on the business context or how this impact…
-
Example: https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/examples/spark-pi.yaml
Operator values
```
operatorVersion: v1beta2-1.2.1-3.0.0
imagePullSecrets:
- name: ha…
-
I have a problem changing the flink application in my pipeline. The problem is this: for example, I want to change the amount of memory for the task мanager in one of the job clusters. I change the d…
-
### What happened?
I am trying to deploy a Beam job (Python Beam) that runs on a PortableRunner (Flink Runner) in my Kubernetes cluster.
I have not experienced issues prior with Beam using the Flin…
-
It seems that `enable-ui-service` was added recently.
Which result in passing `-enable-ui-service=true/false` on `spark-operator` deployment even with old version `spark-operator` who doesn't accept…
-
I have installed the spark operator on AKS 1.19 but when I pass the environment variable in the given example
https://github.com/GoogleCloudPlatform/spark-on-k8s-operator…
-
See discussion in #719 with this last open issue. Moving to a separate issue for clarity.
> > How can you launch a spark application and then reliably wait for it to finish?
>
> I would explore…