-
ETA: 2024-06-30
We want to use IPv4 addresses of SPARK nodes as the scarce resource that makes it expensive for a single party to run many nodes. ATM, we rely on the trusted spark-api service to re…
-
It seems that `enable-ui-service` was added recently.
Which result in passing `-enable-ui-service=true/false` on `spark-operator` deployment even with old version `spark-operator` who doesn't accept…
-
cc @Fokko .
This is a super simple implementation of an iceberg client for dask. It works for the limited couple of datasets I have available including
- version metadata choice
- snapshot time …
-
I have installed the spark operator on AKS 1.19 but when I pass the environment variable in the given example
https://github.com/GoogleCloudPlatform/spark-on-k8s-operator…
-
See discussion in #719 with this last open issue. Moving to a separate issue for clarity.
> > How can you launch a spark application and then reliably wait for it to finish?
>
> I would explore…
-
Can someone help me find the code for image - gcr.io/spark-operator/spark:v3.1.1?
-
Operator deployed using:
```
apiVersion: helm.fluxcd.io/v1
kind: HelmRelease
metadata:
name: google-spark-operator
namespace: kube-system
spec:
chart:
repository: https://googlecl…
-
k8s: GKE 1.17 with auto-scaling node-pool with taint
spark-operator: v1beta2-1.2.0-3.0.0
SparkApp:
dynamicAllocation: enabled
tolerations and nodeSelector: specified
Sometimes executors get…
-
**Your Godot version:**
4.2
**Issue description:**
Decisions made in the style guide are often based in some judgement on what is most useful to the reader/author of the code. For example: ["This…
-
Hi, I built mango on Amazon EMR (5.3.1) as follows:
```
git clone https://github.com/bigdatagenomics/mango.git
cd mango
sh ./scripts/move_to_spark_2.sh
sh ./scripts/move_to_scala_2.11.sh
mvn …