-
**Summary**
Today, when a plugin stashes the ThreadContext the plugin is in a "trusted" mode where it can perform any action on a cluster (analogous to sudo). Conventionally, stashing the ThreadCon…
-
Configure monitoring for spark applications is slightly confusing.
With this we setup monitoring:
```yaml
monitoring:
metricsProperties: |
*.sink......
*.source....
expo…
-
ETA: 2024-06-30
We want to use IPv4 addresses of SPARK nodes as the scarce resource that makes it expensive for a single party to run many nodes. ATM, we rely on the trusted spark-api service to re…
-
cc @Fokko .
This is a super simple implementation of an iceberg client for dask. It works for the limited couple of datasets I have available including
- version metadata choice
- snapshot time …
-
## Description
My pyspark application needs to access GCP storage bucket, and i've mounted the secret (containing the service account key) as volume mount .. however getting an error.
```
Trace…
-
I am not too sure if this is an issue with Spark/K8S or the entry-point of the image, but the result is that the driver can not access the files passed through `--py-files` and `--files` when these ar…
-
Hi, I built mango on Amazon EMR (5.3.1) as follows:
```
git clone https://github.com/bigdatagenomics/mango.git
cd mango
sh ./scripts/move_to_spark_2.sh
sh ./scripts/move_to_scala_2.11.sh
mvn …
-
**Your Godot version:**
4.2
**Issue description:**
Decisions made in the style guide are often based in some judgement on what is most useful to the reader/author of the code. For example: ["This…
-
Example: https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/examples/spark-pi.yaml
Operator values
```
operatorVersion: v1beta2-1.2.1-3.0.0
imagePullSecrets:
- name: ha…
-
It seems that `enable-ui-service` was added recently.
Which result in passing `-enable-ui-service=true/false` on `spark-operator` deployment even with old version `spark-operator` who doesn't accept…