-
I am not too sure if this is an issue with Spark/K8S or the entry-point of the image, but the result is that the driver can not access the files passed through `--py-files` and `--files` when these ar…
-
ETA: 2024-06-30
We want to use IPv4 addresses of SPARK nodes as the scarce resource that makes it expensive for a single party to run many nodes. ATM, we rely on the trusted spark-api service to re…
-
cc @Fokko .
This is a super simple implementation of an iceberg client for dask. It works for the limited couple of datasets I have available including
- version metadata choice
- snapshot time …
-
Example: https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/examples/spark-pi.yaml
Operator values
```
operatorVersion: v1beta2-1.2.1-3.0.0
imagePullSecrets:
- name: ha…
-
**Your Godot version:**
4.2
**Issue description:**
Decisions made in the style guide are often based in some judgement on what is most useful to the reader/author of the code. For example: ["This…
-
- [ ] ✋ I have searched the open/closed issues and my issue is not listed.
I am trying to deploy a Spark application on Kubernetes using the Spark Operator, but I'm encountering an issue related to…
-
It seems that `enable-ui-service` was added recently.
Which result in passing `-enable-ui-service=true/false` on `spark-operator` deployment even with old version `spark-operator` who doesn't accept…
-
I have installed the spark operator on AKS 1.19 but when I pass the environment variable in the given example
https://github.com/GoogleCloudPlatform/spark-on-k8s-operator…
-
See discussion in #719 with this last open issue. Moving to a separate issue for clarity.
> > How can you launch a spark application and then reliably wait for it to finish?
>
> I would explore…
-
We have different ways to do Serialisation in Airflow --- and also multiple way of pickling (dill, stdlib pickle, cloudpickle).
- https://github.com/apache/airflow/blob/main/airflow/serialization/s…
kaxil updated
3 months ago