-
It would be nice to either support [Spark Connect](https://spark.apache.org/docs/latest/spark-connect-overview.html) server natively within the Spark operator or at least provide a tutorial to on how …
-
Hello everyone. I am using Jupyter Enterprise Gateway with PySpark sessions on Kubernetes. The elyra/kernel-spark-py:3.2.3 image works as expected.
I modified the image and rebuilt it to upgrade t…
-
### Please describe your problem in detail
Hello,
Are there any images that can be used for the Spark example of Volcano which is compatible with ARM64 architecture.
The image "gcr.io/spark-operato…
-
How do you connect to spark on kubernetes through client mode. I have tried the following code:
```
config
-
We are running the spark k8s operator in order to process data using the yaml spec in production. This works great but we also want to do exploratory data analyses using Jupyter notebooks. Is this pos…
-
## Description
I use the helmchart of spark operator, it is deployed at the namespace spark-operator I configure on the helmrelease sparkJobNamespaces: spark-jobs that is the namespace where I want t…
-
## Bug report
I found this bug while trying out EMR on EKS on a Cilium-enabled EKS1.20 cluster.
When a service account's name is longer than 63 characters, it is not possible to start a pod usin…
-
**Describe the problem you faced**
Hi Folks. I'm trying to get some advice here on how to better deal with a large upsert dataset.
The data has a very wide key space and no great/obvious partiti…
-
This issue lists Renovate updates and detected dependencies. Read the [Dependency Dashboard](https://docs.renovatebot.com/key-concepts/dashboard/) docs to learn more.
## Repository problems
These pr…
-
Configuring `driver.podName` causes Pod already exists error when the job gets triggered second time.
One way to solve this (as per the discussion in the Slack channel) is, in case of a scheduled …