-
Hi,
I would like to know if it's currently possible to submit a spark-shell job using the spark operator.
I tried to deploy a SparkApplication using `mainClass: org.apache.spark.repl.Main` but this …
-
It is not an issue actually, but want to get help/support. We have on-premise spark cluster with livy, which can be connected from my laptop using Jupyter Notebook + Sparkmagic. But have no idea how t…
-
I am using the example provided in the Java docs and running this on a local spark cluster.
```
public void run() throws Exception {
SparkSession sparkSession = SparkSession.builder()
…
-
- [ ] ✋ I have searched the open/closed issues and my issue is not listed.
#### [I initiated a test task, but the driver pod showed that configmap was not found, and the entire test task failed](ht…
-
Now this is not prossible, despite mesos,k8s,yarn can do this throw follow params
```
spark.mesos.driverEnv. ----> mesos
spark.kubernetes.driverEnv. ---> k8s
spark.yarn.appMasterEnv. ---> yarn
…
-
Hi all,
I'm using the spark-operator: chart version: `spark-operator-1.1.11` and app version: `v1beta2-1.2.3-3.1.1`
I'm getting this error with a Scheduled Spark Application.
```
failed to run…
-
Hello.
I am preparing to introduce Spark with Volcano on Kubernetes.
I've read all the ocumentations below.
- https://spark.apache.org/docs/3.3.0/running-on-kubernetes.html#using-volcano-as-cus…
-
Attempting to perform coreference resolution on a large dataframe containing English-language documents.
## Description
Attempting to run `SpanBertCoref()` in a pipeline
```
document_assem…
-
I would like to be able to set `spec.containers[].resources.limits.ephemeral-storage` and `spec.containers[].resources.requests.ephemeral-storage` on the driver/executor Pods spawned by my `SparkAppli…
-
### Backend
VL (Velox)
### Bug description
We’re getting into a weird situation with a method (`org.apache.spark.shuffle.IndexShuffleBlockResolver.writeMetadataFileAndCommit`) that appears to be mi…