-
Hello,
The operator was installed in our openshift cluster (organization). When the example spark application (spark-examples_2.11-2.4.5.jar) was submitted with the help of operator, submitter pod …
-
**What happened**:
When test the performance of spark-native integration with volcano, when execute the same task with 50 times, interval is 3 seconds, half task failed.
**What you expected t…
-
## Description
When launching Spark-Python Kubernetes mode notebook, enterprise-gateway is getting **Exception in thread "main" java.lang.IllegalArgumentException: basedir must be absolute: ?/.ivy2/l…
-
在k8s master节点使用如下提交：
./bin/spark-submit --master k8s://https://172.31.186.86:6443 --deploy-mode cluster --name spark-pi3 --class org.apache.spark.examples.SparkPi --conf spark.exec…
-
Note start date is not shown in proposal Gantt chart
-
Hi all :wave:
I'm using Spark Structured Streaming to stream from one Hudi table to another Hudi table.
I noticed that when stream started for the first time, each batch was relatively fast, with an…
-
Hi,
Spark 2.3 shipped with experimental support for Kubernetes.
The reality is that Spark on Kubernetes has been battle-tested in a few companies, the "experimental" parts sound to me more like a …
-
**Describe the bug**
Intermittently once pod is deployed,
Any configMap resource update is not getting applied to the Application
We see in problematic pods, we continously see below WARN messages…
-
This is yaml of my spark job:
`kind: SparkApplication
metadata:
name: operatordc1
namespace: spark
spec:
type: Java
mode: cluster
image: "xiotxpcdevcr.azurecr.io/spark-custom:release…
-
## Spark 예제 앱 이미지 생성
- download spark
```
wget https://mirror.navercorp.com/apache/spark/spark-3.1.2/spark-3.1.2-bin-hadoop3.2.tgz
tar xvzf spark-3.1.2-bin-hadoop3.2.tgz
```
- set env
```
cd …