-
I changed the base image from gcr.io spark:3.1.1 to spark:3.5.0 and built my dockerfile from there where it has my DataAnalyticsReporting.jar
This is the error when the spark-operator tries to star…
-
## Description
I am using Spark Operator to run a Spark Job. In my application, I need to open a SSH port on executor so that they can copy data among each other.
## Reproduction Code [Required]…
-
I am trying to test a local spark script.
Whenever I try to upload a file from local Mac system to qinikube cluster, I get the below error.
```sh
$SPARK_HOME/bin/spark-submit \
--deploy-mode …
-
As far as I can see there currently there is no possibility to define spark or hadoop config property from secrets.
This gets rather critical when it is a property related to spark submit, for exam…
-
Hello.
I am preparing to introduce Spark with Volcano on Kubernetes.
I've read all the ocumentations below.
- https://spark.apache.org/docs/3.3.0/running-on-kubernetes.html#using-volcano-as-cus…
-
```
yoel-MBP:spark-2.2.0-k8s-0.5.0-bin-2.7.3 yoeluk$ ./bin/spark-submit \
> --deploy-mode cluster \
> --class org.apache.spark.examples.SparkPi \
> --master k8s://https://192.168.99.100:8443…
-
### What happened?
As a user of the "system architecture" tab in Jaeger I would like to use Spark to generate the diagrams.
But spark no longer works with new charts that use elasticsearch 8+
S…
-
I'm attempting to run [spark-thriftserver](http://spark.apache.org/docs/latest/sql-distributed-sql-engine.html#running-the-thrift-jdbcodbc-server) using this scheduler extender. If you're not familiar…
PeteW updated
4 years ago
-
### Skill Name
Airflow, Spark, Presto, Helm, Argo
### Why?
[Apache Airflow](https://airflow.apache.org) is a very popular open source platform to programmatically author, schedule and monitor workf…
dnskr updated
4 months ago
-
An interesting problem arises when submitting the example PySpark jobs without --jars.
Here is an example submission:
```
env -i bin/spark-submit \
--deploy-mode cluster \
--master k8s://h…