-
## Issue Description:
I'm encountering an issue where I'm unable to utilize an environment variable that contains a password within my Spark application when deploying with the Spark Operator.
…
-
### Affected Stackable version
all
### Affected Apache Spark-on-Kubernetes version
all
### Current and expected behavior
Spark properties that are set by both the user via `spec.sparkConf` and th…
-
@liyinan926 @foxish
**When running the following command:（run the local jar by Dependency Management）**
>export SPARK_HOME=/home/hadoop/nan.wang/spark-2.2.0-k8s-0.5.0-bin-2.7.3
${SPARK_HOME}/bi…
-
Sorry, if this is not the right place ask this kind of question.
I try to run spark-pi in minikube which is installed in my local box. But this job is never finished.
I see the following log inf…
-
I would like to be able to set `spec.containers[].resources.limits.ephemeral-storage` and `spec.containers[].resources.requests.ephemeral-storage` on the driver/executor Pods spawned by my `SparkAppli…
-
https://xiaoxubeii.github.io/articles/practice-of-spark-on-kubernetes/
Spark On Kubernetes实践
前言
众所周知，Spark是一个快速、通用的大规模数据处理平台，和Hadoop的MapReduce计算框架类似。但是相对于MapReduce，Spark凭借其可伸缩、基于内存计算等特点，以及可以直接读写Had…
-
**Why would this plugin be helpful to the Flyte community**
_spark_sql_task_ will allow users to submit a query that will run a Spark. It will not necessarily run on native Spark kubernetes operato…
-
We'll be wanting a plan for presenting this project in PRs that are as digestible as possible by the Apache Spark reviewers upstream. We can use this issue to formulate a strategy
-
Hello maintainers
Is there interest in a Prometheus sink for the metrics systems in order to monitor Spark clusters on (not just) Kubernetes? We extensively use Prometheus for monitoring our K8S cl…
-
## Bug
### Describe the problem
I'm facing memory leak in a long running Spark Thrift Server (STS) on Kubernetes if Delta Lake tables are used.
RSS (process) memory grows all the time while STS…
dnskr updated
3 months ago