-
As a devops installing this operator, I have put in place prometheus metrics collection.
While having a look into the metrics I discovered that counters are available only once a SparkApplication i…
-
**What happened**:
When test the performance of spark-native integration with volcano, when execute the same task with 50 times, interval is 3 seconds, half task failed.
**What you expected t…
-
Greetings!
Other than using --jars to specify dependency jars, is it possible to provide package names just like using --packages argument to provide a list of dependencies in spark-submit command?…
-
Elaborating on https://github.com/apache-spark-on-k8s/spark/pull/545#issuecomment-348267882
We need to separate our integration testing out - so we can make it run any arbitrary branch - including ma…
-
trace
- [ ] operator-go
- [ ] zookeeper
- [ ] hdfs
- [ ] hbase
- [ ] hive
- [ ] spark
- [ ] trino
- [ ] dolphinscheduler
- [ ] superset
- [ ] kafka
## Implement with memcached example
…
-
Sorry I was slow to review and had post-merge comments for https://github.com/apache-spark-on-k8s/spark/pull/395#pullrequestreview-57641643 which was moved to https://github.com/apache-spark-on-k8s/sp…
-
Spark 3.0.0 support [RAPIDS Accelerator](https://github.com/nvidia/spark-rapids) which can provides a set of plugins for Apache Spark that leverage GPUs to accelerate processing via the RAPIDS librari…
-
### Motivation: Why do you think this is important?
EMR Serverless spark for EKS is now generally available. https://aws.amazon.com/blogs/aws/new-amazon-emr-on-amazon-elastic-kubernetes-service-eks/
…
-
Like spark operator write by google team:
https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/tree/master/charts/spark-operator-chart
You could found crds define in the charts path. It …
-
When I run a spark job with `spark.shuffle.service.enabled=true` (without `spark.local.dir` property), I receive an exception
```
Exception in thread "main" java.lang.IllegalArgumentException: req…