-
It is not the first time that I encounter this problem
Suppose that you have the following
```
/opt
|- spark/libs/*.jar
|- customLibs/*.jar
```
You can add your **customLibs** while exe…
-
On kubernetes, there is an event api that can inform us about spark application transitions:
kubectl --kubeconfig dev.yml -n spark-jobs get events --field-selector involvedObject.kind=SparkApplicati…
-
Hello!
I am using Spark Redis to populate a Redis cluster as follows --
```
df.sample(sampleRate)
.write
.mode(SaveMode.Append)
.format("org.apache.spark.sql.redis…
-
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](http…
-
For example: https://medium.com/faun/apache-spark-on-kubernetes-docker-for-mac-2501cc72e659
-
I'm getting an issue to previous issues reported on here, but the fixes don't seem to solve this one.
```
port = 7078
config
-
@foxish @varunkatta
We had a discussion on how to improve our workflow. In particular, how we can shorten the 1. maven/sbt build time and 2. docker image build/push time.
I was chatting a bit m…
-
### Motivation: Why do you think this is important?
EMR Serverless spark for EKS is now generally available. https://aws.amazon.com/blogs/aws/new-amazon-emr-on-amazon-elastic-kubernetes-service-eks/
…
-
Error of running SimpleQuery example with bigdl-ppml-spark_3.1.2-2.1.0-20220907.120744-222-jar-with-dependencies.jar
```
Exception in thread "main" org.apache.spark.sql.AnalysisException: cannot re…
-
I am reading through the [Getting Started for Kubernetes](https://nvidia.github.io/spark-rapids/docs/get-started/getting-started-kubernetes.html) documentation with the lens of a Kubernetes user attem…