-
**Describe the problem you faced**
Migrated to Hudi 0.14.0 from Hudi version 0.8. While attempting to read Hudi table in parquet format from AWS S3 using Spark receiving the following error:-
…
-
## Description
Unable to Start spark job in kubenetes
- [*] ✋ I have searched the open/closed issues and my issue is not listed.
## Reproduction Code [Required]
Steps to reproduce the be…
-
Hi @askhatri, I built a snapshot master branch of LIVY with spark 3.5.0
After I replace them in helm chart, it worked well. However, when I checked LIVY UI, it doesn't show spark ui and application i…
-
I tried this out on my local and it was fantastic, 5 node cluster. However, I want to also set up a spark cluster on the docker images as well as a multi-host cluster for high availability.
E.g have …
-
## Description
We use the operator to manage the lifecycle of both batch and Spark streaming applications. Streaming apps in particular are long lived and if using dynamic allocation may scale up a…
-
### Affected Stackable version
24.3
### Affected Apache Spark-on-Kubernetes version
3.5.0
### Current and expected behavior
With the correct configuration in place for Kerberos and HDFS Spark job…
-
With apache/spark#43627 we eliminate the need to add the plugin jar via `spark.executor.extraClassPath` and paved the way to the simplified Boolean switch useRSM=true/false. Now would be a good time t…
-
### Backend
VL (Velox)
### Bug description
I am using Gluten(tag v1.1.1) + Velox + folly + spark3.4.2 + yarn,building with centos8 aarch64, running on aarch64 , while yarn container running with …
-
### What happened?
When running the `cassandra-spark` E2E test, the pod from the spark job fails:
```
k logs test-spark-deps-spark-dependencies-28508319-z4cmv
WARNING: sun.reflect.Reflection.getCa…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues and did not find a match.
### Who can help?
_No response_
### What are you working on?
I am using the …