-
With apache/spark#43627 we eliminate the need to add the plugin jar via `spark.executor.extraClassPath` and paved the way to the simplified Boolean switch useRSM=true/false. Now would be a good time t…
-
### Tell us about your request
- Add Karpenter support to work with custom schedulers (e.g., Apache Yunikorn, Volcano)
- As per my understanding, Karpenter works only with the default scheduler…
-
### Apache Iceberg version
None
### Query engine
None
### Please describe the bug 🐞
We were upgrading to spark 3.4.1 when we ran into this issue. Currently running on spark 3.2.1 which works. We'…
-
**Describe the problem you faced**
I'm observing failed spark stages
`"Doing partition and writing data: " in " SparkUpsertCommitActionExecutor" job group. `
Effectively it can no longer insert…
kazdy updated
5 months ago
-
I was running BigStitcher Spark on a cluster single-node. At the end of first step "detect interesting point" its throwing an exceptions. Any suggestion ??
I have pasted logs below:
processing …
-
Hi! And thanks so much for writing this great package!
When I run the following command:
`df = spark.read.format("com.elastacloud.spark.excel").option("cellAddress", "A1").load(file_location)`
…
-
We are running the spark k8s operator in order to process data using the yaml spec in production. This works great but we also want to do exploratory data analyses using Jupyter notebooks. Is this pos…
-
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
We ar…
-
In truth this is more an issue with Spark itself which is recorded here: https://issues.apache.org/jira/browse/SPARK-43108
When using the spark snowflake connector (2.11 and above I believe) you wi…
-
### Current Behaviour
I'm making a very simple Spark dataframe with only one column. Apparently, ProfileReport does not generate the report when I am using Databricks notebook.:
Below is the code th…