-
Spark's kubernetes executor [uses the same value for memory request and memory limit](https://github.com/apache/spark/blob/master/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/depl…
-
**Is your feature request related to a problem? Please describe.**
Currently we have `rapids_4_spark_qualification_output_unsupportedOperators.csv` which has details about unsupported operators and `…
-
I changed the base image from gcr.io spark:3.1.1 to spark:3.5.0 and built my dockerfile from there where it has my DataAnalyticsReporting.jar
This is the error when the spark-operator tries to star…
-
Hello,
I have an openshift cluster where I was running some instances of the Spark Operator and they were all running fine since long.
But, recently we upgraded the cluster's version from 4.8 to …
-
### Backend
CH (ClickHouse)
### Bug description
Read a parquet file, with schema
```
message schema {
optional binary id(UTF8);
optional binary id1 (UTF8);
optional binary id2 (UT…
-
### Description
During the analysis of spill in issue #8025, we noted some issues are common between Gluten and Vanilla spark, like the spill read/write buffer size. Some configuration are even not…
-
There's an older vulnerability from 2021 that gets flagged when we're trying to use the spark-operator:
https://github.com/advisories/GHSA-f5f7-6478-qm6p
I haven't looked into the details of the…
-
### Apache Airflow Provider(s)
cncf-kubernetes
### Versions of Apache Airflow Providers
apache-airflow-providers-cncf-kubernetes==8.3.1
### Apache Airflow version
2.9.2
### Operating System
Ubu…
-
## Implement stage-level resourceProfile auto-adjust framework to avoid oom
### Backgroud
In our production environment, we suffer a lot from gluten jobs throwing heap OOM exception occasionally. …
-
### Describe the bug
I am running a modified version of TPC-H query 10. I've removed the filters to stress comet and see how it behaves when processing large amount of data:
```sql
-- SQLBench-H …