-
**Describe the bug**
I run spark with blaze + celeborn on k8s always OOM
**To Reproduce**
My environment:
spark version: 3.3.3 with celeborn DRA patch
blaze version: blaze-engine-spa…
wfxxh updated
4 hours ago
-
### env：
```
host
os：CentOS Linux release 8.2.2004 (Core)
kernel：4.18.0-193.el8.x86_64
memory：1T
jdk：1.8
maven：3.9.6
spark：3.4
scala：2.12
container：
os：CentOS Linux release 7.4.1708 (Core)
…
-
### What happened?
- [ ] ✋ I have searched the open/closed issues and my issue is not listed.
I've kubeflow/spark-operator:2.0.0-rc.0 installed on GKE, and it is working fine
When i create a ne…
-
### Bug Report
Hello,
Sending a variable into a spark component as an array value, kills the request and shows a blank white page. For example:
### Plugin Version
1.0.0-alpha.5
…
-
### OpenLineage integration/client
Spark integration
### OpenLineage version
openlineage-spark_2.12-1.24.2.jar
transports-s3-1.24.2.jar
### Technology and package versions
AWS Glue 4.0…
-
Love sparkdantic, and continue to rely on it. Thank you for your work!
One minor annoyance is that mypy always yells at me for using the `spark_type` kwarg to be explicit about the native spark ty…
-
**Describe the bug**
It seems that using Spark Structured Streaming from a managed table (that should support tead) to an external table (that should support read/write) - is not working.
It throw…
ni-mi updated
17 hours ago
-
### What happened?
- [ ] ✋ I have searched the open/closed issues and my issue is not listed.
I'm trying to install spark-operator on k8s (v1.28), and running in to issues 👍
Command -
```
helm…
-
**Describe the bug**
I'm using an Spark Data Source and Spark Dataframes as Data Assets. When I try to validate the ExpectColumnPairValuesAToBeGreaterThanB expectation it raises an error. I'm going t…
-
Rewards have been stuck in "sending" over a month now. I updated filecoin station and the spark is now failing (logo just blinking). Tried resintalling didn't fix the issue.V.2.3.8
Please help[
![20…