-
TL;DR
I ran across a bug in spark 3.5 and graphframes 0.8.3 where when using connected components, if `spark.sql.adaptive.enabled` is not `false`, the results returned will be incorrect, with many ed…
-
I'm getting an issue to previous issues reported on here, but the fixes don't seem to solve this one.
```
port = 7078
config
-
I have tested the PodCIDRToNodeMapping on a k8s with the provided charts from my findings, I wonder if it behaves as expected: I have to give the nodename as input to the PodCIDRToNodeMapping.resolve …
-
## Description
We use the operator to manage the lifecycle of both batch and Spark streaming applications. Streaming apps in particular are long lived and if using dynamic allocation may scale up a…
-
@liyinan926 @foxish
**When running the following command:（run the local jar by Dependency Management）**
>export SPARK_HOME=/home/hadoop/nan.wang/spark-2.2.0-k8s-0.5.0-bin-2.7.3
${SPARK_HOME}/bi…
-
在k8s master节点使用如下提交：
./bin/spark-submit --master k8s://https://172.31.186.86:6443 --deploy-mode cluster --name spark-pi3 --class org.apache.spark.examples.SparkPi --conf spark.exec…
-
- Hadoop/Yarn/CDH cluster: python, jupyter, bigdl-submit, spark-submit
- K8s cluster: python, jupyter, bigdl-submit, spark-submit
- Notebook dev & scale-out on K8s
- Ray cluster: python, jupit…
-
I was chatting with @mccheah and @jlz27 about what it would take for us to run integration tests in CircleCI, and Jason has a setup that works, minus one problem.
Roughly the setup is to use miniku…
-
1. Milestones
- M1. basic deployment and spark on k8s cluster support [3/18]
- M2. data io and default kms/as integration [4/1]
- M3. e2e ppml solution on k8s-sgx [4/15]
- M4. Gram…
-
> **idea (non-blocker)**: we could have a utility type for making properties. It might make this a little easier for humans to parse.
>
> _Originally posted by @NickLarsenNZ in https://github.com/sta…