-
Hello,
I have installed seldon in my local machine and now i am trying to run the Reuters Newswire Recommendation example but i have problems with spark-worker-controller and reuters-import-data pods…
ghost updated
8 years ago
-
Sub-issue of #128.
@weiting-chen, @foxish, @ifilonenko
When the driver and executors pods access HDFS, the usernames currently appear as `root` to HDFS because k8s pods do not have Linux user a…
-
**Is your feature request related to a problem?**
We need a comprehensive testing framework to validate **PPL ** commands in the **Spark** environment, ensuring that each new PPL (Spark) release me…
-
My az k8s mode configuration is :
```python
model = model_creator(None)
compute_loss = loss_creator(None)
optimizer = optim_creator(model, None)
train_loader = train_loader_creator(None, batch…
-
hi all, I saw there is a spark30 branch for spark 3.0.x supported in the readme. there also seems to be a spark31 branch but wondering is there any plans to support spark 3.2 or could it work out of t…
cpd85 updated
2 years ago
-
**What happened**:
According to https://github.com/volcano-sh/volcano/blob/master/docs/design/multi-volcano-schedulers.md, we can install multi volcano schedulers for scheduling different kind of…
bysph updated
10 months ago
-
Hi everybody,
as @ryanlovett asked me I opened this issue here, related to jupyterhub/zero-to-jupyterhub-k8s#1030.
The Problem is as following:
After starting PySpark I am not able to access t…
h4gen updated
10 months ago
-
### Bug description
RuntimeError: Java gateway process exited before sending its port number
#### Expected behaviour
launching bin/pyspark runs from a terminal shell.
However, it fails i…
-
Explore using https://github.com/jupyterhub/jupyter-server-proxy or another generic approach to provide the Spark UI through a proxy.
The current approach is brittle as it works only on localhost a…
-
@foxish
I was doing the [HDFS-in-K8s experiment](https://github.com/apache-spark-on-k8s/spark/issues/206#issuecomment-297552949) using Spark TeraSort jobs. It turned out the default memory size fo…