-
Spark supports two submission arguments `--packages` and `--repositories` for downloading maven-style jar artifacts (and their transitive deps), as another way to deliver jar files to drivers and exec…
-
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issue…
melin updated
8 months ago
-
### Bug description
RuntimeError: Java gateway process exited before sending its port number
#### Expected behaviour
launching bin/pyspark runs from a terminal shell.
However, it fails i…
-
Hi everybody,
as @ryanlovett asked me I opened this issue here, related to jupyterhub/zero-to-jupyterhub-k8s#1030.
The Problem is as following:
After starting PySpark I am not able to access t…
h4gen updated
10 months ago
-
Hello,
We decided to use Spark Operator to manage multi-tenant environment on an Openshift cluster 4.2.
For this reason we chose to deploy a spark operator in a namespace called tenant-admin tha…
-
I would like to be able to set `spec.containers[].resources.limits.ephemeral-storage` and `spec.containers[].resources.requests.ephemeral-storage` on the driver/executor Pods spawned by my `SparkAppli…
-
Progress log:
- OCR, or Optical character recognition, is the technical term for extracting text for an image. The most powerful OCR tool is Tesseract. It is build by Google.
- Python-tesseract is a…
-
Sometimes, the `driver` exit with following error logs:
```
2017-09-15 16:11:57 INFO SparkUI: Stopped Spark web UI at http://192.168.9.248:4040
2017-09-15 16:11:57 INFO KubernetesClusterSchedulerBa…
-
Sub-issue of #128.
@weiting-chen, @foxish, @ifilonenko
When the driver and executors pods access HDFS, the usernames currently appear as `root` to HDFS because k8s pods do not have Linux user a…
-
**Environment:**
1. Framework: (Keras)
2. Framework version: 2.6.0
3. Horovod version: 0.25.0
4. MPI version: 3
5. CUDA version: 11.7
6. NCCL version: NA
7. Python version: 3.8
8. Spark / PySp…
mtsol updated
5 months ago