-
Initial prototype hard coded the Gaia DR2 PersitentVolumeClaim mounts in the K8s interpreter template.
This task extends the template to read a list of PersitentVolumeClaim mounts from the interpre…
-
Done:
- Creating a Spark scalable distributed cluster.
- Creating a simple demo app allowing to measure performance.
TODO:
- Add 1, 2, 3 workers nodes and compare performance and measure scala…
-
**Environment:**
1. Framework: (Keras)
2. Framework version: 2.6.0
3. Horovod version: 0.25.0
4. MPI version: 3
5. CUDA version: 11.7
6. NCCL version: NA
7. Python version: 3.8
8. Spark / PySp…
mtsol updated
5 months ago
-
### Pre-requisites
- [X] I have double-checked my configuration
- [X] I can confirm the issues exists when I tested with `:latest`
- [ ] I'd like to contribute the fix myself (see [contributing g…
-
I extended the docker image using the recent `spark-2.2.0-k8s-0.4.0-bin-2.7.3` release to add the GCS (Google Cloud Storage) connector.
Observed:
It works great for scala jobs / jars with a `gs://…
-
- [x] Kubernetets cluster env @ Almaren 200
- [x] [Jenkins Slave and Kubernetes client env](http://10.112.231.51:18888/view/BigDL-2.0-NB/job/BigDL-NB-K8s-ExampleTests/)
- [x] [Hyper Zoo Doicker imag…
-
We wanna run on AWS! Specifically, I'm going to try demo this running on AWS at a NASA meeting on September 25, so that's the use case :)
On GCP, we have managed runner with DataFlow, and this solv…
-
JupyterLab provide official helm and docs for deploying JupyterHub on Kubernetes
- https://github.com/jupyterhub/helm-chart
- https://github.com/jupyterhub/zero-to-jupyterhub-k8s
So, it will …
-
Hello,
I saw that it was possible to use the enterprise kernel gateway with the notebooks. Is there an exemple showing how to use it?
Morover, when deploying a KFP with elyra when the notebook use …
-
We'll be wanting a plan for presenting this project in PRs that are as digestible as possible by the Apache Spark reviewers upstream. We can use this issue to formulate a strategy