-
Hi Team,
I am trying to integrate SJS with Cloudera(CDH-5.8.2) on EC2 using Spark 1.6.0. Below is the script which I am using to install SJS on EC2 with spark.
Script runs successfully without …
-
##### SUMMARY
I try to reproduce a CI issue and so I run: `ansible-test sanity --test validate-modules`. `ansible-test` starts a process that consumes a lot of CPU cycle without showing any progres…
-
Hi guys,
I'd like to address some OOM issues I've been having when training on Spark (for weeks). The model I'm training requires about 10-15GB of RAM when training locally and it remains stable wh…
-
**Engenheiro de Dados Junior**
**O que você vai fazer:**
• Ajudar a equipe da Data Science a desenvolver produtos surpreendentes e desafiadores que levam a empresa aos seus objetivos;
• Implement…
-
**Environment:**
1. Framework: MXNET
2. Framework version: 1.4.1
3. Horovod version:
4. MPI version: 3.1.0
5. CUDA version: 10.0
6. NCCL version:
7. Python version: 3.6
8. OS and version: "Am…
-
**Environment:**
1. Framework: TensorFlow
2. Framework version: 1.13.1
3. Horovod version: not specified
4. MPI version: 3.1.0
5. CUDA version: 9.0
6. NCCL version:
7. Python version: 2.7
8. O…
-
It seems that I am getting hung up on `Locking [dev-packages] dependencies…`.
I was able to get the pipenv to run just two weeks ago in a few minutes, but now it is taking 30+ before I kill it. No…
-
Should be available from Apache Archive though, currently looking into in ec2_bootstrap.sh changing
http://apache.mirrors.lucidnetworks.net/spark/spark-2.2.1/spark-2.2.1-bin-hadoop2.7.tgz
into
…
-
we have the spark job server run together with the standalone spark cluster on one machine, which has 8 cores, 14G memory.
we tried to run jobs every 1 second against it, but after about 30 jobs, the…
-
[![mitm_build](https://user-images.githubusercontent.com/1323708/59226671-90645200-8ba1-11e9-8ab3-39292bef99e9.jpeg)](https://medium.com/@jonathan.leitschuh/want-to-take-over-the-java-ecosystem-all-yo…