-
I have a custom transformer python class that I use with a spark mllib pipeline. I want to log the model to mlflow, register it to the mlflow model registry, and load it with spark. I'm able to log th…
-
I'm trying to build a custom 12.2 LTS docker image to support Pytorch 2.0 / Pytorch Lightning. While I can create a valid docker image, when I push this to Databricks, Spark errors without any helpf…
-
Hello guys,
Before I begin, I want to thank you for this amazing tool. It's truely awesome and enables true distributed deep learning out of the box. Now for some questions.
1. From what I've seen I …
-
it takes a long time to build the model on a sparse dataset (89x5000) when read in using parquet format on a 5 executor SW cluster.
-
Hello Everybody,
I'm using Azure Databricks, with Python and i'm trying to use your library "Spark-Excel".
I have added your library on my cluster :
![image](https://user-images.githubusercont…
-
微博内容精选
-
- [x] PySpark SQL
- [x] PySpark Numpy
- [x] PySpark Sklearn LR
- [x] PySpark MLlib
@hzjane
-
I have a PySpark code to train an H2o DRF model. I need to save this model to disk and then load it.
```
from pysparkling.ml import H2ODRF
drf = H2ODRF(featuresCols = predictors,
…
-
I have installed elephas in a clean python environment using the pip command provided in the readme, and am running into the following error when trying to get the examples running.
For the `mllib_…
-
When running Spark I get the following warnings:
```
15/06/15 11:17:36 WARN BLAS: Failed to load implementation from: com.github.fommil.netlib.NativeSystemBLAS
15/06/15 11:17:36 WARN BLAS: Failed to …