-
Spark evaluator recall_at_k returns just recall, not 'at k'
-
I am training spark xgboost model, the train-error in log is about 0.28, and I saved the model, then load model to test it on test set, get very bad auc and accuracy (auc = 0.65, acc=0.55), which I th…
-
I have configured the pyspark kernel for JupyyterHub. Upon trying to test the sample code, I am getting this multi context error, even though it is set to 1. Please advice how do I overcome this issu…
-
A similar problem was reported in [this issue](https://github.com/dmlc/xgboost/issues/1115), which was closed without any verification. The [page](http://xgboost.readthedocs.io/en/latest//tutorials/aw…
-
I am trying to spark-submit the MNIST example on a 3 node Hadoop v3.0+Spark v2.3 cluster and not sure what to do with the error below I encountered.
`spark-submit \
--master yarn \
--deploy-mode c…
-
Hi all,
It's not too late to wish you a happy new year 2018 and a productive year !
I am currently working with pyspark/MLlib to conduct some big data mining on ocean datasets (eg unsupervised cla…
gmaze updated
6 years ago
-
Hi Team,
when I try to fit the model it is giving me an error saying that TypeError: Cannot convert type into Vector
from pyspark.mllib.evaluation import MulticlassMetrics
fitted_p…
-
After `sbt clean` is run, the directory `pyrasterframes/python/.eggs` is still around, making it difficult to test against multiple versions of Spark without manual cleaning of cached files. I'd sugge…
-
I trained a RandomForestRegressor and I want to export it to PMML but I have an error:
```
from pyspark.ml import Pipeline
from pyspark2pmml import PMMLBuilder
from pyspark.mllib.regression im…
-
Failure on xgboost-spark test during 'mvn install'. I am able to successfully run 'spark-shell' and 'pyspark' from a cmd window. The ultimate error during the install is:
`java.io.FileNotFoundExc…