-
MLLib in PySpark depends on NumPy, so we'll need to make sure the workers have access to it -- either via the `openshift-spark` image or via the pyspark image here (distributing NumPy to workers with …
willb updated
8 years ago
-
All of the demos/examples on the [README.md](https://github.com/h2oai/sparkling-water) seem to be doing all the prediction code in scala and only has R as an after thought using the `residualPlotRCode…
-
Hello,
I am trying to use the example code from the README for spark-sklearn. I have installed the latest version of Anaconda, and ran `pip install spark_sklearn` to install the package. The followin…
-
Right now, the solution to view data within the workflow is to perform intermediary file writing within the workflow. Even though the Spark context allows for passing data between the Spark and Python…
-
We use the Azure Spark tutorial ( https://azure.microsoft.com/en-us/documentation/articles/hdinsight-apache-spark-machine-learning-mllib-ipython/ ) and have successfully completed before with our stu…
-
When using PySpark Notebook and MLLib's ALS train function, we end up running out of memory. Maybe this is down to tuning, but looking around the web, I see that this is a known issue:
https://github…
-
I'm using the kernel Python 2 and trying to train a KMeans model, but it fails for not finding `numpy`.
```
Py4JJavaError: An error occurred while calling o36.trainKMeansModel.
: org.apache.spark.Spa…
-
zeppelin-interpreter
zeppelin-zengine
spark-dependencies
spark
markdown
angular
shell
hive
phoenix
postgresql
jdbc
tajo
flink
ignite
kylin
lens
cassandra
elasticsearch
interpreter
notebook
-
running through the steps in GEQE/geqe-ml/README and everything seems to work fine until I get to findSimilarPlaces.py which fails with error
Traceback (most recent call last):
File "/home/haley/de…
-
https://github.com/apache/spark
JIRA
https://issues.apache.org/jira/browse/SPARK-8855?jql=project%20%3D%20SPARK%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Minor%20ORDER%20BY%20key…