search

jadianes / spark-py-notebooks

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks
http://jadianes.github.io/spark-py-notebooks
Other
1.64k stars 918 forks source link

spark context #4

Closed PChiberre closed 8 years ago

PChiberre commented 8 years ago

I had an issue with the command line $ MASTER="spark://127.0.0.1:7077" SPARK_EXECUTOR_MEMORY="1G" IPYTHON_OPTS="notebook --pylab inline" /home/philippe/Downloads/spark-master/bin/pyspark

the error was Connection refused: /127.0.0.1:7077

and was resolved with $ MASTER=local[4] SPARK_EXECUTOR_MEMORY="1G" IPYTHON_OPTS="notebook --pylab inline" /home/philippe/Downloads/spark-master/bin/pyspark maybe you could say a word in the readme about it.

Otherwise great notebooks and great help Thank you!

jadianes commented 8 years ago

Sure. I'm using an actual cluster. I guess you're using a local installation. Well done!