search

davidov541 / HadoopOnVagrant

Collection of vagrant boxes which makes setting up a mini-cluster simple
Apache License 2.0
3 stars 0 forks source link

[question] Spark on Jupyter #4

Closed OneCricketeer closed 4 years ago

OneCricketeer commented 4 years ago

Does the JupyerHub one support Spark?

davidov541 commented 4 years ago

It does not currently. I originally wrote it to do a PoC of using Apache Toree (https://toree.incubator.apache.org/) to use Spark on JupyterHub, so I'm sure I have the steps around here somewhere. Based on that, it should be easy to add it in, and probably should be added in, given this is "Hadoop On Vagrant".

OneCricketeer commented 4 years ago

While nothing is wrong with JupyterHub , I actually prefer using Zeppelin / Hue + Livy instead.

Primarily because they actually have simple AD configurations