Open razvan opened 1 year ago
Jupyter notebooks can connect to stand alone clusters. This allows for much better scalability when analyzing big data with Pyspark notebooks.
I personally like Notebooks running in client mode and requesting executors and would prefer that solution over a Spark standalone cluster. We used that extensively at my previous company
Description
Jupyter notebooks can connect to stand alone clusters. This allows for much better scalability when analyzing big data with Pyspark notebooks.
Acceptance