search

jupyter-incubator / sparkmagic

Jupyter magics and kernels for working with remote Spark clusters
Other
1.33k stars 447 forks source link

Multi-user setup: New Livy session started for each user in the same notebook #732

Open rabejens opened 3 years ago

rabejens commented 3 years ago

I am currently setting up a Jupyterhub/Jupyterlab stack with Sparkmagic connecting to a remote cluster. This works so far save for one thing: When User A opens a notebook and works with it, a new session is created which is fine. When user B opens the same notebook with the kernel still running, a new session is started instead of using the one that's running for user A.

Is this a bug or is there a configuration error somewhere?

devstein commented 3 years ago

@rabejens Thanks for making an issue! Are User A and User B running different Jupyterlab instances? This is typical in the Jupyterhub/Jupterlab setup, which would explain the users have different sessions.

If the users are sharing the same instance of Jupyterlab, and therefore the same running kernel, then I'm not sure about the expected behavior. If this is the case, can you share more about your Jupyterhub setup?

josechudev commented 2 years ago

@rabejens I am dealing with the same setup. Did you manage to fix the issue?