Minutis
commented
1 year ago It is highly likely that the issue is with sparkmagic plugin that manages integration between Lither and Jupyter and not with the Lighter itself. Have you noticed that with a single call to Lighter it is creating multiple seasions instead of one?
on Jupyter notebook, if i press shut down kernel + restart kernel ( do it fast repeatedly) . sometime lighter will spin up 2 different sessions. that might be due to race condition. just report this see anyone else experience similar issue.