search

jupyter-incubator / sparkmagic

Jupyter magics and kernels for working with remote Spark clusters
Other
1.33k stars 447 forks source link

The pyspark kernel not showing in vs code jupyter kernel list #740

Open GaryLiuTelus opened 2 years ago

GaryLiuTelus commented 2 years ago

Describe the bug The pyspark kernel worked fine in Conda jupyter notebook, but it is not showing in the vs code jupyter kernel list. But I can use %%spark to connect my livy service and run code in iPython instance.

To Reproduce Steps to reproduce the behavior.

Expected behavior A clear and concise description of what you expected to happen.

Screenshots If applicable, add screenshots to help explain your problem.

Versions:

Additional context Add any other context about the problem here.

devstein commented 2 years ago

Hi @GaryLiuTelus thanks for making an issue. This is a known problem and is caused by https://github.com/jupyter-incubator/sparkmagic/issues/727 and the fix is this PR; however, there are still outstanding issues before the PR can be merged. Will keep you updated.

GaryLiuTelus commented 2 years ago

I post this issue on github site of vs code jupyter extension, and one of contributor gave me a workaround.

https://github.com/microsoft/vscode-jupyter/issues/8286