search

microsoft / Spark-Hive-Tools

This is for issue/feedback tracking on Spark & Hive Tools
Creative Commons Attribution 4.0 International
6 stars 9 forks source link

Spark Hive tools doesn't work because of pythonpath configuration #34

Open sambathraj opened 2 years ago

sambathraj commented 2 years ago

I am not able to use Synapse Pyspark interactive because of following error.

image

In the log, I see below error

Unable to write to Workspace Settings because python.pythonPath is not a registered configuration.

How to resolve this problem?

zesluo commented 2 years ago

Hello @sambathraj .sorry for the inconvenience. If you are trying to use Synapse pyspark interactive , please use synapse studio instead, thanks. Since it's dependency will not be maintained anymore, it will also not be maintained. Currently, we are updating doc.

sambathraj commented 2 years ago

Thanks for the reply. We are trying to use the VSCode for debugging a library code. We were able to use it with a local installation of pyspark.

How to overcome this error? where do we need to set the python.pythonPath configuration? I tried to setup manually and it doesn't work. { "python.pythonPath": "C:\Users\xxxxxxx\.msvscode.hdinsight\hdinsightJupyter\Scripts\python.exe" }

zesluo commented 2 years ago

can you try jupyter extension v2022.1.1001614873 and python extensiton v2021.12.1559732655? thanks

skandupmanyu commented 2 years ago

Now that VSCode extension is retiring as mentioned in the doc, what are the plans to use PyCharm/VSCode to develop .py scripts instead of notebooks on Synapse?

justin-schrader commented 2 years ago

@zesluo Can you comment on the question above? Is there an alternative to developing for Synapse if this extension no longer supports that?