Submitting spark jobs from VSCode to Azure Synapse stop working

[Rutikhal]

Hello Me and my colleagues cant anymore submit PySpark jobs to Azure Synapse from VSCode using this extention. It started yesterday morning. We dont see in context menu for example Synapse: PySpark Batch.

It seems that you updated or releases something because counter of installation was reset On main page not mentioned Synapse. https://marketplace.visualstudio.com/items?itemName=mshdinsight.azure-hdinsight&ssr=false#overview Also I have some link from MS about using this extension to submit spark jobs to Synapse but I cant find the same docs now. https://docs.microsoft.com/en-us/azure/synapse-analytics/spark/vscode-tool-synapse I have VSCode. I have extension. Any ideas what is wrong?

[tmcnicho]

I also cannot get the extension to work with Synapse.

I tried using the following tutorial since the MS one is gone missing. But once connected to Azure it did not identify my Synapse Folder

https://medium.com/@masterkeshav/development-on-intellij-scala-vs-code-pyspark-with-synapse-spark-pool-ea345acea2b6

I did find the following. I guess there is a problem. Using a Livy connection may be a workaround. It's a pity they pulled the old documentation. It seems like it was buggy but not broken.

https://github.com/MicrosoftDocs/azure-docs/issues/95205

You can get the old documentation here https://github.com/MicrosoftDocs/azure-docs/blob/main-backup/articles/synapse-analytics/spark/vscode-tool-synapse.md

[DaveGreasley]

Can someone from MS comment on the status of accessing Synapse Spark pools using this extension please? Using the built in notebook editor in Synapse is no where near equivalent of being able to develop locally and run jobs against a Synapse cluster using VS code.

Has this feature been removed permanently? If so, why?

[alurbina]

As @DaveGreasley & others stated, this is a great tool.

Would be helpful if we could get an update on the status of the extension.