MicrosoftDocs / azure-docs

Open source documentation of Microsoft Azure

https://docs.microsoft.com/azure

Creative Commons Attribution 4.0 International

10.29k stars 21.47k forks source link

Please make a Tutorial to create an Apache PySpark application with PyCharm using a Synapse workspace #67976

Closed FurcyPin closed 3 years ago

FurcyPin commented 3 years ago

Hi,

being able to run a remote interactive Spark session from within IntelliJ is a great feature. Could you please write a similar documentation for PySpark + PyCharm ?

We managed to do something similar on HDinsight + PyCharm via an SSH remote interpreter, and I wouldn't consider migrating to Synapse without this.

Document Details

⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 9c98433a-f94d-f2d1-1953-bbe5ea26d052
Version Independent ID: 475cf5a5-822b-566c-f1c8-34a60408a51d
Content: Tutorial - Azure Toolkit for IntelliJ (Spark application) - Azure Synapse Analytics
Content Source: articles/synapse-analytics/spark/intellij-tool-synapse.md
Service: synapse-analytics
Sub-service: spark
GitHub Login: @hrasheed-msft
Microsoft Alias: jejiang

himanshusinha-msft commented 3 years ago

Thanks for the feedback and bringing this to our notice . At this time we are reviewing the feedback and will update the document as appropriate .

CHEEKATLAPRADEEP-MSFT-zz commented 3 years ago

@FurcyPin Thanks for the feedback! Your feedback has been shared with the content owner for further review.

Jejiang commented 3 years ago

@FurcyPin Currently, we don't have PyCharm extension to support Synapse PySpark work, like what we do for IntelliJ to support Synapse Scala/Java work. We have added your request into the our backlog and will discuss more with our engineering team and management.

Meanwhile, you can use our VSCode extension for Synapse PySpark work. Documentation can be found below: https://docs.microsoft.com/en-us/azure/synapse-analytics/spark/vscode-tool-synapse

Jejiang commented 3 years ago

@FurcyPin Let me know if you have more questions. Otherwise, we will move forward to close this issue.

Jejiang commented 3 years ago

please-close

skandupmanyu commented 2 years ago

Now that VSCode extension is retiring as mentioned in the doc, what are the plans to use PyCharm/VSCode to develop .py scripts instead of notebooks?

Psychotechnopath commented 2 years ago

Now that VSCode extension is retiring as mentioned in the doc, what are the plans to use PyCharm/VSCode to develop .py scripts instead of notebooks?

I Second this question