search

MicrosoftDocs / azure-docs

Open source documentation of Microsoft Azure
https://docs.microsoft.com/azure
Creative Commons Attribution 4.0 International
10.25k stars 21.42k forks source link

mssparkutils.notebook.run() vs %run #121742

Closed MichalSzopinski00 closed 1 week ago

MichalSzopinski00 commented 6 months ago

Hey team,

As an Azure Spark on Synapse engineer, I'd like to propose an enhancement to a section of our documentation located at:

https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-development-using-notebooks#notebook-reference

I suggest adding a new section that compares and contrasts the nuances and underlying mechanisms of running nested notebooks using both %run and mssparkutils.notebook.run().

This addition will provide clearer guidance on the usage of both methods.

Thanks, Michal.

Document Details

⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

PesalaPavan commented 6 months ago

@MichalSzopinski00 Thanks for your feedback! We will investigate and update as appropriate.

Naveenommi-MSFT commented 6 months ago

@MichalSzopinski00 Thank you for bringing this to our attention. I've delegated this to content author @ruixinxu, who will review it and offer their insightful opinions.

bandersmsft commented 4 months ago

Followed up with author.

whhender commented 1 week ago

Thank you for this suggestion! We'll consider including this information as we update these documents in future.

whhender commented 1 week ago

please-close