search

MicrosoftDocs / azure-docs

Open source documentation of Microsoft Azure
https://docs.microsoft.com/azure
Creative Commons Attribution 4.0 International
10.25k stars 21.42k forks source link

Update page to reflect better practices #104531

Closed JimThorstad closed 1 year ago

JimThorstad commented 1 year ago

Hello,

This is a nice walkthrough of a long process, but can you consider in Step for of this section https://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-databricks-notebook#create-an-azure-databricks-linked-service to recommend or link to additional steps to configure the use of the built-in ADF Managed Identity or a customer defined user-assigned managed identity to connect to Azure Databricks, rather than the currently shown Access Token?

Access Tokens are more difficult for the customer to maintain and I believe MSFT is recommending Managed Identities now. We have some Databricks customers that are new and getting started and as a Databricks field SA I continually have to show them how to do the best practices and avoid learning all the old ways of Key vault, Databricks secret scope, and access tokens.

I'm considering creating my own blog on MSFT Tech Community to show the better practice but I always prefer the official doc to have this to avoid customers going to too many places to see how to do things.

At a minimum, maybe you could elaborate in that section to say "an easier to maintain approach for ADF to connect to Databricks is with Managed Identities. Your ADF instance includes a system assigned managed identity which is revealed when you change Access Type from Access Token to System assigned Managed Identity. Refer to this page to see how to register this identity as a Databricks Service principal and assign it the entitlement to create Databricks clusters and give it access to data in Unity Catalog. "

Document Details

⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

SaibabaBalapur-MSFT commented 1 year ago

@JimThorstad Thanks for your feedback! We will investigate and update as appropriate.

RamanathanChinnappan-MSFT commented 1 year ago

@JimThorstad

Thanks for your contribution. The information discussed in the following links is relevant to your concern. Our product team will review your concern and update you as needed.

https://techcommunity.microsoft.com/t5/azure-data-factory-blog/azure-databricks-activities-now-support-managed-identity/ba-p/1922818

https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/enable-workspaces

https://techcommunity.microsoft.com/t5/analytics-on-azure-blog/azure-data-factory-and-azure-databricks-best-practices/ba-p/3074262

Please add your ideas in below link, Ideas · Community (azure.com).

RamanathanChinnappan-MSFT commented 1 year ago

@JimThorstad

We are going to close this thread but if there are any further questions regarding the documentation, please tag me in your reply and we will be happy to continue the conversation.