search

microsoft / Purview-ADB-Lineage-Solution-Accelerator

A connector to ingest Azure Databricks lineage into Microsoft Purview
MIT License
92 stars 56 forks source link

What is DB_CLUSTER_ID? #152

Closed saf-itpro closed 1 year ago

saf-itpro commented 1 year ago

I am not sure if there is a forum for asking questions related to this Lineage Accelerator. In step 4 of this deployment guide, I do not understand where to find DB_CLUSTER_ID in spark.openlineage.namespace <ADB-WORKSPACE-ID>#<DB_CLUSTER_ID>.

On this online search, I see AWS has something called db cluster identifier. But I am not seeing anything DB_CLUSTER_ID in Azure databricks. Question: Is this just a ClussterID?

wjohnson commented 1 year ago

Thank you for your interest and working through the solution accelerator!

Yes, this is the cluster id which you should find in the tags that Azure Databricks automatically applies to a cluster.

DB in this case stands for DataBricks.

On Mon, Jan 30, 2023 at 11:46 AM saf-itpro @.***> wrote:

I am not sure if there is a forum for asking questions related to this Lineage Accelerator. In step 4 https://github.com/microsoft/Purview-ADB-Lineage-Solution-Accelerator/blob/release/2.2/deploy-base.md#install-openlineage-on-your-databricks-cluster of this deployment guide, I do not understand where to find DB_CLUSTER_ID in spark.openlineage.namespace

#. On this online search , I see AWS has something called db cluster identifier. But I am not seeing anything DB_CLUSTER_ID in Azure databricks. Question: Is this just a ClussterID? — Reply to this email directly, view it on GitHub , or unsubscribe . You are receiving this because you are subscribed to this thread.Message ID: ***@***.*** com>