search

databrickslabs / overwatch

Capture deep metrics on one or all assets within a Databricks workspace
Other
226 stars 64 forks source link

Have question on Configuration csv file #1190

Closed learnprofile closed 4 months ago

learnprofile commented 5 months ago

Sensitive Content Alert Please remember that this repository is publicly visible so do not post anything sensitive in your report such as user emails, secrets, etc.

Overwatch Version 0.8.0.x+

Describe the bug Based on the documentation : https://databrickslabs.github.io/overwatch/deployoverwatch/configureoverwatch/configuration/ it says to use this .csv file and make changes with respect to Azure Databricks URL.

Screenshots If applicable, add screenshots to help explain your problem. Be sure to blur or cover any sensitive data.

The documentation is not clear if i need to upload this .csv file to storage account/ mount point and then which command to run? however based on existing notebook i made changes and while running below step:

image

It throws this error:

DeltaAnalysisException: [DELTA_MISSING_TRANSACTION_LOG] Incompatible format detected.

You are trying to write to dbfs:/test/1206-003704-wvqwgqbx/global_share/instancedetails using Delta, but there is no transaction log present. Check the upstream job to make sure that it is writing using format("delta") and that you are trying to write to the table base path.

To learn more about Delta, see https://docs.microsoft.com/azure/databricks/delta/index

So wanted to know what is going wrong?

Issue Reports Please provide the reports requested from the Troubleshooting page in the docs.

Neha-vs123 commented 5 months ago

Hi @learnprofile,

Please let me know your timezone. We need to get on a call to understand your existing configurations and what is missing. I am from the IST timezone. We can connect at an available time.

Regards, Neha

learnprofile commented 5 months ago

if you are available we can connect now?

learnprofile commented 5 months ago

Hi Neha, I am available now for a call, could you send teams invite we can discuss further.

Thanks, Prashanth Kumar

Sent from Outlookhttp://aka.ms/weboutlook

From: Neha VS @.> Sent: Monday, April 29, 2024 12:28 PM To: databrickslabs/overwatch @.> Cc: learnprofile @.>; Mention @.> Subject: Re: [databrickslabs/overwatch] Have question on Configuration csv file (Issue #1190)

Hi @learnprofilehttps://github.com/learnprofile,

Please let me know your timezone. We need to get on a call to understand your existing configurations and what is missing. I am from the IST timezone. We can connect at an available time.

Regards, Neha

— Reply to this email directly, view it on GitHubhttps://github.com/databrickslabs/overwatch/issues/1190#issuecomment-2082009340, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AHU4H7QCNSZ34R7644Y7MC3Y7XVTHAVCNFSM6AAAAABG5N5PNCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBSGAYDSMZUGA. You are receiving this because you were mentioned.Message ID: @.***>

Neha-vs123 commented 5 months ago

Hi @learnprofile,

I have a conflict, can we connect at 3pm IST?

learnprofile commented 5 months ago

Yes 3pm IST will work for me, please send me the meeting invite accordingly.

Neha-vs123 commented 5 months ago

@learnprofile please share your mail id to send the meeting invite. If not, can you send the invite directly? My mail id is neha.vs@databricks.com

learnprofile commented 5 months ago

Sure thank you, I just sent you teams invite.

Neha-vs123 commented 5 months ago

Hi @learnprofile, Thanks for joining the call. Hope your doubts are cleared. Please let me know if you have any other issues.

Regards, Neha