search

databricks-demos / dbdemos

Demos to implement your Databricks Lakehouse
Other
255 stars 80 forks source link

uc-04-system-tables - initialization job failure #45

Closed chhayavishwakarma closed 11 months ago

chhayavishwakarma commented 12 months ago

Unable to view the dashboard due to initialization job failure

image
QuentinAmbard commented 11 months ago

thanks, I suspect this is because some workspaces / sku don't have enough data. We did a check but it's at the beginning and not including all the SKU after, I moved it in the UDF. Could you try with this notebook and let me know if it fixes your issue ?

it's a .dbc as a zip for github, so you have to unzip first and then import it (replace the one that was installed with this new with the fix)

02-forecast-billing-tables.dbc.zip

It should also fix the dashboard:

QuentinAmbard commented 11 months ago

@chhayavishwakarma I released a new version including the fix, could you try to install again and let me know if it works for you? Thanks!

chhayavishwakarma commented 11 months ago

@QuentinAmbard thank you for the update, I gave it a try. however, couldn't understand why below dates doesn't match to dates in filter above.

image

another thing I wanted to check is that, does system tables give cost consumption/notebook ? and job ?

QuentinAmbard commented 11 months ago

Awesome, I think it's just because you don't have any data yet, and the graph will plot from the current month (July) and the forecast for the next 4 months (but here it looks like you don't have enough data / consumption this month) You can try the last quarter to see if you have something?

chhayavishwakarma commented 11 months ago

thank you @QuentinAmbard I will give it a try, how about this ? does system tables give cost consumption per notebook ? and job ?

QuentinAmbard commented 11 months ago

it's more compute-based, so per cluster * runtime. However systems tables are going to add more content to include jobs, warehouse and more very soon :)

chhayavishwakarma commented 11 months ago

@QuentinAmbard - Can I consider systems table as overwatch replacement ?

QuentinAmbard commented 11 months ago

I think the vision is that over time you'll at least find the same base information in the system tables as in overwatch. If what you need is or will be available in system tables then I'd recommend using that instead of overwatch, it'll be much easier for you to setup and maintain! I'm closing this, feel free to re-open if you have another question!