search

BLEND360 / innovation_lab

cool stuff for people to work on
0 stars 0 forks source link

snowflake spending #9

Open charlesdublend360 opened 2 years ago

charlesdublend360 commented 2 years ago

we are spending way too much money on Snowflake.

let's figure out what's going on.

charlesdublend360 commented 2 years ago

we need to federate access. WE should be in control of who is using what

charlesdublend360 commented 2 years ago

we need to produce reports of who is spending how much month by month.

We then need accountability to see which department is spending the money

Which needs to be further broken down to which projects are spending money

charlesdublend360 commented 2 years ago

repeat excercise for storage. We are currently spending $500/month on storage

charlesdublend360 commented 2 years ago

@AliHaddad-ForthPoint can you work with Ksenia to get this sorted out for EOD today please?

I need to know which warehouses are responsible for our monthly cost ($3k)

I need to know which client accounts those warehouses are being used for.

And finally I need to know why our storage costs are so high.

kseniadyakova10 commented 2 years ago

snowflake.zip @AliHaddad-ForthPoint

kseniadyakova10 commented 2 years ago

credit_ovg.zip @charlesdublend360 @AliHaddad-ForthPoint In this file you will find the sql script for credit usage from organization_usage.usage_in_currancy_daily that i was looking at and the excel file are the results of the query. If you look at the results, your total $ is over $2,800. The only thing i'm not sure about is, in the "usage_type" column, everything start with "overage". Does that mean this is extra credits that you went over?? Also, it looks like East is spending a lot more in compute than west. and if you look at credit usage the here are your top offenders:

2022-03 POWERHOUSE CENTURY_PROD 139.138045139837 2022-03 POWERHOUSE ALTERYX 72.218877031157 2022-03 POWERHOUSE RUPADHYE 59.038179304536 2022-03 POWERHOUSE HQIN 46.700373669434 2022-03 WH_BIGBOY ZIYUE.QI@BLEND360.COM 42.81088395145 2022-03 POWERHOUSE KSENIA.DYAKOVA@BLEND360.COM 38.077748071179 2022-03 WH_BIGBOY ZQI 30.724103612 2022-03 WH_BIGBOY DATA_INSTALL 28.722887714551

and this is storage top ones (GB)... you have two new tables in march

2022-01 ALTAIR_HISTORICAL_100821 C2G_LAKE_DEV ZIYUE.QI@BLEND360.COM 278.956920147 2022-03 EPSILON_TSP_LATEST C2G_LAKE_DEV ABHIRAM.GOPAL@BLEND360.COM 89.496411324 2022-03 ACXIOM_LATEST C2G_LAKE_DEV DATA_INSTALL 81.190359592 2022-01 ALTAIR_SAMPLE_5PCT C2G_LAKE_DEV ZIYUE.QI@BLEND360.COM 15.163201332