MSD-LIVE / issues

0 stars 0 forks source link

finish figuring out why there was a spike in efs costs #237

Open zguillen opened 1 month ago

zguillen commented 1 month ago

Need to figure out why the daily cost of our dev efs was $30/day when it should have been 3 cents a day. Suspect datasync caused this. When looking at metrics for that efs drive there was '100' data reads for the time period we saw the price increase for (IDK what units that is in however): Image

Standard (GB-Month) $0.16 57.29 * 0.16 = $9.16 / 31 = 0.029 cents per day

Test this theory by datasync'ing demo bucket to dev efs once and see what cost is next day, do again (should be no data moved) and check costs again

datasync is set up to be once per hour for edu notebooks, dataset notebook has RDM's cron triggering dataset once every 10 mins. But that would explain the cost being 6x more than expected, which is way less than what we're seeing