2i2c-org / infrastructure

Infrastructure for configuring and deploying our community JupyterHubs.
https://infrastructure.2i2c.org
BSD 3-Clause "New" or "Revised" License
106 stars 65 forks source link

AWS Cost Attribution: Investigate why deleted files are not reflected in Grafana until days later #5164

Open jnywong opened 1 day ago

jnywong commented 1 day ago

Context

Following a hack session with Openscapes (see https://github.com/2i2c-org/meta/issues/1578), both Tasha (CryoCloud) and Andy (Openscapes) reported that they had deleted large datasets (~1TB) from the hub and this was not reflected in Grafana until a few days to 1 week later. This is a small area of concern as they wish to verify with Grafana that they are not paying for data that they believe has been deleted. There is also interest in understanding how this is related to backup costs.

Definition of Done