search

cBio / cbio-cluster

MSKCC cBio cluster documentation
12 stars 2 forks source link

Massive level of Metadata was added #423

Closed tatarsky closed 8 years ago

tatarsky commented 8 years ago

Somebody overnight has managed to fill the metadata disks 100%.

They were at 40% use this weekend.

I am trying to determine who and how to proceed.

tatarsky commented 8 years ago

Seems to have something to do with snapshots and deleted file rates. I am dropping snapshots.

tatarsky commented 8 years ago

Back to 8% free. Still dropping snapshots to see which one is involved.

tatarsky commented 8 years ago

Our nightly GPFS snapshots size profile has dramatically changed. I am reviewing the average sizes of them as I delete them and will likely need to alter the methods involved to provide that service.

It appears to be a combination of some recent inode increases but also decreases due to deletions. But the bottom line is the assumptions of the number/rate of them needs to be re-examined.

tatarsky commented 8 years ago

This has been confirmed. I have adjusted the logic for the pruning of snapshots to prevent a re-occurrence.