search

cBio / cbio-cluster

MSKCC cBio cluster documentation
12 stars 2 forks source link

Request to clean up a bit on /cbio #404

Closed tatarsky closed 8 years ago

tatarsky commented 8 years ago

We have reached our alarm point of 5% free on GPFS with a moderately steady decline pattern.

We will determine if anyone in particular is resulting in this but I will be reducing snapshot count this morning and ask also that if you can reduce non-needed items please do so.

Thank you.

Xerez13 commented 8 years ago

I suspect this may be related to a set of jobs I am running which are taking up a lot of space on nobackup. I plan to clean up many of these files today!

tatarsky commented 8 years ago

Just to be clear, nobackup is just a directory on the same filesystem as everything else.

jchodera commented 8 years ago

We may be able to free up ~10 TB later today.

tatarsky commented 8 years ago

Noted. Its not an urgent situation but I try to flag when we dip below 5%.

jchodera commented 8 years ago

I seem to recall there was a webpage to monitor historical storage utilization by group/user---is that something that can be added to the wiki (or, if security reasons don't permit it, some internal-access-only info)?

tatarsky commented 8 years ago

I can add some of the items we've been working on to the wiki. They are internal only for a web page and some of the raw quota data that is used for it I will document where it is. Some of this data is on the private Git wiki already.

Also do not forget the per major directory "DISK*" files that the adu program generates.

tatarsky commented 8 years ago

The private git contains this data and I do not feel its public posting wise. The page there is labelled "Useful Links and Reports".

https://github.com/cBio/hal-admins-private/wiki/Useful-Links-and-Reports

The original purpose of this Git is no longer urgent as some cleaning areas were provided and removed and have now expired from the snapshots.