OpenWaterFoundation / cdss-app-snodas-tools

Colorado's Decision Support Systems (CDSS) Snow Data Assimilation System (SNODAS) Tools
8 stars 4 forks source link

Compress old files #34

Closed smalers closed 3 years ago

smalers commented 3 years ago

The old files in /var/opt/snodas-tools-1 are taking up about 600 GB of disk space out of 1TB disk. This is going to be an issue when we run the full period using the new software. Therefore, need to run gzip on all files that can compress in the old files, such as *.csv and *.geojson. These files can be removed at some point but keep for now in case we need to compare results. Ideally the result will be that at least 700-800 GB are free so that we can store all the new output with room for several years of output. If that does not work, we may need to resize the disk, which is hopefully easier than resizing the system disk.

Nightsphere commented 3 years ago

All files in the retired /var/opt/snodas-tools-1/ directory have been compressed with gzip, which has brought down the disk space from ~ 600 GB to 145 GB. This leaves 841 GB free for the new SNODAS Tools data, which will last for a while. Closing the issue.