search

EMCECS / ecs-sync

ecs-sync is a bulk copy utility that can move data between various systems in parallel
Apache License 2.0
61 stars 22 forks source link

Please increase /home directory to be much larger #41

Closed kh-dell closed 5 years ago

kh-dell commented 5 years ago

/home is only 30G, yet the file system has the best part of 150G. Some clip lists are large and by the time we create source and target lists, sort them then do a difference check, we can often easily end up filling up the /home directory.

twincitiesguy commented 5 years ago

So the reason /home is a separate partition is so it won't take down any running jobs if it happens to fill up. And the reason / (root) has so much more space allocated than /home is because the sync databases are stored under /var, and the migrations for those large lists also take up a lot of table space.

Over the years, we have had a lot of feedback to establish the partitions in the OVA. We tried to provide a reasonable allocation for both /home and /, assuming that clip lists are temporary, audit/status tables are more permanent, and we should allow a bit more room for error on the database/service side. We are also constrained by requests to limit the total size of the vdisk (we don't want to impact other VMs on a production SAN). However, obviously each situation is different, and the default allocation won't always work well.

If you are using the ecs-sync VM to store/reconcile object lists and need more space, I highly recommend expanding the /home volume as the solution. If we increase the /home partition in the OVA, we'll have to take that space from /, which will lower the space available for audit/status tables. Unfortunately that will impact too many other deployments to make sense.

There is a pretty good walk-through on expanding an LVM volume in vSphere here: https://kb.vmware.com/s/article/1006371

kh-dell commented 5 years ago

Thanks for the explanation.