search

moosefs / moosefs-docker-cluster

Multiple node MooseFS cluster on Docker
https://moosefs.com
GNU General Public License v2.0
77 stars 27 forks source link

Disk size limits do not work as expected #16

Open Derkades opened 4 years ago

Derkades commented 4 years ago

When creating four chunk servers with a single disk (but actually all on the same host disk), environment variable SIZE=10 one expects to get four chunk servers that show 0GB / 10GB (0%) used. However, the web interface shows 10GB / 10GB (100%) used. Creating files fails with an out of space error.

image

When removing the size limit the cause of this issue becomes immediately obvious: image To calculate 'used' space moosefs uses the drive's used space instead of the size of files actually stored in the directory. This makes a lot of sense due to performance and inconsistency issues when counting individual files, but it makes the SIZE option a lot less useful.

It took me quite a while to figure out why all my disks showed as full, if there is no good fix for this at least you should document this in the README or manual in my opinion.

Derkades commented 4 years ago

It appears that as soon as one object is uploaded it calculates used space correctly image

rocinante-sys commented 3 years ago

my test setup does not want to store anything. it says no space on device :)

Derkades commented 3 years ago

@rocinante-sys Are you using storage quotas (SIZE environment variable)?

rocinante-sys commented 3 years ago

@Derkades yes, I saw in first post that is the issue. It works if I leave it out :+1: