andrinux / opendedup

Open Deduplication File System
1 stars 2 forks source link

Chuncks not being cleaned up. #22

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
It does not seem like deleted files are being cleaned up.

I have created a couple of VMware Workstation VMs in a 100GB SDFS volume. All 
has been deleted except one. The Windows XP VM that remains has written about 
1.2 GB of data, but the archive now consumes 6.5 GB.

The volume was created as a 10GB volume, but was changed to a 100GB volume by 
editing the "/etc/sdfs/sdfs_vol1-volume-cfg.xml" file, and remounting the store.

The first VM I installed with Windows XP could not boot after a short while. I 
dont know why, but it has not happened again so far.

After that experience I devided to use getfattr to create a vmdk to install in. 
I then created a 20GB vmdk, and that is the one I am currently using.

du -sh /opt/sdfs/volumes/sdfs_vol1/
6,5G    /opt/sdfs/volumes/sdfs_vol1/

Filesystem            Size  Used Avail Use% Mounted on
sdfs_vol1-volume-cfg.xml 100G  1,3M  100G   1% /mnt/sdfs_vol1

Original issue reported on code.google.com by bfkmnemo...@gmail.com on 25 Sep 2010 at 1:21

Attachments:

GoogleCodeExporter commented 9 years ago
The data got corrupted again. I attached some output it made to the console 
where I mounted the volume.

Original comment by bfkmnemo...@gmail.com on 25 Sep 2010 at 1:56

Attachments:

GoogleCodeExporter commented 9 years ago
SDFS does garbage collection on data that has not been claimed for 6-10 hours. 
Garbage collection can occur more frequently by modifying the parameters within 
the sdfs configuration file.
Take a look at http://www.opendedup.org/administrators-guide#dcr. Also, within 
sdfs 0.9.7 and later, you can clean the store manually by running 

setfattr -n user.cmd.cleanstore -v 5555:<minutes back> <mount-path>

 It looks like your volume filled up and caused errors and corruption.

Let me know if this helps.

Original comment by sam.silv...@gmail.com on 27 Sep 2010 at 8:14

GoogleCodeExporter commented 9 years ago

Original comment by sam.silv...@gmail.com on 27 Sep 2010 at 8:15

GoogleCodeExporter commented 9 years ago

Original comment by sam.silv...@gmail.com on 16 Oct 2010 at 3:55