search

gilbertchen / duplicacy

A new generation cloud backup tool
https://duplicacy.com
Other
5.11k stars 335 forks source link

File size and storage usage #436

Open theincogtion opened 6 years ago

theincogtion commented 6 years ago

I am currently uploading my backup using sftp with chunksize 1M and 4 parallel threads. encryptio is on. My storage is also available via cifs/smb if I take a look on my folder size it looks like this in windows: grafik

Größe auf Datenträger = size on storage Größe= size

It looks like if it consumes 40% more storage as the file size. any idea how to avoid this? My backup will take a few hours and has 88GB My storage has 100GB so if the values are true I will not be able to finish my backup.

I had to reduce the chunksize due to high ram usage. would the "size on storage" be smaller if I use 2M? max and min are not defined.

A single file with a small size looks like this: grafik

looks like that even small files consume at least 1M and if have a lot of small text files in my source folder

gboudreau commented 6 years ago

Pretty sure the Size on Disk number is just wrong.
Check the number using a SSH console: du -sk /path/to/backup/snapshot-id/

My guess: Samba is reporting wrong Size on Disk. Ref: https://lime-technology.com/forums/topic/53133-share-in-windows-quotsize-vs-size-on-diskquot-massive-difference-question/?tab=comments#comment-522441