search

jborg / attic

Deduplicating backup program
Other
1.11k stars 104 forks source link

Attic and large files #63

Open jure1 opened 10 years ago

jure1 commented 10 years ago

I've recently found out about attic and it seems really interesting, but I'm having trouble backing up large files (ie. dvd images). Is it possible to do something about it - skip deduplication, decrease compression or something that would speed things up? I've tried creating and running attic on a large directory with many small files and it works great, but now I'm creating a new repository of a bunch of home folders and from the output of lsof I can see it takes several hours to backup large files. Update: I'm using encryption, transferring over ssh with arcfour and compression enabled over a 10mbit line. It seems that the network is the bottleneck.

jborg commented 10 years ago

Yeah, Attic should have no problem filling a 10mbit line.

Is it okay to close this issue now, or do you have other large file related problems and/or questions?

jure1 commented 10 years ago

If anyone else has problems: I've switched to ssh hpn, set the compressionlevel to 1 and ciphers to arcfour128 and now it is better. So yes, it's ok to close the issue now.

anarcat commented 9 years ago

bump: this issue can be closed.

rpodgorny commented 9 years ago

mentioning ssh-hpn, this would be a nice fit: https://github.com/jborg/attic/issues/99

ThomasWaldmann commented 9 years ago

please close.