search

OctopusDeploy / Octodiff

| Public | 100% C# implementation of remote delta compression based on the rsync algorithm
Other
27 stars 87 forks source link

Investigate alternate hashing algorithms #23

Open droyad opened 5 years ago

droyad commented 5 years ago

Also, it would be interesting to use the xxHash algorithm instead of SHA1 (SHA1 has an average speed of 0.28 GB/s, while xxHash has 5.4 GB/s).

https://cyan4973.github.io/xxHash/

Originally posted by @arabasso in https://github.com/OctopusDeploy/Octodiff/pull/21#issuecomment-535457374

For Octopus we would need to figure out how we get the two ends to agree on the algorithm to be used.

GrzegorzBlok commented 4 years ago

@droyad xxHash64 is a default algorithm instead of SHA1 in a library that I derived from Octodiff: https://github.com/GrzegorzBlok/FastRsyncNet It works perfectly fine - it gives you significant faster calculations and smaller signature size.

droyad commented 4 years ago

@GrzegorzBlok Cool. The blocker for Octopus is negotiating between the two endpoints since either end could be running an older version of Octodiff.