search

storj / uplink

Storj network Go library
MIT License
115 stars 18 forks source link

Support different hash algorithm for piece hash #121

Closed iglesiasbrandon closed 1 year ago

iglesiasbrandon commented 1 year ago

The main goal here is support more than one piece hash algorithm.

When we upload, we calculate the hash of the pieces. This is very expensive operation, especially as we use SHA-256.

Blake3 showed some benefits. Mainly in the used cpu, the wall clock duration was mainly the same.

We extended the protocol to support different piece hash algorithm, but we didn't modify anything in the uplink.

Now we can upload experimental files and do more measurements.

iglesiasbrandon commented 1 year ago

Hey @elek can you add a description to this ticket and update it if the code has already been merged/ deployed?