search

oconnor663 / bao

an implementation of BLAKE3 verified streaming
Other
479 stars 23 forks source link

think about parallelism a la Blake2bp #9

Closed oconnor663 closed 6 years ago

oconnor663 commented 6 years ago

Is there a way to define a parallelism mode such that you don't pay 4x or 8x the cost for tiny inputs?

oconnor663 commented 6 years ago

Probably the format itself doesn't need any modification for parallelism. A decoder could buffer 4 or 8 chunks at a time, hash them all in parallel, and then assemble them into the tree as usual. You could even hash parent nodes in parallel, all the way up.

It would be very interesting to try this with Rayon.

oconnor663 commented 6 years ago

This has been working for a while.