search

project-machine / puzzlefs

Apache License 2.0
378 stars 18 forks source link

Parallelize puzzlefs builds #84

Closed ariel-miculas closed 10 months ago

ariel-miculas commented 1 year ago

We can parallelize the data chunks compression and storage, since the chunks are independent of one another.

ariel-miculas commented 1 year ago

I made a parallel version but it's not significantly faster than the single threaded version, so it's not worth adding it.