flokli / nix-casync

A more efficient way to store and substitute Nix store paths
80 stars 4 forks source link

pkg/store/blobstore/casync_store: make chunking size configurable, add parallelity #35

Closed flokli closed 2 years ago

flokli commented 2 years ago
commit ed87efca2b79f7ebedb3ff44652bfb478280b9b6
Author: Florian Klink <flokli@flokli.de>
Date:   Thu Jan 13 23:49:07 2022 +0100

    pkg/store/blobstore/casync_store.go: ramp up concurrency

    Configure a concurrency of the number of CPUs available to the process,
    up to the maximum of 4.

commit e3cfb4b40b7b1892f7c27099a609d3b34e262c3c
Author: Florian Klink <flokli@flokli.de>
Date:   Thu Jan 13 00:59:24 2022 +0100

    Provide a --avg-chunk-size parameter

    This controls the average chunking size to use when receiving Narfiles.

    The min and max values are a fifth and four times that value,
    respectively.

Fixes #1