Closed aofarrel closed 2 years ago
I can't believe I'm only just after learning about pigz...
This saves about 40 minutes per shard. It just works. Perfectly. I'm astounded. Why is this not the default?
In the future it might be worth adding the pigz installation to every task and/or remaking the Docker image so it includes pigz already.
I can't believe I'm only just after learning about pigz...
This saves about 40 minutes per shard. It just works. Perfectly. I'm astounded. Why is this not the default?
In the future it might be worth adding the pigz installation to every task and/or remaking the Docker image so it includes pigz already.