[FEATURE REQUEST] Allow multithreaded compression with pigz support

nienbo / cache-buildkite-plugin

Tarball, Rsync & S3 Cache Kit for Buildkite. Supports Linux, macOS and Windows

https://buildkite.com/plugins

MIT License

67 stars 39 forks source link

[FEATURE REQUEST] Allow multithreaded compression with pigz support #38

Closed stiak closed 3 years ago

stiak commented 3 years ago

I've started using this plugin as a proof of concept vs multi stage docker builds. So far it's working pretty well. One thing that can be slow is the compression of assets. On our node project this is about 3 minutes. I did some digging into how to speed that up, and it seems like pigz is the multithreaded equivalent of gzip. I see that gzip is currently hardcoded, it would be great to see the option of using pigz.

Ideally this would be an additional parameter in the plugin configuration.

gencer commented 3 years ago

Released as v2.4.10 🎉

Thank you for the PR!