This PR is adapted from the compression-opts branch. See discussion on #257 for details. This PR drops the zstd option from that branch.
This PR adds the flag --compression to kit pack, with valid options none, gzip, and gzip-fastest:
none: no compression of layers, store layers as plain tarballs
gzip: current default behavior, compress layer tarballs with gzip
gzip-fastest: compress layer tarballs with gzip at the lowest compression level
The new default behavior is none, i.e. layers are stored in tar format with no compression. In testing, this was found to be a lot faster with minimal effect on modelkit size.
In addition, the gzip-fastest option is added as testing showed that it could decrease pack time by a factor of 2-10x with minimal loss in compression ratio.
Description
This PR is adapted from the compression-opts branch. See discussion on #257 for details. This PR drops the
zstdoption from that branch.This PR adds the flag
--compressiontokit pack, with valid optionsnone,gzip, andgzip-fastest:none: no compression of layers, store layers as plain tarballsgzip: current default behavior, compress layer tarballs with gzipgzip-fastest: compress layer tarballs with gzip at the lowest compression levelThe new default behavior is
none, i.e. layers are stored in tar format with no compression. In testing, this was found to be a lot faster with minimal effect on modelkit size.In addition, the
gzip-fastestoption is added as testing showed that it could decrease pack time by a factor of 2-10x with minimal loss in compression ratio.Linked issues
Closes #257