search

criteo / kitchen-transport-speedy

Speed up kitchen file transfer using archives
Apache License 2.0
5 stars 5 forks source link

Speedy compression v2 #6

Closed Lqp1 closed 3 years ago

Lqp1 commented 3 years ago

The goal of this patch is to do a full compress of archives before sending them over ssh. This reduces a lot needed bandwidth; as an example, we reduce an archive of 32MB to 2MB only.

Wdyt?

Lqp1 commented 3 years ago

Note that this was inspired by https://github.com/test-kitchen/test-kitchen/pull/845, which we can alternatively use.

jeremy-clerc commented 3 years ago

My 2 comments for the redirect on stdout, else LGTM. I'll let @Annih approve as you had some discussions internally.