search

coderanger / kitchen-sync

Test Kitchen transport plugin to speed up tests.
Apache License 2.0
81 stars 24 forks source link

Added tar.gz support for folder upload. #31

Open AdallomRoy opened 7 years ago

AdallomRoy commented 7 years ago

When first uploading files (no directory @ remote), it's MUCH more efficient to tar.gz files @ local, upload the archive and unzip it @ the remote. For comparison, some 170 seconds uploads cut down to 1-2 seconds during my tests. (more than x100) It still falls back to using parallel upload for single files or if it fails in one of the steps.

coderanger commented 7 years ago

How does this compare to rsync and what kind of latency is there on your connection?

AdallomRoy commented 7 years ago

Hi,

I haven't compared it to rsync, since rsync is required to be installed @ the remote, while I'm using the base Azure Linux image and it's not installed there (as opposed to tar which comes with the basic Linux image), so it's irrelevant for me. I'm located in Israel, and running azurerm on West Europe - that's the main cause for the latency. I guess if I were running a local vagrant things would look differently. As for the exact latency, this is an example ping result: Reply from XXXXXX: bytes=32 time=75ms TTL=48

Roy.

amontalban commented 7 years ago

Would love to have this merged, +1

AdallomRoy commented 7 years ago

Hi @coderanger, Are you going to accept this patch? Do you have anything that should be fixed, or comments regarding it?

Thanks

moshezvi commented 7 years ago

Any update on this?

AdallomRoy commented 7 years ago

@coderanger ?

AdallomRoy commented 7 years ago

@coderanger ?

AdallomRoy commented 6 years ago

@coderanger ??????