search

helloSystem / Utilities

Utilities written in PyQt5, meant for use with helloSystem
BSD 2-Clause "Simplified" License
28 stars 29 forks source link

zsync tool/utility #28

Open probonopd opened 3 years ago

probonopd commented 3 years ago

Need a zsync tool/utility that can download the incremental update vs the already-downloaded ISO.

zsync allows you to download a file from a remote server, but by comparing with a local file it will only retrieve the newer parts, thereby minimizing the volume of your download.

This will hopefully speed up downloading coninuous builds significantly.

The zsync in FreeBSD cannot handle https and/or redirects properly, but my fork does, by utilizing libcurl: https://github.com/probonopd/zsync-curl/

Also see: https://github.com/probonopd/zsync-curl/issues/38

probonopd commented 3 years ago

zsync_curl is using only one core for reading the seed (="old") file, which makes it slow...

probonopd commented 3 years ago

So slow in fact that re-dowloading may be faster, depending on your connection. Also, right now only 25% were re-used in almost identical builds Probably this could be optimized by experimenting with the compression...