Some download sites (e.g: the GMTED one) have a TCP-layer rate-limiter which simply kills connections. This makes it rather difficult to download large files reliably, which would be required if running Joerd across a large cluster.
This PR adds a download method which is reliable in the sense that it can resume terminated downloads, and is configurable.
rmarianski
commented
8 years ago
Some download sites (e.g: the GMTED one) have a TCP-layer rate-limiter which simply kills connections. This makes it rather difficult to download large files reliably, which would be required if running Joerd across a large cluster.
This PR adds a download method which is reliable in the sense that it can resume terminated downloads, and is configurable.
Connects to #18.
@rmarianski could you review, please?