fedebotu
commented
1 year ago LGTM!
At the moment though, it does not support adding proxies to the GUI - we may consider adding it as well Also, as for the proxy, here is a simple possible fix that could be done automatically: https://github.com/monosans/proxy-list Just adding crawling that proxy list on start and running with that should be sufficient
Anonymous github restrict max connections to 350 files / 15mins. To counter-act this restriction, I added proxies option and make the algorithm skips all files downloaded correctly.
But there is still a main drawback is that I cannot determine the binary files is downloaded correctly or not. So if the files are not existed, then downloaded. If not, some of the files will be jumped over and others will downloaded again. [see line 50 in src/download.py]