Reduce memory usage by reading and writing to file, instead of reading entire file into memory.
Check for existing file with correct hash to avoid re-downloading.
Both of these are important for working with large bundles of large files. For example the cbz files of the recent "Image Comics Showcase" was 91 files totaling 23GB.
Some of this was taken from @affinityv 's earlier pull request, which included many other things as well
Reduce memory usage by reading and writing to file, instead of reading entire file into memory.
Check for existing file with correct hash to avoid re-downloading.
Both of these are important for working with large bundles of large files. For example the cbz files of the recent "Image Comics Showcase" was 91 files totaling 23GB.
Some of this was taken from @affinityv 's earlier pull request, which included many other things as well