After any completed download on a single File, the last chunk was not released and lived in memory until all files have been downloaded.
Changes
Release chunks from memory (rather mark it as garbage for later collection) right after it has been written to the temporary file.
Refactor the httpx.AsyncClient strategy to use the same client across the lifetime of a Processor object (e.g. during the lifetime of a single esgpull download command).
After any completed download on a single File, the last chunk was not released and lived in memory until all files have been downloaded.
Changes
httpx.AsyncClient
strategy to use the same client across the lifetime of aProcessor
object (e.g. during the lifetime of a singleesgpull download
command).