offspot / imager-service

Create Kiwix Hotspot microSD cards online
https://imager.kiwix.org/
GNU General Public License v3.0
10 stars 6 forks source link

download from mirror.download #408

Closed rgaudin closed 2 months ago

rgaudin commented 2 months ago

Once we have https://github.com/offspot/offspot-config/issues/39, we should force downloads from mirror.download and not rely on metalink anymore has this proved to be slower in the worker case. This explains by worker and host being in same DC while metalink downloads from a number of hosts in parallel.

kelson42 commented 2 months ago

@rgaudin Do you know why this is slower? Sounds strange to me as mirror.download is anyway a source in the Metalink!

rgaudin commented 2 months ago

this is not new. aria2 for metalink assigns parts of the file for the number of source it wants. Parts assigned to mirror.download will be fast but the others will be slower. There would be more parts for that mirror since it would finish them faster but still.

rgaudin commented 2 months ago

Done. Readers and ZIM are downloaded from mirror. with Checksum.