search

offspot / imager-service

Create Kiwix Hotspot microSD cards online
https://imager.kiwix.org/
GNU General Public License v3.0
11 stars 6 forks source link

Installer fails to retrieve zim files #283

Closed Popolechien closed 5 months ago

Popolechien commented 2 years ago

https://cardshop.hotspot.kiwix.org/orders/L755R61B7, https://cardshop.hotspot.kiwix.org/orders/L754R61B7, and https://cardshop.hotspot.kiwix.org/orders/L753R61B7 all failed with a variation of Error downloading http://mirror.download.kiwix.org/zim/nameofzimfile.zim to /data/kiwix-hotspot.cache/nameofzimfile.zim aria2c returned 1 With said zim files being ' wikipedia_en_all_maxi' or ' cest-pas-sorcier_fr_all'

Popolechien commented 2 years ago

Ok I stand corrected: the installer does not fail to retrieve the zim file: it is more like the connection breaks at some point.

In my latest run (L757R61B8) the installation crashed while it was 16% into the download of cest-pas-sorcier_fr_all

rgaudin commented 2 years ago

Was already the case for the other ones ; first one failed after download 48GiB for instance

Popolechien commented 2 years ago

Yes yes but I had written a generic "fails", I wanted to put it on record in the ticket what the issue was.

Popolechien commented 2 years ago

Both https://cardshop.hotspot.kiwix.org/orders/L765R61C0 and https://cardshop.hotspot.kiwix.org/orders/L766R61C0 crashed again, again with C'est pas sorcier, around 15 and 23% of it.

I did have another config in English with Wikipedia_en_all_maxi go through, on the plus side.

Popolechien commented 2 years ago

Created a new order with the same config from which I only removed the usual point of failure (C'est pas sorcier) and relaunched: it failed again with error being on KAlite (not a zim therefore):

Error downloading http://mirror.download.kiwix.org/other/kalite/videos_fr_0.17.tar to /data/kiwix-hotspot.cache/kalite_videos_fr.tar
aria2c returned 1
rgaudin commented 2 years ago

OK, it's the first time it's not happening on a ZIM AFAIK. It's also a much smaller file (10GB)

Popolechien commented 2 years ago

Re-added C'est pas sorcier, which is now last on the content list order for image creation: after a couple of recreations (61d84cba98c8bfb26d64a327, 61d840a498c8bf4811649001) it clearly is not the cause of this issue as the creation fails now consistently on the same yet different 15G file (at 44 and 73%):

Error downloading http://mirror.download.kiwix.org/zim/other/nota-bene_fr_all_2020-04.zim to /data/kiwix-hotspot.cache/nota-bene_fr_all.fr.zim
aria2c returned 1
Popolechien commented 2 years ago

Adding L819R61E7, L820R61E7 and L818R61E7

First and second ones crashed on c'est pas sorcier, the third one on KAlite videos (exact same as above videos_fr_0.17.tar)

Popolechien commented 2 years ago

Adding L827R61ED which failed on 

Error downloading http://mirror.download.kiwix.org/zim/wikihow/wikihow_en_maxi_2022-01.zim to /data/kiwix-hotspot.cache/wikihow_en_maxi.en.zim
aria2c returned 1

There have been three or four successful image creations with similar setups (c'est pas sorcier) before that so clearly this is more of something acting up that a clear bug.

kelson42 commented 5 months ago

@rgaudin Time to reassess/fix this issue considering the new imager downloader is going to be harden.