search

openzim / zim-requests

Want a new ZIM file? Propose ZIM content improvements or fixes? Here you are!
https://farm.openzim.org
36 stars 2 forks source link

<us_code> configuration is incorrect #1108

Open RavanJAltaie opened 1 month ago

RavanJAltaie commented 1 month ago

Recipe URL

https://farm.openzim.org/recipes/us_code

What is wrong

The recipe is still running for 18 days, but when you check the debug, the progress is 100% complete with the error below: Warning, A/uscode.house.gov/images/stat/111/894.png have empty mimetype.

benoit74 commented 1 month ago

This is an old zimit 1.6.3 task. Please cancel the ghost task and request the recipe again now that we are on 2.0.3, there is significant chances the problem is already solved (or at least I won't be able to fix the problem on 1.6.3)

benoit74 commented 1 month ago

Oh, and before requesting the task you should fix the disk resources. Currently it says it needs only 4GB, which is obviously wrong, it is going to be way bigger.

image

I suggest you start by assuming it is going to be 100G for instance, and you'll be able to refine this number once the first ZIM is produced.

benoit74 commented 1 month ago

Note that a ZIM has finally been uploaded. It is however quite broken, so definitely worth it to run again the task with Zimit2

RavanJAltaie commented 1 month ago

@benoit74 I've requested again with Zimit 2.0.4, I'll update the progress here once done.

RavanJAltaie commented 1 week ago

it took around 14 days and the progress is still 80%, I've cancelled and re-requested

benoit74 commented 1 week ago

I think there is no point in re-request this. The scraper is behaving correctly, it is just the site which is too big and/or zimit which is not appropriate for this content.