I can't create nice zim like before on zimit.kiwix, display looks like on a mobile device

hamoudak commented 3 months ago

in the last three or four days something strange happend when creating or browsing custom zim files. first there was in the scraper info field just : warc2zim and now I see zimit 2.0.3 + browsertrix crawler 1.2.0 . I think this is an update or something related. the main problem now is that (include field) not working as it was. not excluding any urls . sometimes it bypasses the given urls to include others, and with another website it takes a while to open pages in the created zim file. the web page interface styles and fonts changed completely by itself and not working well . could you please fix this; I 'll give you screenshots to confirm the issue.

this is the old one, working as expected, everything as on the web and it plays from the defined url . (from page 84 to 70)

this is when everything has changed . when I play it, it won't start from the defined url (page 69) I can't see it. besides the other problems I have mentioned and more .

benoit74 commented 3 months ago

in the last three or four days something strange happend when creating or browsing custom zim files.

We have rolled out progressively zimit2 and warc2zim2 over the last days / weeks indeed

first there was in the scraper info field just : warc2zim and now I see zimit 2.0.3 + browsertrix crawler 1.2.0

The old info was limited, you now have full details of the three tools used: zimit, crawler and warc2zim. Details of the discussion are in https://github.com/openzim/warc2zim/issues/156 and linked issues / PRs

the main problem now is that (include field) not working as it was. not excluding any urls . sometimes it bypasses the given urls to include others, and with another website it takes a while to open pages in the created zim file. the web page interface styles and fonts changed completely by itself and not working well . could you please fix this; I 'll give you screenshots to confirm the issue.

We will need more info. Just sharing screenshots is not sufficient. Would you mind to share which parameters you are passing to zimit so that we can debug your issue? We already have ~40 ZIMs in production using the new version and they work like a charm, so it is not like we broke everything, but as with any big update I wouldn't be surprised there are few rough edges left.

hamoudak commented 3 months ago

thank you for the info. this is the forum display link - https://majles.alukah.net/forumdisplay.php?f=20&page=69

I used to make these settings:

depth : 23 extra hops : 2 scope type : custom include ( for instance) :

hamoudak commented 3 months ago

have you figured it out ?

benoit74 commented 3 months ago

Nope, didn't found time to have a look at it this week. Next week hopefully.

hamoudak commented 3 months ago

ok, I hope so.

benoit74 commented 3 months ago

OK so the change occurred because since Zimit 2 we use by default a technical setting to indicate the website we want the mobile version of the website, since most of our users are browsing ZIMs from mobile devices.

The website you are ZIMing is not dynamically adjusting its layout based on screen size, so the layout which is stored inside the ZIM is the mobile layout, and it does not adapt dynamically when the reader is finally browsing the ZIM from a big screen.

Should you want to return to previous "big screen" layout (which is probably ugly on mobile devices), you have to either set the As Device setting to a big screen device (probably in landscape)

Or you can restore Zimit1 behavior with the new setting "No Device" (I just added it few minutes ago to the UI, it was available in the scraper but not available from UI, it got forgotten). This setting is a bit dangerous since it means it will crawl at a default resolution (which currently is desktop, so it is fine, but it might change in the future), but this is probably OK for your usecase. Just tick the toggle to restore Zimit1 behavior.

hamoudak commented 3 months ago

thank you for clearing this up to me , I didn't know much of it, and for adding the "No device" setting . am using a laptop and browse zims on it all the time, so now am gonna try to use first "No device" then I'll check later "big screen" which is landscape. I hope it work as I did it before. I'll tell you the results after downloading one.

hamoudak commented 3 months ago

It did work but I have noticed something; it takes sometime (ten seconds or thirteen) to open pages, what do about that? when I leave the app sometime in the background then i go to open pages, it opens fast for just one page.

benoit74 commented 3 months ago

Can you share a ZIM with us (preferably a - very - small one) so that we can confirm if the issue is linked to the Kiwix JS reader or to the Zimit scraper? (if it's ok for you, you can upload it to whatever upload service you would like, e.g. https://www.swisstransfer.com if you are looking for a safe one)

hamoudak commented 3 months ago

https://www.swisstransfer.com/d/433db02e-57e0-422f-b3a1-169830b6300b

benoit74 commented 3 months ago

Thank you!

Unfortunately I'm not experiencing at all the slowness you're speaking about, not in Kiwix JS and not in Kiwix Apple (MacOS). This is going to be hard to diagnose.

Can you confirm you are using Kiwix JS 3.3.6 and opening the ZIM in trust mode? If not which version are you using?

hamoudak commented 3 months ago

yes I am - Kiwix JS PWA 3.3.6. my op is windows 10 pro ; but now when I was browsing the file more than once , pages open normal, no problem with it ! anyway sorry for taking your time. I know you're busy with your stuff.

hamoudak commented 3 months ago

hii once again, I've tried to uninstall it with its data on chrome, then reinstalled a fresh one, it was very fast as you said. it could be something with overload data on my chrome browser. I don't know.

benoit74 commented 2 months ago

OK, let's close this issue then

openzim / zimit-frontend

I can't create nice zim like before on zimit.kiwix, display looks like on a mobile device #59