openzim / zimit

Make a ZIM file from any Web site and surf offline!
GNU General Public License v3.0
401 stars 26 forks source link

Add ability to disable JavaScript #419

Open vitaly-zdanevich opened 1 month ago

vitaly-zdanevich commented 1 month ago

For example this website will be closed after a few weeks - but with JS enabled in my browser - I see a blocking popup https://ask.fm/kami_____g

Image

ikreymer commented 1 month ago

Using a browser profile created with Browsertrix Crawler will avoid the popup, as Brave blocks this. However, it only happens on second page load, so a profile is needed. If you reload the page, the popup will be gone, then save the profile and pass that to zimit. Browsertrix docs on profiles here: https://crawler.docs.browsertrix.com/user-guide/browser-profiles/#using-browser-profile-with-a-crawl You should be able to just the profile with zimit as well I believe.

benoit74 commented 1 month ago

Disabling the javascript won't help at all since javascript looks mandatory on this website for many things. You need a way to prevent this popup, and browser profile is indeed the only potential solution, and yes this is supported by zimit.

I propose to close this issue since there is not much to do on our side, it is more a matter of configuring the crawler (and yes, this is very tricky).