search

yuvadm / free-haaretz

A nefarious browser extension that easily bypasses the haaretz{.co.il,.com} paywall
158 stars 19 forks source link

Haaretz and TheMarker status code 403 #49

Open maxim-sm opened 3 years ago

maxim-sm commented 3 years ago

Hi,

Thanks for the add-on! It seems that Haaretz (and TheMarker) are detecting the add-on and are throwing error 403 when trying to access any page from these domains. Same issue is occurring with Bypass Paywalls extension: https://github.com/iamadamdev/bypass-paywalls-chrome/issues/1004

Tested on Firefox: Desktop Version: 82 Mobile Version: 68.10 Add-On Version: 0.9.7

1

maxim-sm commented 3 years ago

An interesting finding from the issue linked in the OP. Apparently the issue is with the user-agent (Googlebot).

almog commented 3 years ago

@maxim-sm The problem is likely not with the user agent string, but rather with it (finally?) being validated, probably using reverse dns-lookup.

I've noticed that I only get an error when using the google-bot agent, whereas the Bing user agent (see https://github.com/almog/free-haaretz/commit/4ebbe85f3705cd196fdc12d88789ef0863b768fa) still bypasses the paywall. I also tried Duck Duck Go and Yandex but both aren't excluded from the paywall

Also, when I tested this locally with about:debugging (after failing to package and use the XPI), I saw that there are multiple warning regarding the manifest file, which may or may not be the reason why FF reports the XPI as corrupted.

borges136 commented 3 years ago

managed to create a working XPI (attached here as ZIP but it's same) by uploading it as an unlisted extension to addons.mozilla.org and downloading the signed version.

free_haaretz.zip

murad2019 commented 3 years ago

@borges136 thank you it works now :)

yoavsapir commented 3 years ago

managed to create a working XPI (attached here as ZIP but it's same) by uploading it as an unlisted extension to addons.mozilla.org and downloading the signed version.

free_haaretz.zip

@borges136 Any way to download it as XPI on android? Firefox doesn't allow manual installation of XPIs from the device, only via links (at least on android).

borges136 commented 3 years ago

sorry @yoavsapir , i don't have an android device... try with this link maybe? https://srv-store5.gofile.io/download/pWlfyb/free_haaretz-0.9.7-fx.xpi