yuvadm / free-haaretz

A nefarious browser extension that easily bypasses the haaretz{.co.il,.com} paywall
158 stars 19 forks source link

הארץ שינו עיצוב והתוסף הפסיק לעבוד #46

Open xspy007 opened 5 years ago

xspy007 commented 5 years ago

שלום יובל הם כל הזמן בשנה האחרונה מנסים לשבש את התוסף שפיתחת כעת הם ביצעו שינויים בהפניות וב URL כך שהתוסף לא עובד עכשיו בכלל

יש אפשרות לסדר את זה בבקשה? יש לתוסף הזה עשרות אלפי משתמשים וזה שירות דמוקרטי ממעלה ראשונה בתקופה כזו

תודה רבה

antishok commented 5 years ago

Hi. You can try to block these scripts in your adblocker filters. Every once in a while they add/change it and a new url needs to be blocked..

www.haaretz.co.il/_next/static/chunks/1cc1.789c0d5cbe9c2edc2851.js
www.haaretz.co.il/_next/static/chunks/1cc1.c314b8cb97fd6abf7ce6.js
www.haaretz.co.il/_next/static/chunks/60.3d9ea9cdc2a09274d7f8.js
tworepetae commented 5 years ago

I'm experiencing the same issue as the OP. But those scripts @antishok mentioned don't appear in the ublock logger, so perhaps they made some other change?

xspy007 commented 5 years ago

Hi All

Haaretz started to change the URL, as so the add on is not working

https://www.haaretz.co.il/gallery/television/lazy-eye/.premium.highlight-1.7925476

Instead of just "premium"

That’s what I think.

10x

From: tworepetae notifications@github.com Sent: Friday, October 4, 2019 12:46 PM To: yuvadm/free-haaretz free-haaretz@noreply.github.com Cc: xspy007 udi.heller@gmail.com; Author author@noreply.github.com Subject: Re: [yuvadm/free-haaretz] הארץ שינו עיצוב והתוסף הפסיק לעבוד (#46)

I'm experiencing the same issue as the OP. But those scripts @antishok https://github.com/antishok mentioned don't appear in the ublock logger, so perhaps they made some other change?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/yuvadm/free-haaretz/issues/46?email_source=notifications&email_token=AEBMXU5DW3WD6ENKWL5FHI3QM4GEXA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEALEEDY#issuecomment-538329615 , or mute the thread https://github.com/notifications/unsubscribe-auth/AEBMXU6C3NKTKKUEMNR2ZQLQM4GEXANCNFSM4I3CSIOQ . https://github.com/notifications/beacon/AEBMXUYD7WSK7L67CLXRK4DQM4GEXA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEALEEDY.gif

antishok commented 5 years ago

@tworepetae I'm not sure if they would appear in ublock's logger, because they are "chunks" of code that is dynamically loaded by some framework they are using. Blocking those chunks is still working fine for me, and for a friend of mine. (In addition of course, to having free-haaretz installed, and Easylist Hebrew selected in ublock origin)

xspy007 commented 5 years ago

תשמעו התוסף פשוט הפסיק לעבוד, וזהו. יש מלא שגיאות ואגב, חוסמי הפרסומות מושבתים בכלל. תודה

A cookie associated with a cross-site resource at http://google.com/ was set without the SameSite attribute. A future release of Chrome will only deliver cookies with cross-site requests if they are set with SameSite=None and Secure. You can review cookies in developer tools under Application>Storage>Cookies and see more details at https://www.chromestatus.com/feature/5088147346030592 and https://www.chromestatus.com/feature/5633521622188032.

From: Uri Gilad notifications@github.com Sent: Saturday, September 28, 2019 6:36 PM To: yuvadm/free-haaretz free-haaretz@noreply.github.com Cc: xspy007 udi.heller@gmail.com; Author author@noreply.github.com Subject: Re: [yuvadm/free-haaretz] הארץ שינו עיצוב והתוסף הפסיק לעבוד (#46)

Hi. You can try to block these scripts in your adblocker filters. Every once in a while they add/change it and a new url needs to be blocked..

www.haaretz.co.il/_next/static/chunks/1cc1.789c0d5cbe9c2edc2851.js www.haaretz.co.il/_next/static/chunks/1cc1.c314b8cb97fd6abf7ce6.js http://www.haaretz.co.il/_next/static/chunks/1cc1.c314b8cb97fd6abf7ce6.js www.haaretz.co.il/_next/static/chunks/60.3d9ea9cdc2a09274d7f8.js http://www.haaretz.co.il/_next/static/chunks/60.3d9ea9cdc2a09274d7f8.js

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/yuvadm/free-haaretz/issues/46?email_source=notifications&email_token=AEBMXU43OT7ON35TX4TVXFLQL52WLA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD724FLI#issuecomment-536199853 , or mute the thread https://github.com/notifications/unsubscribe-auth/AEBMXUZWCDUMRTJXBKJK5MLQL52WLANCNFSM4I3CSIOQ . https://github.com/notifications/beacon/AEBMXU5MM4G2CQVOXSCMCWTQL52WLA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD724FLI.gif

Clegane84 commented 5 years ago

Hi Guys,

It seems some links still work while some are blocked, first here's an example for 2 links that are blocked, no matter what I've tried (filtering "chunks" in ublock, signing in and out, incognito, different browsers etc....): https://www.haaretz.co.il/gallery/television/lazy-eye/.premium.highlight-1.7925476 https://www.haaretz.co.il/news/elections/.premium.highlight-1.7942845

What seems to be in common with these, as opposed to un-blocked links - is the ".highlight" part which was added after the "premium" and is not present on un-blocked links such as this one: https://www.haaretz.co.il/tmr/.premium-1.7941588.

It might not sound like much but Identifying the issue is a start....and by differentiating blocked URL's vs. un-blocked ones we might be able to pin point the problem.

antishok commented 5 years ago

@Clegane84 thanks for the info. Your first link works ok for me, the 2nd one indeed is blocked. But I unblocked it by removing the .highlight part from the URL: https://www.haaretz.co.il/news/elections/.premium-1.7942845 That loads fine for me. But it doesn't work on all ".highlight" URLs..

xspy007 commented 5 years ago

I think an updated version of the add on is welcomed. A long time since it was and haaretz certainly made all kind of changes

10x!

From: Uri Gilad notifications@github.com Sent: Sunday, October 6, 2019 5:23 PM To: yuvadm/free-haaretz free-haaretz@noreply.github.com Cc: xspy007 udi.heller@gmail.com; Author author@noreply.github.com Subject: Re: [yuvadm/free-haaretz] הארץ שינו עיצוב והתוסף הפסיק לעבוד (#46)

@Clegane84 https://github.com/Clegane84 thanks for the info. Your first link works ok for me, the 2nd one indeed is blocked. But I unblocked it by removing the .highlight part from the URL: https://www.haaretz.co.il/news/elections/.premium-1.7942845 That loads fine for me. But it doesn't work on all ".highlight" URLs..

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/yuvadm/free-haaretz/issues/46?email_source=notifications&email_token=AEBMXU65ZVYCSVH4Z27NZR3QNHYCRA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEAOLHCY#issuecomment-538751883 , or mute the thread https://github.com/notifications/unsubscribe-auth/AEBMXU6WY2HT4NHSXY52Z7DQNHYCRANCNFSM4I3CSIOQ . https://github.com/notifications/beacon/AEBMXU5XJHKNQ67GUZ5NVLLQNHYCRA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEAOLHCY.gif

Clegane84 commented 5 years ago

@Clegane84 thanks for the info. Your first link works ok for me, the 2nd one indeed is blocked. But I unblocked it by removing the .highlight part from the URL: https://www.haaretz.co.il/news/elections/.premium-1.7942845 That loads fine for me. But it doesn't work on all ".highlight" URLs..

Yep I've noticed this behavior as well, for some reason removing the "highlight" works on some URL's but not all.

xspy007 commented 4 years ago

שלום לכולם

https://www.haaretz.co.il/gallery/television/tv-review/.premium.highlight-1.8067524 https://www.haaretz.co.il/gallery/television/tv-review/.premium.highlight-1.8067524

הארץ ממשיך להרחיב את השימוש ב highlight בשורת ה URL ולבסוף יחסום את כל האתר בצורה הזו

האם יש כוונה לעדכן את התוסף? כי עבורי ואני מניח שעבור רבים, אין דרך לעקוף וזה לא עובד בשום צורה אחרת, כולל הסרת highlight מה URL

תודה

אודי

From: Clegane84 notifications@github.com Sent: Monday, October 7, 2019 10:11 AM To: yuvadm/free-haaretz free-haaretz@noreply.github.com Cc: xspy007 udi.heller@gmail.com; Author author@noreply.github.com Subject: Re: [yuvadm/free-haaretz] הארץ שינו עיצוב והתוסף הפסיק לעבוד (#46)

@Clegane84 https://github.com/Clegane84 thanks for the info. Your first link works ok for me, the 2nd one indeed is blocked. But I unblocked it by removing the .highlight part from the URL: https://www.haaretz.co.il/news/elections/.premium-1.7942845 That loads fine for me. But it doesn't work on all ".highlight" URLs..

Yep I've noticed this behavior as well, for some reason removing the "highlight" works on some URL's but not all.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/yuvadm/free-haaretz/issues/46?email_source=notifications&email_token=AEBMXU3AB7UL4CHV5G5HWY3QNLOGVA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEAPHRLA#issuecomment-538867884 , or mute the thread https://github.com/notifications/unsubscribe-auth/AEBMXU2Y4V6NERW2Z3DED63QNLOGVANCNFSM4I3CSIOQ . https://github.com/notifications/beacon/AEBMXUYZGRCSJDQGXXCYAEDQNLOGVA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEAPHRLA.gif

xspy007 commented 4 years ago

היי יובל

יהיה פתרון ? או שוויתרת?

תודה

From: Udi Heller (Gmail) udi.heller@gmail.com Sent: Sunday, November 3, 2019 8:58 AM To: 'yuvadm/free-haaretz' reply@reply.github.com; 'yuvadm/free-haaretz' free-haaretz@noreply.github.com Cc: 'Author' author@noreply.github.com Subject: RE: [yuvadm/free-haaretz] הארץ שינו עיצוב והתוסף הפסיק לעבוד (#46)

שלום לכולם

https://www.haaretz.co.il/gallery/television/tv-review/.premium.highlight-1.8067524 https://www.haaretz.co.il/gallery/television/tv-review/.premium.highlight-1.8067524

הארץ ממשיך להרחיב את השימוש ב highlight בשורת ה URL ולבסוף יחסום את כל האתר בצורה הזו

האם יש כוונה לעדכן את התוסף? כי עבורי ואני מניח שעבור רבים, אין דרך לעקוף וזה לא עובד בשום צורה אחרת, כולל הסרת highlight מה URL

תודה

אודי

From: Clegane84 <notifications@github.com mailto:notifications@github.com > Sent: Monday, October 7, 2019 10:11 AM To: yuvadm/free-haaretz <free-haaretz@noreply.github.com mailto:free-haaretz@noreply.github.com > Cc: xspy007 <udi.heller@gmail.com mailto:udi.heller@gmail.com >; Author <author@noreply.github.com mailto:author@noreply.github.com > Subject: Re: [yuvadm/free-haaretz] הארץ שינו עיצוב והתוסף הפסיק לעבוד (#46)

@Clegane84 https://github.com/Clegane84 thanks for the info. Your first link works ok for me, the 2nd one indeed is blocked. But I unblocked it by removing the .highlight part from the URL: https://www.haaretz.co.il/news/elections/.premium-1.7942845 That loads fine for me. But it doesn't work on all ".highlight" URLs..

Yep I've noticed this behavior as well, for some reason removing the "highlight" works on some URL's but not all.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/yuvadm/free-haaretz/issues/46?email_source=notifications&email_token=AEBMXU3AB7UL4CHV5G5HWY3QNLOGVA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEAPHRLA#issuecomment-538867884 , or mute the thread https://github.com/notifications/unsubscribe-auth/AEBMXU2Y4V6NERW2Z3DED63QNLOGVANCNFSM4I3CSIOQ . https://github.com/notifications/beacon/AEBMXUYZGRCSJDQGXXCYAEDQNLOGVA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEAPHRLA.gif

yuvadm commented 4 years ago

The addon as it currently exists doesn't have any strategy for handling these URLs. I'll happily accept any PRs if anyone is interesting in doing the research on it.

eyalgindi commented 4 years ago

Guys, if you have any page which is blocked and with some (manual) URL or any other modification you were able to pass through, please comment with such an example, so we can try and find a generic way to modify the addon to work with the latest changes.

xspy007 commented 4 years ago

Hey

https://www.haaretz.co.il/opinions/.premium.highlight-1.8069289

if u try dismissing the .highlight there is a redirection back to the original URL so u cannot bypass it.

The same way the add on handless the .premium, it should now handle the .premium.highlight ?

10x

From: eyalgindi notifications@github.com Sent: Monday, November 4, 2019 11:18 AM To: yuvadm/free-haaretz free-haaretz@noreply.github.com Cc: xspy007 udi.heller@gmail.com; Author author@noreply.github.com Subject: Re: [yuvadm/free-haaretz] הארץ שינו עיצוב והתוסף הפסיק לעבוד (#46)

Guys, if you have any page which is blocked and with some (manual) URL or any other modification you were able to pass through, please comment with such an example, so we can try and find a generic way to modify the addon to work with the latest changes.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/yuvadm/free-haaretz/issues/46?email_source=notifications&email_token=AEBMXUZAYOJBHIICXAU52ETQR7SFZA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEC6TR7Y#issuecomment-549271807 , or unsubscribe https://github.com/notifications/unsubscribe-auth/AEBMXU664WJYXVVVTAG5OSTQR7SFZANCNFSM4I3CSIOQ . https://github.com/notifications/beacon/AEBMXUZ45PIW4B76NBIP3JDQR7SFZA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEC6TR7Y.gif

eyalgindi commented 4 years ago

OK, Find out that the URL redirection is being done locally based on a pre-loaded code on request time, that's why ublock script blocking didn't help. Skimming the code, I've noticed the below line, which might be the flag for hiding the content.

Will continue investigation later on, if anyone here is familiar with ublock scripting, I'd go that way, trying to set properties value to false.

LL25255252 commented 4 years ago

Hi Guys,

It seems some links still work while some are blocked, first here's an example for 2 links that are blocked, no matter what I've tried (filtering "chunks" in ublock, signing in and out, incognito, different browsers etc....): https://www.haaretz.co.il/gallery/television/lazy-eye/.premium.highlight-1.7925476 https://www.haaretz.co.il/news/elections/.premium.highlight-1.7942845

What seems to be in common with these, as opposed to un-blocked links - is the ".highlight" part which was added after the "premium" and is not present on un-blocked links such as this one: https://www.haaretz.co.il/tmr/.premium-1.7941588.

It might not sound like much but Identifying the issue is a start....and by differentiating blocked URL's vs. un-blocked ones we might be able to pin point the problem.

Works fine for me on all those 3 links (except the comments - as usual for me, if I want to read the comments I use another browser without the extension) . Tested both on Firefox 70.0.01 (64bit) and Waterfox Classic

uBlock Orgin w (with EasyList Hebrew filter but without any other tweaks ) Win 7 x64

LL25255252 commented 4 years ago

OK... while still not being blocked on @Clegane84 links it happened to me on this link - https://www.haaretz.co.il/gallery/television/tv-review/.premium.highlight-1.8070572

... So maybe the new ".premium.highlight" mechanism only effects NEW URLs ? If so how many days it take for a URL to change its category from NEW to OLD ?

roeyzaw1 commented 4 years ago

Hi all,

I've taken a brief look at the new HTTP request. What is interesting is z-actions-log parameter, which is added now with "super content blocked"

I suspect that Haaretz has now added a reverse DNS lookup before serving the webpage: https://support.google.com/webmasters/answer/80553?hl=en

Clegane84 commented 4 years ago

Hi Guys, It seems some links still work while some are blocked, first here's an example for 2 links that are blocked, no matter what I've tried (filtering "chunks" in ublock, signing in and out, incognito, different browsers etc....): https://www.haaretz.co.il/gallery/television/lazy-eye/.premium.highlight-1.7925476 https://www.haaretz.co.il/news/elections/.premium.highlight-1.7942845 What seems to be in common with these, as opposed to un-blocked links - is the ".highlight" part which was added after the "premium" and is not present on un-blocked links such as this one: https://www.haaretz.co.il/tmr/.premium-1.7941588. It might not sound like much but Identifying the issue is a start....and by differentiating blocked URL's vs. un-blocked ones we might be able to pin point the problem.

Works fine for me on all those 3 links (except the comments - as usual for me, if I want to read the comments I use another browser without the extension) . Tested both on Firefox 70.0.01 (64bit) and Waterfox Classic

uBlock Orgin w (with EasyList Hebrew filter but without any other tweaks ) Win 7 x64

The links you are referring to in your post are already obsolete, as Haaretz remove the "highlight" tag from an article after a while (could be anything from a few days to weeks, from my experience). Right now manually removing the "highlight" part from the URL only works on a tiny fraction of articles, while 99% will not work following this manipulation (the page will simply refresh with the "highlight" tag again). I'm afraid once all the articles will move to the "highlight" tag - this addon will turn completely useless.

xspy007 commented 4 years ago

Hey Guys

Haaretz is spreading the assimilation of the ".premium.highlight" across all sections and articles.

Anything that can or will be done? o/w the add on is becoming useless.

I think that Haaretz is, by his own hands, losing the democratic battle and leave the field open for those who act against it by releasing their poisoning content freely.

10x

From: Clegane84 notifications@github.com Sent: Friday, November 8, 2019 9:19 AM To: yuvadm/free-haaretz free-haaretz@noreply.github.com Cc: xspy007 udi.heller@gmail.com; Author author@noreply.github.com Subject: Re: [yuvadm/free-haaretz] הארץ שינו עיצוב והתוסף הפסיק לעבוד (#46)

Hi Guys, It seems some links still work while some are blocked, first here's an example for 2 links that are blocked, no matter what I've tried (filtering "chunks" in ublock, signing in and out, incognito, different browsers etc....): https://www.haaretz.co.il/gallery/television/lazy-eye/.premium.highlight-1.7925476 https://www.haaretz.co.il/news/elections/.premium.highlight-1.7942845 What seems to be in common with these, as opposed to un-blocked links - is the ".highlight" part which was added after the "premium" and is not present on un-blocked links such as this one: https://www.haaretz.co.il/tmr/.premium-1.7941588. It might not sound like much but Identifying the issue is a start....and by differentiating blocked URL's vs. un-blocked ones we might be able to pin point the problem.

Works fine for me on all those 3 links (except the comments - as usual for me, if I want to read the comments I use another browser without the extension) . Tested both on Firefox 70.0.01 (64bit) and Waterfox Classic

uBlock Orgin w (with EasyList Hebrew filter but without any other tweaks ) Win 7 x64

The links you are referring to in your post are already obsolete, as Haaretz remove the "highlight" tag from an article after a while (could be anything from a few days to weeks, from my experience). Right now manually removing the "highlight" part from the URL only works on a tiny fraction of articles, while 99% will not work following this manipulation (the page will simply refresh with the "highlight" tag again). I'm afraid once all the articles o Haaretz will move to the "highlight" tag - this addon will turn completely useless.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/yuvadm/free-haaretz/issues/46?email_source=notifications&email_token=AEBMXU5H5MNO7OX2OPFSPPLQSUHGJA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEDO62EY#issuecomment-551415059 , or unsubscribe https://github.com/notifications/unsubscribe-auth/AEBMXU3SCB2UVEMGEUQGPCDQSUHGJANCNFSM4I3CSIOQ . https://github.com/notifications/beacon/AEBMXU6RE6AVMUB23RH4F7DQSUHGJA5CNFSM4I3CSIO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEDO62EY.gif

Nirsch1 commented 4 years ago

Hey guys! Was there any progress in this matter, in the last few months ?