und3fined / medium-unlocker

Read Medium content without limit!
https://medium.und3fined.com
Mozilla Public License 2.0
1.3k stars 57 forks source link

The journey continues #48

Open Olshansk opened 1 year ago

Olshansk commented 1 year ago

Starting this thread as a place for discussion on how we can continue the journey.

I don't have a solution (yet) but I am just posting my findings.


I just saw the recent announcement:

On July 13th, 2023, Medium has updated its platform with a new version. It restricts casual users from viewing full article content. I have attempted to bypass these restrictions but was unsuccessful. Perhaps the story will end here. I will check back again in the near future. Thank you for using this extension!

After running into it myself at this link:

Screenshot 2023-07-18 at 3 40 07 PM

I tried using 12ft.io as a proxy (accessible here), but am seeing that whatever gets indexed by Google (how 12ft.io works) is no longer the full article:

Screenshot 2023-07-18 at 3 43 04 PM
und3fined commented 1 year ago

@Olshansk thanks for sharing information. But please try with getpocket.com It's help me read full content in Medium

BudgieBird commented 1 year ago

@Olshansk thanks for sharing information. But please try with getpocket.com It's help me read full content in Medium

Upnext also works as well. Next is to try an alternative that's self-hosted/free.

Olshansk commented 1 year ago

@und3fined I've been a paying subscriber of getpocket.com for years now and contemplated cancelling my subscription recently. Seems like I now have a reason to keep it :)

Thanks @BudgieBird, looks super slick and will give it a shot as well!

BudgieBird commented 1 year ago

@Olshansk @und3fined It looks like Upnext and Pocket have been patched, at least on FF as of last evening.

Earlopain commented 1 year ago

The google search indexer gets access to the full article contents. Unfortunatly you can't just set the User-Agent to the google bot since they have well-known IPs and Medium blocks impersonators.

I believe there is however one possible solution. Since google provides cached versions of websites it's possible to get the full article that way: http://webcache.googleusercontent.com/search?q=cache:Q827lx-O0JYJ:https://towardsdatascience.com/overview-of-text-similarity-metrics-3397c4601f50 The website goes white directly after loading but the html is there. I don't know what this cache key is or whatever but you can just remove it and get a link like this: http://webcache.googleusercontent.com/search?q=cache:https://towardsdatascience.com/overview-of-text-similarity-metrics-3397c4601f50

But apparently this is how 12ft.io already works? So I'm not enirely sure, maybe something changed.

Sparticuz commented 1 year ago

I've found google's cache only works if you select Text-Only

eventanilha commented 1 year ago

Take a look here: https://gitlab.com/magnolia1234/bypass-paywalls-chrome-clean/-/issues/1061 It's working.

leviethung2103 commented 1 year ago

It's not working with bypass-paywalls. I think the medium has already fixed the problem.

BudgieBird commented 1 year ago

@leviethung2103 Are you using the -clean version linked about? Just tried FF and Chrome again, which both work.

leviethung2103 commented 1 year ago

@BudgieBird I am not using exactly the version. Because the release of source code only has v3.2.5.0 and v3.2.6.0. I've tried both versions and they did not work

UsamaKarim commented 1 year ago

@leviethung2103 You can clone the repo, It adds a link to Google Webcache

image

Opening that link worked for me

leviethung2103 commented 1 year ago

@osmanfurkan115 I've tried to open the Google Web cache. However, it shows the blank page after opening the link. Maybe I will wait for the authors to update the extension or pay 5$ for month subscription :D

UsamaKarim commented 1 year ago

@leviethung2103

  1. Which link you have tried?
  2. Are you using .crx version or BPC for installation?
und3fined commented 1 year ago
Screenshot 2023-08-01 at 15 01 59

This is first look for new unlock content

und3fined commented 1 year ago

Hi all, i release a pre-release

Please help me test: https://github.com/und3fined/medium-unlocker/releases/tag/v1.0.0-beta.1

giasraya commented 1 year ago

Hi all, i release a pre-release

Please help me test: https://github.com/und3fined/medium-unlocker/releases/tag/v1.0.0-beta.1

image

it's working Link

Thanks @und3fined

ffreemt commented 1 year ago

Awesome it works! Thanks a lot.

jamalkaksouri commented 1 year ago

Hi all, i release a pre-release

Please help me test: https://github.com/und3fined/medium-unlocker/releases/tag/v1.0.0-beta.1

I opened another article that required a subscription using the same IP, but for this article, it gives an IP block error! Why? Accessible -> https://towardsdatascience.com/overview-of-ui-monitoring-tools-for-apache-kafka-clusters-9ca516c165bd Inaccessible -> https://tomaszs2.medium.com/5-amazing-go-projects-cybersecurity-networking-and-cloud-architecture-7c4b68cc7f26 inaccessable

UsamaKarim commented 1 year ago

It gives an IP block error!

It seems like Google does not yet cache the content

jamalkaksouri commented 1 year ago

Hi all, i release a pre-release Please help me test: https://github.com/und3fined/medium-unlocker/releases/tag/v1.0.0-beta.1

I opened another article that required a subscription using the same IP, but for this article, it gives an IP block error! Why? Accessible -> https://towardsdatascience.com/overview-of-ui-monitoring-tools-for-apache-kafka-clusters-9ca516c165bd Inaccessible -> https://tomaszs2.medium.com/5-amazing-go-projects-cybersecurity-networking-and-cloud-architecture-7c4b68cc7f26 inaccessable

And in other articles, it remains frozen in the same state, and the information does not load. inaccessable2

txctxc commented 1 year ago

Hi all, i release a pre-release

Please help me test: https://github.com/und3fined/medium-unlocker/releases/tag/v1.0.0-beta.1

I opened an article that required a subscription -> https://towardsdatascience.com/uncovering-anomalies-with-variational-autoencoders-vae-a-deep-dive-into-the-world-of-1b2bce47e2e9 everything works including those python codes in this article. However, I opened another article that required a subscription -> https://towardsdatascience.com/auto-encoder-what-is-it-and-what-is-it-used-for-part-1-3e5c6f017726 Some codes in the article does not show up: image

und3fined commented 1 year ago

However, I opened another article that required a subscription -> https://towardsdatascience.com/auto-encoder-what-is-it-and-what-is-it-used-for-part-1-3e5c6f017726 Some codes in the article does not show up:

No there, it's bug from Medium

Screenshot 2023-08-02 at 23 18 32
und3fined commented 1 year ago

@jamalkaksouri Please make sure you can open Google cache Try this link http://webcache.googleusercontent.com/search?q=cache:https://tomaszs2.medium.com/5-amazing-go-projects-cybersecurity-networking-and-cloud-architecture-7c4b68cc7f26

This is my content

image

nipnipj commented 1 year ago

Beta version is working here. I'm using Linux mint 21 and Microsoft Edge.

Edit: I think code chunks are not being displayed.

1noahmorris commented 1 year ago

@und3fined How do I install it? Do I need an extension such as tampermonkey?

und3fined commented 1 year ago

@1noahmorris

Screenshot 2023-08-03 at 17 06 06
cuongblhs commented 1 year ago

Hello @und3fined How to install the beta version for Firefox?

1noahmorris commented 1 year ago

@1noahmorris Screenshot 2023-08-03 at 17 06 06

It doesn't seem to work for me. I followed the instructions and have it installed, but on any medium article it is still locked, and it doesn't show the "Medium Unlocker" watermark at the top.

rzsgrt commented 1 year ago

Hi all, i release a pre-release

Please help me test: https://github.com/und3fined/medium-unlocker/releases/tag/v1.0.0-beta.1

Just test this and its work! Thank you. But I have question (since i'm not familiar with this):

It is a snapshot of the page as it appeared on 30 Jul 2023 08:34:36 GMT.
The content is cached on Google and may not be up to date.

Medium article: link

So, it mean that article I'm read is based on content cached on 30 July? If there's update on this article, is it also update the snapshot?

und3fined commented 1 year ago

@rzsgrt Content from Google Cache and Google will update it but maybe need few day

und3fined commented 1 year ago

@cuongblhs There is a difference between the Manifest of Chrome and Firefox. You can download the zip file and create a Manifest compatible with Firefox yourself.

cretin70707 commented 1 year ago

When using webcashe the site disappears. how to get around that?

rzsgrt commented 1 year ago

So today, I try to open this article

But I got image

Anyone know why this happen?

hs41-18 commented 1 year ago

it doesnt seem to be working

bytebeats commented 1 year ago

When I Load unpacked, it show only errors:

Manifest version 2 is deprecated, and support will be removed in 2023. See https://developer.chrome.com/blog/mv2-transition/ for more details.

And my Chrome version is: Version 115.0.5790.170 (Official Build) (arm64)

und3fined commented 1 year ago

@bytebeats @hs41-18 use beta version

https://github.com/und3fined/medium-unlocker/releases/tag/v1.0.0-beta.1

hs41-18 commented 1 year ago

@bytebeats @hs41-18 use beta version

https://github.com/und3fined/medium-unlocker/releases/tag/v1.0.0-beta.1

I use beta, still seeing

image
und3fined commented 1 year ago

@bytebeats @hs41-18 use beta version https://github.com/und3fined/medium-unlocker/releases/tag/v1.0.0-beta.1

I use beta, still seeing image

Try reload page

hs41-18 commented 1 year ago

the overlay only gets removed for the previously visible part of the screen for a second and then appears again. However, in anyway the rest of the article is not visible.

cheemzboi commented 1 year ago

i was trying to access this article link but it just removed the paywall and didnt show content then i looked the errors and found this image

when i went to the link in the error page i could see the contents of the page normally

eveningcafe commented 1 year ago

my page cannot load image :( image

yskmry commented 1 year ago

@und3fined This fully works, but page translation does't work because content was wrapped by iframe.

bytebeats commented 1 year ago

@bytebeats @hs41-18 use beta version https://github.com/und3fined/medium-unlocker/releases/tag/v1.0.0-beta.1

I use beta, still seeing image

Try reload page

Recently when I tried to open member-only articles, the codes can't be loaded, only an empty region there. What's happening now?

WX20230830-112321@2x

bytebeats commented 1 year ago

I have some open source workarounds for the new medium restriction, have a look: https://freedium.cfd

Freedium still cant load codes yet.

ZhymabekRoman commented 1 year ago

Freedium still cant load codes yet.

Do you mean iframe?

bytebeats commented 1 year ago

Freedium still cant load codes yet.

Do you mean iframe?

Sorry, I'm not familiar with web technology. When I try to load member-only articles in freedium.cfd, codes can't be displayed. And neither medium unlocker did.

ZhymabekRoman commented 1 year ago

Please provide example links

bytebeats commented 1 year ago

Please provide example links

Try this guy pls: https://betterprogramming.pub/stop-calling-kotlin-flows-hot-and-cold-48e87708d863

PS: this guy is more obvious: https://betterprogramming.pub/demystifying-kotlins-channel-flows-b9007e1f773b, you can see part of its codes in safari.

ZhymabekRoman commented 1 year ago

Okey, I understand you. I will implement iframe support asap

adhiraj2001 commented 1 year ago

I have some open source workarounds for the new medium restriction, have a look: ***

Unfortunately, I am not able to find their Organization/Repository on GitHub, and the link to the source on their website doesn't seem to redirect to any URL either.

Any idea what's wrong here, or are they not open-source yet ?