realaravinth / libmedium

An Alternative Medium Frontend | Development continues at: https://git.batsense.net/realaravinth/libmedium
https://libmedium.batsense.net
GNU Affero General Public License v3.0
74 stars 7 forks source link

Certain member-only articles cannot be read #27

Open FireMasterK opened 9 months ago

FireMasterK commented 9 months ago

These can be viewed through Google/Bing's cache for example.

Example URL: https://medium.com/@steve_mullen/an-introduction-to-lean-canvas-5c17c469d3e0

Here's a tool that can read it: https://www.smry.ai/proxy?url=https%3A%2F%2Fmedium.com%2F%40steve_mullen%2Fan-introduction-to-lean-canvas-5c17c469d3e0

realaravinth commented 9 months ago

I never thought about bypassing member-only articles and this seems like a very good idea. Thanks for sharing!

realaravinth commented 4 months ago

minor update: I did some research on this matter, and I found out that smry.ai uses JSDOM to parse Google Webcache/Wayback machine archives to retrieve dynamically rendered content, and then renders the page displayed to the web user.

I couldn't find a good JSDOM-like library in Rust, so I'm thinking I'll create something like ladder (it doesn't render dynamic pages like smry; or I would use it) and use it as a supporting service for libmedium. I have a rough proof-of-concept ready, but it needs a lot of work before it is production ready.