search

kemayo / leech

Turn a story on certain websites into an ebook for convenient reading
MIT License
158 stars 24 forks source link

Fanfiction.net not working. #53

Closed WiseThrush closed 3 years ago

WiseThrush commented 3 years ago

I got this error when I tried python leech.py https://www.fanfiction.net/s/12044591/1/Forged-Destiny

[sites] Load failed: waiting 10 to retry (403: https://www.fanfiction.net/s/12044591/)

It's working for fiction.live though.

kemayo commented 3 years ago

Yeah, fanfiction.net very recently did a migration to use CloudFlare that blocked most non-browser methods of loading their pages. The only way around it so far is to run a proxy server that (basically) runs a copy of Chrome that loads pages for you... which is a bit of a pain.

They've said that they're going to be launching an API that people can use to download things, so ideally they'll do that promptly and I can just switch to it.

WiseThrush commented 3 years ago

Alright, thanks for the info. And the program too, it's been quite helpful.

kemayo commented 3 years ago

Incidentally, because I had a copy sitting around from a while ago, here's the story you were trying to get.