p0ody / ff2ebook

WIP.
http://www.ff2ebook.com
18 stars 2 forks source link

Cannot download fanfiction #31

Closed MortalOP closed 3 years ago

MortalOP commented 3 years ago

Shows output error in the new version and 'missing fic info' in old version.

StarWolf3000 commented 3 years ago

See #27 and #30.

MortalOP commented 3 years ago

So is there any solution?

On Mon, 28 Dec, 2020, 10:51 AM StarWolf3000, notifications@github.com wrote:

See #27 https://github.com/p0ody/ff2ebook/issues/27 and #30 https://github.com/p0ody/ff2ebook/issues/30.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/p0ody/ff2ebook/issues/31#issuecomment-751579955, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASI5FBY2MV4IB7NAEV3GJUDSXAIUZANCNFSM4VLGK2IA .

StarWolf3000 commented 3 years ago

There was a temporary solution with using a list of proxies, but it's rather difficult to circumvent the Cloudflare protection on FFN (it was introduced a few weeks ago, after they experienced a DDoS attack).

MortalOP commented 3 years ago

I think only new fics are not downloadable because I can download old ones......

On Mon, 28 Dec, 2020, 1:47 PM StarWolf3000, notifications@github.com wrote:

There was a temporary solution with using a list of proxies, but it's rather difficult to circumvent the Cloudflare protection on FFN (it was introduced a few weeks ago, after they experienced a DDoS attack).

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/p0ody/ff2ebook/issues/31#issuecomment-751627089, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASI5FB346S2NSLKPCDJUQVLSXA5H3ANCNFSM4VLGK2IA .

bastien8060 commented 3 years ago

I think that would be because ff2ebooks can retrieve fanfic that has been downloaded before. Its "cached".

bastien8060 commented 3 years ago

If the maintainers of this repo (or anyone else) are interested, I am nearly finished working on a "fixed" version of this, that works on fanfiction.net, effectively bypassing CloudFlare for now. I could submit a pull/merge request when its done.

Edit: I am just stitching up a few details, before considering it finished :) !

Edit 2: I can confirm it works well too, just rather slow.

PenguinPaws commented 3 years ago

I think that would be because ff2ebooks can retrieve fanfic that has been downloaded before. Its "cached".

ff2ebook definitely does archive previously pulled stories. That's where there's an Archive link at the top :)

bastien8060 commented 3 years ago

Yep :) My fix works well so far but its pretty slow. I would only use it on small fanfic. I will keep working on this tomorrow to see if I can improve the speed :)

Edit: And there is also the pairing detections to fix. Screenshot_2021-01-02-11-44-27-459_com android chrome

LanzCorporalAssWipe commented 3 years ago

Yep :) My fix works well so far but its pretty slow. I would only use it on small fanfic. I will keep working on this tomorrow to see if I can improve the speed :)

Edit: And there is also the pairing detections to fix. Screenshot_2021-01-02-11-44-27-459_com android chrome

Bro. If you manage to get it working i will proclaim you as the Omnissiah.

p0ody commented 3 years ago

@bastien8060 , your work is appreciated. Just add a pull request when you're satisfied with your work and I'll merge it.

Personally i dont have the time anymore to work on this.

Thank you

bastien8060 commented 3 years ago

@bastien8060 , your work is appreciated. Just add a pull request when you're satisfied with your work and I'll merge it.

Personally i dont have the time anymore to work on this.

Thank you

Glad it helps. I can submit a merge request for now with some slow execution time if your willing to level up your server's timeout value :). You probably will need to put it up to 5 minutes or so, for people converting large ebooks (around ~40 chapters ish), when ajax calls are stacked up, since php is not asynchronous among different clients.

It will take some time before I find some quality and reliable proxies. I have about 140 proxies I think, but only 50 of them are not "that slow". Also 10 of them are really fast but will run out after 5GB (Not an issue for now I think).

Edit: I only applied edits to the portable branch since I don't have time to get a database.

here (https://github.com/bastien8060/ff2ebook) if you want to have a look

StarWolf3000 commented 3 years ago

Also 10 of them are really fast but will run out after 5GB (Not an issue for now I think).

Is that a daily limitation?

bastien8060 commented 3 years ago

Also 10 of them are really fast but will run out after 5GB (Not an issue for now I think).

Is that a daily limitation?

Ahem, monthly... But the rest of them are unlimited. I'm not too worried with that just yet. There are many other proxies still and I am still trying to find more.

bastien8060 commented 3 years ago

Alright It's finished, now waiting on moderator to merge the code. FF2ebook.com won't be fixed until the moderator of that website (probably @p0ody, but not necessarily) chooses to update it with latest changes from this GitHub Repo. If all goes well, everything should be working soon.

Btw, don't expect it to be lightning-fast like before. I'm still surprised with how fast it used to be (lol). Also, there is a very slight error rate, but it does happen. You can try again in that case or run it on your own pc, with a VM. (probably wont need to go that far.)

If you want to see the details, I encourage you to check #33.

Bro. If you manage to get it working i will proclaim you as the Omnissiah.

All credit for the tool of course remains to @p0ody. FF2Ebook is a very well coded tool and website, and he's the one to write it all in the first place. I only just wrote a small fix.

Edit: I quite like working on this project too btw, and I am a huge fan of this repo. I could add another fanfiction site to be supported, in my spare time tomorrow if you guys have any ideas. (I thought Wattpad because I would be using it).

How does that sound?

Edit 2: I almost feel like I'm writing an A/N lol.