genious7 / FanFictionReader

An android app that improves browsing Fan Fiction stories on a mobile device
GNU General Public License v3.0
56 stars 24 forks source link

Story refuses to download #77

Closed acesknight closed 3 years ago

acesknight commented 3 years ago

I'm trying to download a 53 chapter story and in the 20 times i've tried the furthest it's gotten is 15 chapters.Is anyone else struggling with this?

acesknight commented 3 years ago

Through My Blood by ThatFenrisWolf Incase anyone was wondering.

sykotiksonik commented 3 years ago

I made an account specifically for responding that yes, I am also having the same issue, and that I hope it can be resolved soon. The story for me, in question, is The DOOM Chronicles, which has been updated over the past few months the app has been out of service to now have 94 chapters. As I attempt to download the new chapters, it gets to around 80/94 complete before giving up.

Love the app, it's my first and usually my only choice for comfortably reading Fanfictions!

genious7 commented 3 years ago

The problem is as follows: FanFiction.net does not want people to download stories, which is why they added a Cloudflare check to block downloads. My app tries to go around that (and it sort-of-does), but whichever automated system they use sometimes detects the download (particularly on longer stories where it is more obvious) and blocks the download.

Truth to be told, there will never be a perfect solution since Cloudflare is deliberately blocking the download on the other side. That being, said, I will try to remedie the issue by having the app wait a few seconds after failing to download a chapter before automatically retrying rather than quitting the whole process as it does now.

I'll work on that during the weekend.

Luminatrix-eng commented 3 years ago

The problem is as follows: FanFiction.net does not want people to download stories, which is why they added a Cloudflare check to block downloads. My app tries to go around that (and it sort-of-does), but whichever automated system they use sometimes detects the download (particularly on longer stories where it is more obvious) and blocks the download.

Truth to be told, there will never be a perfect solution since Cloudflare is deliberately blocking the download on the other side. That being, said, I will try to remedie the issue by having the app wait a few seconds after failing to download a chapter before automatically retrying rather than quitting the whole process as it does now.

I'll work on that during the weekend.

@genious7 I've got an update since the last time I've logged in. Unfortunately, every time I try to update my stories, the que goes up to 20% before I get an error message with: "Error downloading story. Failed to connect to server". About 6 times in a row, it always fails at 20%. Which leads me to think it's not random.

I was able to update about 5 stories during that 20% but after that, it kept getting a error message and stops at 20%. I don't know if cloudflare is doing this or not but just wanted to let you know. I hate being the bearer of bad news or negative updates especially when this happens.

hallowknight99 commented 3 years ago

The problem is as follows: FanFiction.net does not want people to download stories, which is why they added a Cloudflare check to block downloads. My app tries to go around that (and it sort-of-does), but whichever automated system they use sometimes detects the download (particularly on longer stories where it is more obvious) and blocks the download. Truth to be told, there will never be a perfect solution since Cloudflare is deliberately blocking the download on the other side. That being, said, I will try to remedie the issue by having the app wait a few seconds after failing to download a chapter before automatically retrying rather than quitting the whole process as it does now. I'll work on that during the weekend.

@genious7 I've got an update since the last time I've logged in. Unfortunately, every time I try to update my stories, the que goes up to 20% before I get an error message with: "Error downloading story. Failed to connect to server". About 6 times in a row, it always fails at 20%. Which leads me to think it's not random.

I was able to update about 5 stories during that 20% but after that, it kept getting a error message and stops at 20%. I don't know if cloudflare is doing this or not but just wanted to let you know. I hate being the bearer of bad news or negative updates especially when this happens.

Same. Also I think I found a new issue sometimes when downloaded 1 new story and then click the update button for all stories the counter increased by 2 which it should of increased by 1 e.g. counter was 2004 and now 2006 although only 1 new story was added. Might be related why getting "Error downloading story. Failed to connect to server"

Edit: looking at the sqlonline.com it appears that I have 1967 showing in the sql database of doing a latest backup. Now I wonder where the other number is coming from.

hallowknight99 commented 3 years ago

@genious7 How about a automatic update function that checks for updates every 2 hours or so if reading a long story for a while so when person comes out of the stoey the other stories will be already updated to read the new chapters. see code below that I found.

ScheduledExecutorService ses = Executors.newSingleThreadScheduledExecutor();
ses.scheduleAtFixedRate(new Runnable() {
    @Override
    public void run() {
        update command
    }
}, 0, 2, TimeUnit.HOURS);
ghrrrr commented 3 years ago

The problem is as follows: FanFiction.net does not want people to download stories, which is why they added a Cloudflare check to block downloads. My app tries to go around that (and it sort-of-does), but whichever automated system they use sometimes detects the download (particularly on longer stories where it is more obvious) and blocks the download. Truth to be told, there will never be a perfect solution since Cloudflare is deliberately blocking the download on the other side. That being, said, I will try to remedie the issue by having the app wait a few seconds after failing to download a chapter before automatically retrying rather than quitting the whole process as it does now. I'll work on that during the weekend.

@genious7 I've got an update since the last time I've logged in. Unfortunately, every time I try to update my stories, the que goes up to 20% before I get an error message with: "Error downloading story. Failed to connect to server". About 6 times in a row, it always fails at 20%. Which leads me to think it's not random. I was able to update about 5 stories during that 20% but after that, it kept getting a error message and stops at 20%. I don't know if cloudflare is doing this or not but just wanted to let you know. I hate being the bearer of bad news or negative updates especially when this happens.

Same. Also I think I found a new issue sometimes when downloaded 1 new story and then click the update button for all stories the counter increased by 2 which it should of increased by 1 e.g. counter was 2004 and now 2006 although only 1 new story was added. Might be related why getting "Error downloading story. Failed to connect to server"

Edit: looking at the sqlonline.com it appears that I have 1967 showing in the sql database of doing a latest backup. Now I wonder where the other number is coming from.

Extra number could be from stories that has been since deleted from the site. And adding 2 to the story counter instead of one could be one for the download and one for the checking of the whole list for updates. Since the list contains one additional story now but i am not sure, in my previous experience it only added one when you try to download an additional story while checking for updates. (Process as i understand is that it first notes all the stories then checks that list one by one so there shouldnt be non-manual addition to that list once it begins.)

Ahh... how i missed the days there was only one specific story that i couldnt ever download (i think due to some weird reason the app tries to download more chapters(17) than that actually exists(16) causing it to fail. Dont know why but it has been this way for years) (id:1798522 'Curse of the Banshees by Sheyda' if anyone is wondering or wanted to try downloading it) now all the stories are the same