LightNovelPub not working

Enrico-Fabbri commented 1 year ago

Source information

LightNovelPub

Steps to reproduce

Search a novel on LightNovelPub using the global research and specific research. Try to read a novel.

Expected behavior

It should load the Light Novels

Actual behavior

When I search a novel in the global search lnp always visualize a JSON parsing error Screenshot_2023-06-28-16-20-27-07_3c1c179116822eec69c21805387f0489 And I always get an error saying the app couldn't surpass cloudflare protection Screenshot_2023-06-28-16-30-02-94_3c1c179116822eec69c21805387f0489 It won't load all the text of the chapter Screenshot_2023-06-28-16-38-18-41_3c1c179116822eec69c21805387f0489.jpg

LNReader version

1.1.15

Android version

Android 13

Other details

No response

Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open issue.
[X] I have written a short but informative title.
[X] I have updated the app to version 1.1.15.
[X] I have updated all installed extensions.
[X] If this is an issue with the app itself, I should be opening an issue in the app repository.
[X] I will fill out all of the requested information in this form.

K1ngfish3r commented 1 year ago

try this dev build: https://github.com/K1ngfish3r/lnreader/actions/runs/5403272535 it should fix [x] lightnovelpub search [ ] cloudflare protection? once you open the source once in webview mode and back out you should have the cookies for when you enter the source again but that is surprisingly odd since you managed to obtain page one. [x] open the chapter in webview and go down the chapter and accept the verification message that appears at the middle of the chapter. lasts for around 3-4 chapters before having to do it again. this is based on my download testing

Enrico-Fabbri commented 1 year ago

How should I try the dev build? (I'm a noob)

K1ngfish3r commented 1 year ago

login to github
Click on LNreader-r1 under artifacts
install apk on your device
lemme know if it works/is broken

Enrico-Fabbri commented 1 year ago

Ok so the thing is that now sometimes it works correctly and sometimes it doesn't.

As you can see sometimes it is unable to bypass cloudflare photo_1_2023-06-29_13-56-37

Sometimes it doesn't load the data photo_2_2023-06-29_13-56-37

And sometimes it is just stuck in this endless process photo_3_2023-06-29_13-56-37

K1ngfish3r commented 1 year ago

[x] due to current limitations of this app, you would most probably run into cloudflare blocking every 3 pages. You can refresh the cookie when that happens but the frequency of the blocking will remain this way unless @rajarsheechatterjee can look into it
[ ] very odd. most probably related to cloudflare but I'll try to replicate
[x] this is tough. Based on the current logic of the source we get the chapter list page by page. Each 100 chapters is a page and there is a delay of 1s between each time the app requests a new page so it depends on how fast your internet speed is and the number of pages the novel has so a novel can have a load time of 20-30s depending on how many chapters it has (infinite mana in the apocalypse has 2307 chapters and took around 35s for me, ymmv)

Enrico-Fabbri commented 1 year ago

Ah, I totally forgot this problem photo_2023-06-29_16-49-59

Anyway, the problem of the page not loading the data happens only when I try to open something like 2/3 novels at a time (I don't wait for the page to load and return right back).

Probably as you said it's my internet speed that is slow that is why the page get stuck on loading for quite some time (I'll just wait for a bit more and see if it happens again)

K1ngfish3r commented 1 year ago

here's another dev build for you https://github.com/K1ngfish3r/lnreader/actions/runs/5414497422 I tried cleaning up the selectors a bit if the novel decides to go unknown and double checked the search logic. After installing go to More -> Settings -> Advanced -> Clear all (5 options, read them before you use them) and try to search again.

Enrico-Fabbri commented 1 year ago

I cleared all the options as you mentioned. Ok so now the search works perfectly, but it still get stuck on the new novels (novels I don't have saved in my library) when I try to check their data... This time around I waited for two minutes before going back but it just got stuck on the loading of the novel data. I searched for this ln but it didn't load photo_2023-06-29_19-36-26

as you can see there (as I said I waited two minutes) photo_2023-06-29_19-36-22

K1ngfish3r commented 1 year ago

Okay I think I know what's happening. You're most likely getting cloudflare'd whilst the chapters are being loaded. (literally opening more than 5 pages if more than 500 chaps). I'll try looking into a partial load of chapters and seeing if that fixes things

LNReader / lnreader-plugins