search

dipu-bd / lightnovel-crawler

Generate and download e-books from online sources.
https://pypi.org/project/lightnovel-crawler/
GNU General Public License v3.0
1.37k stars 267 forks source link

i am trying to fetch novel from lightnovelpub and lightnovelworld #2373

Closed baqirNemer closed 1 week ago

baqirNemer commented 2 months ago
Screenshot 2024-05-12 at 05 04 46

each time error -9 occurs I am chrome opens automatically and the download stops meta.json and I get this JSON file in the directory where the novel is supposed to be downloaded

jango1985 commented 1 month ago

I just tried to download a novel from lightnovelworld and it downloaded a little then had a cloudfare captcha in chromium browser it opened. I clicked the checkbox manually and it would download about 16 or so chapters before asking again then I got the bright idea to look for a free captcha solver extension and load it into the lncrawler chromium. I found this https://github.com/NopeCHALLC/nopecha-extension and loaded it into the browser in developer mode. Now it auto clicks the verify your human checkbox for me. Not sure if this will have to be redone next time lncrawler tries to download another book through chromium but even it does still more easier than constantly clicking the captcha box myself.

dipu-bd commented 1 week ago

@baqirNemer closing this since crawler can not solve captcha automatically