dipu-bd / lightnovel-crawler

Generate and download e-books from online sources.
https://pypi.org/project/lightnovel-crawler/
GNU General Public License v3.0
1.52k stars 296 forks source link

foxaholic #1907

Open SirGryphin opened 1 year ago

SirGryphin commented 1 year ago

Novel URL: https://www.foxaholic.com/novel/the-yandere-that-came-during-the-night/ App Location: PIP App Version: 3.2.3

Does not work, tried making a new script using --bot lookup, and if fails with 403 Error: Forbidden Client, so I think it's being blocked by Cloudflare. Not sure if someone wants to double check before adding to the rejected list.

watzeedzad commented 1 year ago

Seem like they're using Cloudflare turnstile, latest version of cloudscraper seem to support turnstile but we will required 3rd party provider to solve the captcha.

watzeedzad commented 1 year ago

If I have free time this weekend I will try with capsolver provider to see that to is working or not.

watzeedzad commented 1 year ago

After checking debug log of cloudscraper, it appear that foxaholic return 403 error due to JavaScript and cookies not enable. `

`

Crawling using selenium might work.