dipu-bd / lightnovel-crawler

Generate and download e-books from online sources.
https://pypi.org/project/lightnovel-crawler/
GNU General Public License v3.0
1.43k stars 279 forks source link

https://wuxiaworld.eu #2224

Closed chiffonkla closed 6 months ago

chiffonkla commented 8 months ago
camp00000 commented 7 months ago

The website redirects to https://wuxia.click/ which is already a supported source (and I tested it, seems to work just fine).

https://github.com/dipu-bd/lightnovel-crawler/blob/master/sources/en/w/wuxiaclick.py

@dipu-bd close this issue?

chiffonkla commented 7 months ago

The website redirects to https://wuxia.click/ which is already a supported source (and I tested it, seems to work just fine).

https://github.com/dipu-bd/lightnovel-crawler/blob/master/sources/en/w/wuxiaclick.py

@dipu-bd close this issue?

It said that it did not recognize the site https://www.wuxia.click or the Error: ('Fail to init crawler: %s is rejected', 'https://wuxia.click/') for https://wuxia.click/

Discord bot could not find novels from there too.

camp00000 commented 6 months ago

The website redirects to https://wuxia.click/ which is already a supported source (and I tested it, seems to work just fine).

https://github.com/dipu-bd/lightnovel-crawler/blob/master/sources/en/w/wuxiaclick.py

@dipu-bd close this issue?

It said that it did not recognize the site https://www.wuxia.click or the Error: ('Fail to init crawler: %s is rejected', 'https://wuxia.click/') for https://wuxia.click/

Discord bot could not find novels from there too.

@chiffonkla sorry for the slow reply but yes, the www.wuxia.click domain was not supported, only the wuxia.click domain. I've remedied this in #2265 .

It seems the reason why the bot refuses to download from there is because the wuxia.click domain is in the rejected sources list (see https://github.com/dipu-bd/lightnovel-crawler?tab=readme-ov-file#rejected-sources ). It was added to that list back in August of 2023, I will look into this.

Until it's removed from that list it seems the only way to download from there is to run the crawler locally on your own pc. Keep an eye on #2265 for any updates.

dipu-bd commented 6 months ago

2085