dipu-bd / lightnovel-crawler

Generate and download e-books from online sources.
https://pypi.org/project/lightnovel-crawler/
GNU General Public License v3.0
1.48k stars 292 forks source link

Can't crawl Royalroad #1911

Open MineAnPlay opened 1 year ago

MineAnPlay commented 1 year ago

I have searched the latest issues and did not find a similar issue with the current up-to-date version.

Novel URL: www.royalroad.com App Location: PIP App Version: v3.2.3

Describe this issue

The current available source file for royalroad does not work with the current royalroad site. Most likely Royal Road has changed how they format there site.

image

Update line 36 as below: self.novel_title = soup.find("h1", {"property": "name"}).text.strip() To: self.novel_title = soup.find("h1").text.strip() as the h1 no longer has the "property" attribute.

Update line 44 as below: self.novel_author = soup.find("span", {"property": "name"}).text.strip() To: self.novel_author = soup.find("h4").findChildren("a", recursive=True)[0].text.strip() as author is found in h4 under grandchild "a".

taintedvalor commented 1 year ago

I have the same problem.

dipu-bd commented 1 year ago

1914 #1904

PolarisFx commented 1 year ago

image

I'm guessing they're still changing things.

thevoidwatches commented 1 year ago

I've been able to use Calibre with Flagfic to download from Royalroad, as an alternative.

PolarisFx commented 1 year ago

I've been using web2epub. But you can't beat the way lncrawl outputs epubs. It's simply perfect.