search

dteviot / WebToEpub

A simple Chrome (and Firefox) Extension that converts Web Novels (and other web pages) into an EPUB.
Other
740 stars 140 forks source link

ranobes not fetching all chapters #751

Closed SirGryphin closed 2 years ago

SirGryphin commented 2 years ago

Describe the bug It seems to only find 200 chapters and no more. Also it messing up cover image url and adds url twice like this https://ranobes.net/https://ranobes.net/uploads/posts/2021-03/1616079872_fey-evolution-merchant.jpg

To Reproduce

  1. Go to 'https://ranobes.net/novels/758070-fey-evolution-merchant-v149307.html'
  2. Click on WebtoEpub
  3. See only last 200 chapters.

Expected behavior Fetch all 1152 chapters.

Screenshots Screenshot 2022-06-02 001132

Desktop (please complete the following information):

Additional context I'm using version 0.0.0.149 on chrome store but I've also tried version 0.0.0.150 from google drive and both don't work.

Flwk commented 2 years ago

Yeah, i have the same problem and i use the last version of the gdrive :)

aelementj commented 2 years ago

Refresh the ranobes website and check if you've been detected as a bot. Ranobes has an anti-bot system and it gets triggered when 3 or more chapters are being fetched simultaneously. This just based on my experience and my recommendation is to lower your "Max web pages being fetched", from the default 8 to just 2. I never had problems making epubs on ranobes since.

dteviot commented 2 years ago

@SirGryphin @Flwk I just tried https://ranobes.net/novels/758070-fey-evolution-merchant-v149307.html, and it listed 1158 chapters. I'm going to assume that @aelementj is correct. I also spent some time checking WebToEpub code against return from site. All seems OK.

For my notes: 15 minutes work