search

dteviot / WebToEpub

A simple Chrome (and Firefox) Extension that converts Web Novels (and other web pages) into an EPUB.
Other
734 stars 139 forks source link

Cloudflare Always Triggers on HelheimScans with Firefox #1551

Closed dastrdly6585 closed 2 weeks ago

dastrdly6585 commented 1 month ago

Describe the bug Attempts to download any chapters from HelheimScans trigger a 403 error from Cloudflare. Can use 'Open URL for captcha' and verify as a human on the captcha, but Cloudflare immediately blocks on retry and the visited chapter still isn't successfully downloaded.

To Reproduce Steps to reproduce the behavior:

  1. Go to series page on HelheimScans (e.g., https://helheimscans.com/series/5d98787945a/)
  2. Open WebToEpub
  3. Choose any number of chapters
  4. Hit 'Pack Epub'
  5. Get error

Expected behavior Chapters should be downloaded with only the rare occasion of a Cloudflare block, which after going to the URL and solving the captcha, should fix the downloading for at least a while.

Screenshots N/A

Desktop (please complete the following information):

Smartphone (please complete the following information): N/A

Additional context

Elthara commented 1 month ago

I'm having exactly the same issue on Foxaholic trying to grab this: https://www.foxaholic.com/novel/little-love-song/.

Same version of windows and firefox involved.

gamebeaker commented 1 month ago

I am confused maybe someone can help in the network tab i can see that the cookie gets send with the request (normal site not WebToEpub) image than i go to the Storage tab and can't find "cf_clearance" image If i open WebToEpub i am also unable to get "cf_clearance" cookie for the site with browser.cookies.getAll({partitionKey: {}});

dteviot commented 1 month ago

@gamebeaker Have you considered trying the Storage Access API? https://developer.mozilla.org/en-US/docs/Web/Privacy/State_Partitioning#storage_access_api In particular, https://developer.mozilla.org/en-US/docs/Web/API/Document/requestStorageAccess

gamebeaker commented 3 weeks ago

@Battlespike1 @dastrdly6585 @Elthara is the bug still present with the new Firefox version 132.0?

dastrdly6585 commented 3 weeks ago

@gamebeaker Can confirm the bug still exists in Firefox version 132.0.

gamebeaker commented 3 weeks ago

@dastrdly6585 can you please try it with all other addons disabled?

dastrdly6585 commented 3 weeks ago

@gamebeaker Still getting the issue even with all other addons disabled besides WebToEpub.

dastrdly6585 commented 3 weeks ago

@gamebeaker Update, I seem to have fixed it by going into Firefox's settings and clearing out all website data for helheimscans.com.

Elthara commented 2 weeks ago

@Battlespike1 @dastrdly6585 @Elthara is the bug still present with the new Firefox version 132.0?

I just saw dastrdly's post and tried clearing out cookies for foxaholic and NOW it works fine. Before I did that it wasn't working; I tried both with and without extensions disabled.