stashapp / CommunityScrapers

This is a public repository containing scrapers created by the Stash Community.
https://stashapp.github.io/CommunityScrapers/
GNU Affero General Public License v3.0
654 stars 420 forks source link

Kink Scaper not working #2062

Open Thelayer8one opened 3 weeks ago

Thelayer8one commented 3 weeks ago

I am trying to scrape a scene Scraped with URL (tried with the following URL: https://www.kink.com/shoot/106298). I've also tried to scrape by name The Filename is: 106298_A Good Slut.mp4

grafik

The logs dont show any more informattions unfortuantly

feederbox826 commented 3 weeks ago

403 forbidden usually indicates that it's blocked by cloudflare or geoip

doublewelp commented 2 weeks ago

403 forbidden usually indicates that it's blocked by cloudflare or geoip

I've recently installed Stash and stumbled into this issue as well. I've been trying to diagnose it by making these changes to the Kink scraper yml file:

driver:
  headers:
    - Key: User-Agent
      Value: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.11 (KHTML, like Gecko) Chrome/23.0.1271.64 Safari/537.11
    - Key: Accept
      Value: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    - Key: Accept-Charset
      Value: ISO-8859-1,utf-8;q=0.7,*;q=0.3
    - Key: Accept-Encoding
      Value: none
    - Key: Accept-Language
      Value: en-US,en;q=0.8
    - Key: Connection
      Value: keep-alive
  cookies:
    - CookieURL: "https://www.kink.com"
      Cookies:
        - Name: "ct"
          Domain: "www.kink.com"
          Value: "2"
          Path: "/"
# Last Updated April 22, 2024
debug:
  printHTML: true

I believe these headers are the bare minimum to bypass Cloudflare - I can validate this with a successful wget from the same IP, so it's not a Cloudflare machine block.

But debug isn't really helping, nothing seems to get written to logs. Is there a log folder I can check?

feederbox826 commented 2 weeks ago

it's a streaming log, you need it open to see the logs, you can set up a log file as output under system

feederbox826 commented 7 hours ago

Mentioned in the discord, can't seem to get a bypass working. Looks like TLS fingerprinting