stashapp / CommunityScrapers

This is a public repository containing scrapers created by the Stash Community.
https://stashapp.github.io/CommunityScrapers/
GNU Affero General Public License v3.0
666 stars 429 forks source link

House of Gord scraper returns 403 #634

Closed quirkyjoe closed 3 years ago

quirkyjoe commented 3 years ago

Attempting to use the House of Gord scraper returns a 403 error in the error popup.

Example URL: https://www.houseofgord.com/d/another-naked-pussy-walker

Result:

Error
http error 403:Forbidden
JaseNZC commented 3 years ago

Attempting to use the House of Gord scraper returns a 403 error in the error popup.

Example URL: https://www.houseofgord.com/d/another-naked-pussy-walker

Result:

Error
http error 403:Forbidden

I have created a Pull Request for it here if you wanted to try it. #635

quirkyjoe commented 3 years ago

After replacing my current yml file and restarting Stash, trying to scrape yields the following:

image

Error

exec: "google-chrome": executable file not found in $PATH

I don't think this is on my end, because I have successfully used other scrapers on the two machines I tested the fix on. (?)

Thank you very much for your time! If I can provide any further info, let me know.

JaseNZC commented 3 years ago

You need to have CDP enabled for the updated yml to work :-)

Under Settings->Configuration you will see the setting to populate.

The one here is my setup as I use docker so yours will be different depending on what operating system you are using for stash. Ie say for windows would be something like. c:\Program Files\Google\Chrome\Application\chrome.exe

Screen Shot 2021-07-09 at 3 38 27 PM
Ruthalas commented 3 years ago

I'm also running Stash in a docker, would you mind pointing me at the chrome docker you're using?

JaseNZC commented 3 years ago

command for installing headless chrome docker instance is, this is just done via terminal. docker run --restart=always -d -p 9222:9222 --name headless-shell --shm-size 2G chromedp/headless-shell

quirkyjoe commented 3 years ago

That worked great, looks good!

Thank you for the guidance on the CDP path setting as well.

bnkai commented 3 years ago

closing this as #635 was merged