search

stashapp / CommunityScrapers

This is a public repository containing scrapers created by the Stash Community.
https://stashapp.github.io/CommunityScrapers/
GNU Affero General Public License v3.0
651 stars 418 forks source link

Blacked.com not working #171

Closed thecat18 closed 4 years ago

thecat18 commented 4 years ago

Is the scraper not working or do i have rename the scene a certain way?

bnkai commented 4 years ago

Just tried and it works ( sample URL https://www.blacked.com/summer-dj-fling ). Have you setup CDP properly though ( settings -> configuration ) ? The specific scraper needs that.

thecat18 commented 4 years ago

Thanks but I'm not sure what I put in the settings the address of the scene is h##ps://www.blacked.com/perfect-blonde-with-2-monster-black-cocks Also how do I know which scrapers needs cdp. a little over my head. Also when adding a full movie is adultdvdempire.com is also a cdp? it wasn't working for me.

Belleyy commented 4 years ago

Thanks but I'm not sure what I put in the settings

You put the path to your chrome.exe (Google chrome executable) like C:\Users\Winter\AppData\Local\Chromium\Application\chrome.exe

Also how do I know which scrapers needs cdp. a little over my head.

In the scraper file, these line enable the CDP 

driver:
  useCDP: true

Also when adding a full movie is adultdvdempire.com is also a cdp? it wasn't working for me.

adultdvdempire scraper don't use CDP. Maybe you got a problem because it's a Movie scraper not a Scene scraper.

thecat18 commented 4 years ago

Well guess I am out of luck I use Firefox. Also adultdvdempire I was trying to use in the movie section because iafd didn't have enough info & no pics. If I want to use this better I guess I need chrome. https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/User-Agent/Firefox does this have to do with using stash in firefox with this blacked.com scraper to work. Is this what u put in settings- for windows 64-bit-Mozilla/5.0 (Windows NT x.y; Win64; x64; rv:10.0) Gecko/20100101 Firefox/10.0 just seems like this are old info in here. I looked up & changed it to this Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:80.0) Gecko/20100101 Firefox/80.0 but nothing. Also how i exit stash & get back in & don't have to put my info in again of where my files are located?

Belleyy commented 4 years ago

I also use mainly use Firefox, but i have other browser. For the User-Agent i use Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:79.0) Gecko/20100101 Firefox/79.0 Check the Logs - Debug to see what the scraper get. And you can write in the scraper (AdultEmpire.yml) these lines to get the exact HTML, it scrape

debug:
  printHTML: true
bnkai commented 4 years ago

@thecat18 as stated above blacked.com scrapers requires CDP and thus the use ( and configuration ) of a chromium based browser, the user agent isn't enough.

how i exit stash & get back in & don't have to put my info in again of where my files are located?

what do you mean? did you hit the save button after you completed the configuration changes ?

thecat18 commented 4 years ago

@thecat18 as stated above blacked.com scrapers requires CDP and thus the use ( and configuration ) of a chromium based browser, the user agent isn't enough.

how i exit stash & get back in & don't have to put my info in again of where my files are located?

what do you mean? did you hit the save button after you completed the configuration changes ?

Ok I was using the link in bookmarks that opened it on that page. Also can I use microsoft edge to make blacked.com work?

thecat18 commented 4 years ago

printHTML: true

debug says this for trying to add the blacked.com scene, but 1st I get the chrome error then this & after is the debug when I try to use adultdvdempire when adding a movie. I don't understand what this stuff means. 20-09-16 19:35:21Debug SQL: SELECT DISTINCT scenes.id FROM scenes left join scene_markers on scene_markers.scene_id = scenes.id left join performers_scenes as performers_join on performers_join.scene_id = scenes.id left join movies_scenes as movies_join on movies_join.scene_id = scenes.id left join studios as studio on studio.id = scenes.studio_id left join galleries as gallery on gallery.scene_id = scenes.id left join scenes_tags as tags_join on tags_join.scene_id = scenes.id GROUP BY scenes.id ORDER BY scenes.date ASC, bitrate DESC, framerate DESC, scenes.rating DESC, scenes.duration DESC LIMIT 40 OFFSET 0 , args: []

SQL: SELECT DISTINCT movies.id FROM movies left join movies_scenes as scenes_join on scenes_join.movie_id = movies.id left join scenes on scenes_join.scene_id = scenes.id left join studios as studio on studio.id = movies.studio_id GROUP BY movies.id ORDER BY movies.name COLLATE NOCASE ASC LIMIT 40 OFFSET 0 , args: []

thecat18 commented 4 years ago

I also use mainly use Firefox, but i have other browser. For the User-Agent i use Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:79.0) Gecko/20100101 Firefox/79.0 Check the Logs - Debug to see what the scraper get. And you can write in the scraper (AdultEmpire.yml) these lines to get the exact HTML, it scrape

debug:
  printHTML: true

Also it looks I got the user agent right but what is able to do since it seems like only chrome will work with blacked.com & probably others too/.

bnkai commented 4 years ago

Closing as the scraper is working.