search

pierre-delecto / stash_theporndb_scraper

A python script to scrape Stash data from thePornDB
MIT License
50 stars 31 forks source link

Cannot run the script #19

Open overloadedStasher opened 3 years ago

overloadedStasher commented 3 years ago

Hi, I've been trying to run the script with stash V0.60:development, and i'm hitting a major roadblock. I always get this error, but it's pretty vague and I have no idea where to start to fix it. I'm trying a test run with 6 scenes that have the tag test :

python3 scrapeScenes.py -t test DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.1.20:9999 DEBUG:urllib3.connectionpool:http://10.0.1.20:9999 "GET /playground HTTP/1.1" 302 53 DEBUG:urllib3.connectionpool:http://10.0.1.20:9999 "GET /login?returnURL=%2Fplayground HTTP/1.1" 200 1387 DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.1.20:9999 DEBUG:urllib3.connectionpool:http://10.0.1.20:9999 "POST /login HTTP/1.1" 302 0 DEBUG:urllib3.connectionpool:http://10.0.1.20:9999 "GET / HTTP/1.1" 200 None DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.1.20:9999 DEBUG:urllib3.connectionpool:http://10.0.1.20:9999 "POST /graphql HTTP/1.1" 200 101 DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.1.20:9999 DEBUG:urllib3.connectionpool:http://10.0.1.20:9999 "POST /graphql HTTP/1.1" 200 None DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.1.20:9999 DEBUG:urllib3.connectionpool:http://10.0.1.20:9999 "POST /graphql HTTP/1.1" 200 None DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.1.20:9999 DEBUG:urllib3.connectionpool:http://10.0.1.20:9999 "POST /graphql HTTP/1.1" 200 None DEBUG:root:Getting tag id for tag 'ThePornDB Ambiguous'. DEBUG:root:Found the tag. ID is 353 DEBUG:root:Getting tag id for tag 'Scraped From ThePornDB'. DEBUG:root:Found the tag. ID is 351 DEBUG:root:Getting tag id for tag 'Missing From ThePornDB'. DEBUG:root:Found the tag. ID is 352 DEBUG:root:Getting tag id for tag 'ThePornDB Unconfirmed Alias'. DEBUG:root:Found the tag. ID is 354 DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.1.20:9999 DEBUG:urllib3.connectionpool:http://10.0.1.20:9999 "POST /graphql HTTP/1.1" 200 84 DEBUG:root:Getting tag id for tag 'test'. DEBUG:root:Found the tag. ID is 355 Getting Scenes With Required Tags DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.1.20:9999 DEBUG:urllib3.connectionpool:http://10.0.1.20:9999 "POST /graphql HTTP/1.1" 422 191 ERROR:root:GraphQL query failed to run by returning code of 422. Query: query($filter:FindFilterType!, $scene_filter:SceneFilterType!){findScenes(filter:$filter, scene_filter:$scene_filter){ count scenes{ id title oshash details url date rating path studio { id name } gallery { id } movies { movie { id } scene_index } performers { name id } tags { name id } } } } . Variables: {'filter': {'q': '', 'sort': 'created_at', 'direction': 'DESC', 'page': 1, 'per_page': 100}, 'scene_filter': {'tags': {'modifier': 'INCLUDES', 'value': ['355']}}} ERROR:root:Unexpected error getting stash scene: DEBUG:root:Getting tag id for tag 'Missing From ThePornDB'. DEBUG:root:Found the tag. ID is 352 DEBUG:root:Getting tag id for tag 'Scraped From ThePornDB'. DEBUG:root:Found the tag. ID is 351 Getting Scenes Without Excluded Tags DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.1.20:9999 DEBUG:urllib3.connectionpool:http://10.0.1.20:9999 "POST /graphql HTTP/1.1" 422 191 ERROR:root:GraphQL query failed to run by returning code of 422. Query: query($filter:FindFilterType!, $scene_filter:SceneFilterType!){findScenes(filter:$filter, scene_filter:$scene_filter){ count scenes{ id title oshash details url date rating path studio { id name } gallery { id } movies { movie { id } scene_index } performers { name id } tags { name id } } } } . Variables: {'filter': {'q': '', 'sort': 'created_at', 'direction': 'DESC', 'page': 1, 'per_page': 100}, 'scene_filter': {'tags': {'modifier': 'EXCLUDES', 'value': ['352', '351']}}} ERROR:root:Unexpected error getting stash scene: Success! Finished.

Thank you!

madejackson commented 2 years ago

Edit: Nevermind, it works with this more recent fork: https://github.com/ThePornDatabase/stash_theporndb_scraper

Same issue by me (on Unraid):

`DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.62.74:9999 DEBUG:urllib3.connectionpool:http://10.0.62.74:9999 "GET /playground HTTP/1.1" 200 868 DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.62.74:9999 DEBUG:urllib3.connectionpool:http://10.0.62.74:9999 "POST /graphql HTTP/1.1" 200 90 DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.62.74:9999 DEBUG:urllib3.connectionpool:http://10.0.62.74:9999 "POST /graphql HTTP/1.1" 200 None DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.62.74:9999 DEBUG:urllib3.connectionpool:http://10.0.62.74:9999 "POST /graphql HTTP/1.1" 200 None DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.62.74:9999 DEBUG:urllib3.connectionpool:http://10.0.62.74:9999 "POST /graphql HTTP/1.1" 200 None DEBUG:root:Getting tag id for tag 'ThePornDB Ambiguous'. DEBUG:root:Found the tag. ID is 274 DEBUG:root:Getting tag id for tag 'Scraped From ThePornDB'. DEBUG:root:Found the tag. ID is 275 DEBUG:root:Getting tag id for tag 'Missing From ThePornDB'. DEBUG:root:Found the tag. ID is 276 DEBUG:root:Getting tag id for tag 'ThePornDB Unconfirmed Alias'. DEBUG:root:Found the tag. ID is 277 DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 10.0.62.74:9999 DEBUG:urllib3.connectionpool:http://10.0.62.74:9999 "POST /graphql HTTP/1.1" 422 207 ERROR:root:GraphQL query failed to run by returning code of 422. Query: { jobStatus{ progress status message } } . Variables: None ERROR:root:Something went wrong. Have you: • Checked to make sure you're running the "development" branch of Stash, not "latest"? • Checked that you can connect to Stash at the same IP and port listed in your configuration.py? If you've check both of these, run the script again with the --debug flag. Then post the output of that in the Discord and hopefully someone can help.

Traceback (most recent call last): File "/mnt/user/Martin/stash_theporndb_scraper/scrapeScenes.py", line 933, in main my_stash.waitForIdle() #Wait for Stash to idle before scraping File "/mnt/user/Martin/stash_theporndb_scraper/StashInterface.py", line 152, in waitForIdle jobStatus = self.getStatus() File "/mnt/user/Martin/stash_theporndb_scraper/StashInterface.py", line 168, in getStatus result = self.callGraphQL(query) File "/mnt/user/Martin/stash_theporndb_scraper/StashInterface.py", line 111, in callGraphQL return self.callGraphQL(query, variables) File "/mnt/user/Martin/stash_theporndb_scraper/StashInterface.py", line 140, in callGraphQL raise Exception("GraphQL error") Exception: GraphQL error`