mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.7k stars 953 forks source link

[Pornhub] extractor failing with "580/594 origin timeout" errors #6299

Closed serveral1 closed 2 weeks ago

serveral1 commented 2 weeks ago

They're failing at random spots but with the same error

gallery-dl https://www.pornhub.com/model/dyno-johnson/photos --verbose
[gallery-dl][debug] Version 1.27.6-dev
[gallery-dl][debug] Python 3.11.4 - Windows-10-10.0.19044-SP0
[gallery-dl][debug] requests 2.32.2 - urllib3 2.2.1
[gallery-dl][debug] Configuration Files ['%APPDATA%\\gallery-dl\\config.json']
[gallery-dl][debug] Starting DownloadJob for 'https://www.pornhub.com/model/dyno-johnson/photos'
[pornhub][debug] Using PornhubPhotosExtractor for 'https://www.pornhub.com/model/dyno-johnson/photos'
[pornhub][debug] Loading cookies from 'C:\Users\WEPS\.aria2\cookies.txt'
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.pornhub.com:443
[urllib3.connectionpool][debug] https://www.pornhub.com:443 "POST /model/dyno-johnson/photos/public/ajax?page=1 HTTP/1.1" 200 None
[pornhub][debug] Using PornhubGalleryExtractor for 'https://www.pornhub.com/album/70307741'
[pornhub][debug] Loading cookies from 'C:\Users\WEPS\.aria2\cookies.txt'
[urllib3.connectionpool][debug] https://www.pornhub.com:443 "GET /album/70307741 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.pornhub.com:443 "GET /album/show_album_json?album=70307741 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): ei.phncdn.com:443
[urllib3.connectionpool][debug] https://ei.phncdn.com:443 "GET /pics/albums/070/307/741/802451241/(m=e-yaaGqaq)(mh=azUu4UsYz43Cu8M7)original_802451241.jpg HTTP/1.1" 200 14404
.\gallery-dl\pornhub\Dyno Johnson\70307741 Fat Cock profile\001_802451241.jpg
[pornhub][debug] Using PornhubGalleryExtractor for 'https://www.pornhub.com/album/69606532'
[pornhub][debug] Loading cookies from 'C:\Users\WEPS\.aria2\cookies.txt'
[urllib3.connectionpool][debug] https://www.pornhub.com:443 "GET /album/69606532 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.pornhub.com:443 "GET /album/show_album_json?album=69606532 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://ei.phncdn.com:443 "GET /pics/albums/069/606/532/798165672/(m=lflGe-yaaGqaqdg)(mh=05SOFI81ZsTEJnx1)original_798165672.mp4 HTTP/1.1" 200 902649
.\gallery-dl\pornhub\Dyno Johnson\69606532 Must see album\001_798165672.mp4
[urllib3.connectionpool][debug] https://ei.phncdn.com:443 "GET /pics/albums/069/606/532/798165442/(m=lflGe-yaaGqaqdg)(mh=s-ljdfC8ijZ6Mwe9)original_798165442.mp4 HTTP/1.1" 200 263850
.\gallery-dl\pornhub\Dyno Johnson\69606532 Must see album\002_798165442.mp4
[urllib3.connectionpool][debug] https://ei.phncdn.com:443 "GET /pics/albums/069/606/532/798165642/(m=lflGe-yaaGqaqdg)(mh=se6jrx2VlBqQCj87)original_798165642.mp4 HTTP/1.1" 200 735055
.\gallery-dl\pornhub\Dyno Johnson\69606532 Must see album\003_798165642.mp4
[urllib3.connectionpool][debug] https://ei.phncdn.com:443 "GET /pics/albums/069/606/532/798165592/(m=lflGe-yaaGqaqdg)(mh=StniD-PnA9eY2Fsh)original_798165592.mp4 HTTP/1.1" 200 505054
.\gallery-dl\pornhub\Dyno Johnson\69606532 Must see album\004_798165592.mp4
[urllib3.connectionpool][debug] https://ei.phncdn.com:443 "GET /pics/albums/069/606/532/798165662/(m=lflGe-yaaGqaqdg)(mh=CgWrrdvAkEN4YBem)original_798165662.mp4 HTTP/1.1" 200 462464
.\gallery-dl\pornhub\Dyno Johnson\69606532 Must see album\005_798165662.mp4
[pornhub][error] An unexpected error occurred: KeyError - '798165622'. Please run gallery-dl again with the --verbose flag, copy its output and report this issue on https://github.com/mikf/gallery-dl/issues .
[pornhub][debug]
Traceback (most recent call last):
  File "C:\Users\WEPS\AppData\Local\Programs\Python\Python311\Lib\site-packages\gallery_dl\job.py", line 151, in run
    for msg in extractor:
  File "C:\Users\WEPS\AppData\Local\Programs\Python\Python311\Lib\site-packages\gallery_dl\extractor\pornhub.py", line 69, in items
    for num, image in enumerate(self.images(), 1):
  File "C:\Users\WEPS\AppData\Local\Programs\Python\Python311\Lib\site-packages\gallery_dl\extractor\pornhub.py", line 109, in images
    img = images[key]
          ~~~~~~^^^^^
KeyError: '798165622'
[pornhub][debug] Using PornhubGalleryExtractor for 'https://www.pornhub.com/album/65014832'
[pornhub][debug] Loading cookies from 'C:\Users\WEPS\.aria2\cookies.txt'
[urllib3.connectionpool][debug] https://www.pornhub.com:443 "GET /album/65014832 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.pornhub.com:443 "GET /album/show_album_json?album=65014832 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://ei.phncdn.com:443 "GET /pics/albums/065/014/832/753809472/(m=lflGe-yaaGqaqdg)(mh=cKMRIakWbhH_jiqJ)original_753809472.mp4 HTTP/1.1" 594 None
[downloader.http][warning] '594 Origin Time-out' for 'https://ei.phncdn.com/pics/albums/065/014/832/753809472/(m=lflGe-yaaGqaqdg)(mh=cKMRIakWbhH_jiqJ)original_753809472.mp4' (1/5)
[urllib3.connectionpool][debug] Starting new HTTPS connection (2): ei.phncdn.com:443

KeyboardInterrupt
mikf commented 2 weeks ago

This file doesn't load in browser either: https://www.pornhub.com/photo/753809472