search

mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.54k stars 946 forks source link

E-Hentai site error i7 #4733

Closed earthyrock closed 11 months ago

earthyrock commented 11 months ago

Hadn't touched e-hentai for a number of months but found myself needing to a couple nights ago. If the gallery link is to all pics, none will download. If a mixed collection of pics and gifs, gifs will download fine. If it is all gifs, they will ALL download fine.

I don't believe it's an issue of the Username/Password as I've created a new one, placed same in the gallery-dl.conf, and the issue persists.

I don't believe it's an issue of the IP as I've used TorGuard multiple times to pull different IPs.

Probably not related, but if there is anything to do w/ cookies, cache or tokens, I have not done anything regards these (ie. clearing/deleting/refreshing. Not even sure any of them apply as regards the e-hentai site, though I'm open to any information/configuration I should begin using in future to help resolve this issue.).

I run the command from batch file.

"C:\Users\AdminS6\gallery-dl\gallery-dl.exe" --dest "X:\12X\11Web\gallery-dl" "https://e-hentai.org/g/2719438/aae4b73254/"

It polls the gallery-dl.conf

{
    "postprocessor":
    {
        "gif to mp4":
        {
            "name": "exec",
            "async"  : false,
            "command": "\"G:\\00OSz\\12win10b zEnt-LTSC 1809 x64\\05Apps\\Multimedia\\Video\\Installed\\ffmpeg\\bin\\ffmpeg.exe\" -i {} {}.mp4 && del {}",
            "event"  : "after",
            "filter": "extension == 'gif'"
        }
    },

    "extractor":
    {

    "postprocessors": [
        {
            "name": "ugoira",
            "whitelist": ["pixiv", "danbooru"],
            "extension": "mp4",
            "keep-files": false,
            "ffmpeg-twopass": false,
            "ffmpeg-args": ["-hide_banner", "-loglevel", "quiet", "-c:v", "libx264", "-b:v", "2M", "-preset", "veryfast", "-pix_fmt", "yuv420p"],
            "ffmpeg-location": "G:\\00OSz\\12win10b zEnt-LTSC 1809 x64\\05Apps\\Multimedia\\Video\\Installed\\ffmpeg\\bin\\ffmpeg.exe"
        },

        {
            "name": "metadata",
            "whitelist": ["danbooru", "yandere", "sankaku"],
            "mode": "tags"
        }
    ],

        "deviantart":
        {
            "directory": ["{username}"],
            "filename": "{index} - {title}.{extension}",
            "extra": false,
            "client-id": "***",
            "client-secret": "***",
            "flat": true,
            "folders": false,
            "journals": "html",
            "mature": true,
            "metadata": false,
            "original": true,
            "quality": 100,
            "refresh-token": "cache",
            "wait-min": 0,
            "cookies": "C:\\Users\\AdminS6\\gallery-dl\\cookies.txt",
            "cookies-update": true
        },

        "exhentai":
        {
            "directory": ["e-hentai", "{title}"],
            "username": "***",
            "password": "***",
            "postprocessors": ["gif to mp4"],
            "filename": "{num:>04}_{name}.{extension}"
        },

        "instagram":
        {
            "directory": [],
            "username": "***",
            "password": "***",
            "wait-min": 0,
            "wait-max": 8,
            "videos": true
        },

    "oauth":
        {
            "browser": true,
            "cache": true,
            "port": 6414
        },

        "pixiv":
        {
            "directory": ["{user[name]} - {user[id]}"],
            "filename": "{filename} - {title} - {tags}.{extension}",
            "refresh-token": "cache",
            "avatar": false,
            "wait-min": 0,
            "wait-max": 0.2,
            "ugoira": true
        },

        "twitter":
        {
            "directory": [],
            "username": "***",
            "password": "***",
            "cards": false,
            "conversations": false,
            "pinned": false,
            "quoted": false,
            "replies": true,
            "retweets": false,
            "text-tweets": false,
            "twitpic": false,
            "users": "timeline",
            "videos": true
        },

    "downloader":
    {
        "part": true,
        "part-directory": null,

        "http":
        {
            "adjust-extensions": true,
            "mtime": true,
            "rate": null,
            "retries": 4,
            "timeout": 30.0,
            "verify": true
        },

        "ytdl":
        {
            "format": null,
            "forward-cookies": false,
            "mtime": true,
            "outtmpl": null,
            "rate": null,
            "retries": 4,
            "timeout": 30.0,
            "verify": true
        }
    },

    "output":
    {
        "mode": "auto",
        "progress": true,
        "shorten": true,
        "log": "[{name}][{levelname}] {message}",
        "logfile": null,
        "unsupportedfile": null
    },

    "netrc": false
}}

I get the following verbose output:

[gallery-dl][debug] Version 1.26.1 - Executable
[gallery-dl][debug] Python 3.8.10 - Windows-10-10.0.19044
[gallery-dl][debug] requests 2.31.0 - urllib3 1.26.17
[gallery-dl][debug] Configuration Files ['C:\\Users\\AdminS6\\gallery-dl\\gallery-dl.conf']
[gallery-dl][debug] Starting DownloadJob for 'https://e-hentai.org/g/2719438/aae4b73254/'
[exhentai][debug] Using ExhentaiGalleryExtractor for 'https://e-hentai.org/g/2719438/aae4b73254/'
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): e-hentai.org:443
[urllib3.connectionpool][debug] https://e-hentai.org:443 "GET /g/2719438/aae4b73254/ HTTP/1.1" 200 4283
[exhentai][debug] Sleeping 5.00 seconds (request)
[urllib3.connectionpool][debug] https://e-hentai.org:443 "GET /s/70252bb84d/2719438-1/2719438-1 HTTP/1.1" 200 1555
[exhentai][debug] Active postprocessor modules: [ExecPP]
[urllib3.connectionpool][debug] https://e-hentai.org:443 "GET /fullimg.php?gid=2719438&page=1&key=nsy9ib6a41b HTTP/1.1" 302 3
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): gwztiop.peqynhkbfvep.hath.network:12358
[downloader.http][warning] HTTPSConnectionPool(host='gwztiop.peqynhkbfvep.hath.network', port=12358): Max retries exceeded with url: /h/70252bb84de2fee120ff05489faaeb1812e594e2-1406864-2400-2000-jpg/keystamp=1698450300-e8a5229993;fileindex=135976717;xres=org/01.jpg (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x0483B2B0>: Failed to establish a new connection: [WinError 10013] An attempt was made to access a socket in a way forbidden by its access permissions')) (1/5)
[urllib3.connectionpool][debug] https://e-hentai.org:443 "GET /fullimg.php?gid=2719438&page=1&key=nsy9ib6a41b HTTP/1.1" 302 3
[urllib3.connectionpool][debug] Starting new HTTPS connection (2): gwztiop.peqynhkbfvep.hath.network:12358
[downloader.http][warning] HTTPSConnectionPool(host='gwztiop.peqynhkbfvep.hath.network', port=12358): Max retries exceeded with url: /h/70252bb84de2fee120ff05489faaeb1812e594e2-1406864-2400-2000-jpg/keystamp=1698450300-e8a5229993;fileindex=135976717;xres=org/01.jpg (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x0483B760>: Failed to establish a new connection: [WinError 10013] An attempt was made to access a socket in a way forbidden by its access permissions')) (2/5)
[urllib3.connectionpool][debug] https://e-hentai.org:443 "GET /fullimg.php?gid=2719438&page=1&key=nsy9ib6a41b HTTP/1.1" 302 3
[urllib3.connectionpool][debug] Starting new HTTPS connection (3): gwztiop.peqynhkbfvep.hath.network:12358
[downloader.http][warning] HTTPSConnectionPool(host='gwztiop.peqynhkbfvep.hath.network', port=12358): Max retries exceeded with url: /h/70252bb84de2fee120ff05489faaeb1812e594e2-1406864-2400-2000-jpg/keystamp=1698450300-e8a5229993;fileindex=135976717;xres=org/01.jpg (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x0483BBF8>: Failed to establish a new connection: [WinError 10013] An attempt was made to access a socket in a way forbidden by its access permissions')) (3/5)
[urllib3.connectionpool][debug] https://e-hentai.org:443 "GET /fullimg.php?gid=2719438&page=1&key=nsy9ib6a41b HTTP/1.1" 302 3
[urllib3.connectionpool][debug] Starting new HTTPS connection (4): gwztiop.peqynhkbfvep.hath.network:12358
[downloader.http][warning] HTTPSConnectionPool(host='gwztiop.peqynhkbfvep.hath.network', port=12358): Max retries exceeded with url: /h/70252bb84de2fee120ff05489faaeb1812e594e2-1406864-2400-2000-jpg/keystamp=1698450300-e8a5229993;fileindex=135976717;xres=org/01.jpg (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x04D1C0B8>: Failed to establish a new connection: [WinError 10013] An attempt was made to access a socket in a way forbidden by its access permissions')) (4/5)
[urllib3.connectionpool][debug] https://e-hentai.org:443 "GET /fullimg.php?gid=2719438&page=1&key=nsy9ib6a41b HTTP/1.1" 302 3
[urllib3.connectionpool][debug] Starting new HTTPS connection (5): gwztiop.peqynhkbfvep.hath.network:12358
[downloader.http][warning] HTTPSConnectionPool(host='gwztiop.peqynhkbfvep.hath.network', port=12358): Max retries exceeded with url: /h/70252bb84de2fee120ff05489faaeb1812e594e2-1406864-2400-2000-jpg/keystamp=1698450300-e8a5229993;fileindex=135976717;xres=org/01.jpg (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x04689FE8>: Failed to establish a new connection: [WinError 10013] An attempt was made to access a socket in a way forbidden by its access permissions')) (5/5)
[download][error] Failed to download 0001_None.jpg
[urllib3.connectionpool][debug] https://e-hentai.org:443 "POST /api.php HTTP/1.1" 200 911
[exhentai][error] An unexpected error occurred: KeyError - 'i7'. Please run gallery-dl again with the --verbose flag, copy its output and report this issue on https://github.com/mikf/gallery-dl/issues .
[exhentai][debug]
Traceback (most recent call last):
  File "gallery_dl\job.pyc", line 124, in run
  File "gallery_dl\extractor\exhentai.pyc", line 175, in items
  File "gallery_dl\extractor\exhentai.pyc", line 310, in images_from_api
KeyError: 'i7'
Hrxn commented 11 months ago

Duplicate of #4730

CatPlanet commented 11 months ago

@earthyrock my brother in Christ, you included your usernames and passwords in pasted config

CatPlanet commented 11 months ago

@earthyrock by the way, if you didn't know this: you can see past edit changes in github history so change your password EVERYWHERE. Better now than later, cheers!

mikf commented 11 months ago

you can see past edit changes in github history

I've deleted them all except for the current revision, where everything is replaced with ***. Still, changing your credentials is highly recommended.

CatPlanet commented 11 months ago

Still, changing your credentials is highly recommended.

I agree. 13 hours of credentials being on public github is usually 13 more than enough, just pray bots are not monitoring these /issues or are unable to comprehend this kind of json.