search

mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
10.68k stars 881 forks source link

gallery-dl exited with code 4 (reddit extractor) #5678

Open kriss6557 opened 3 weeks ago

kriss6557 commented 3 weeks ago

Hi, I'm using gallery-dl in a docker container. (CMD gallery-dl -v -c /etc/gallery-dl.conf ${URL}) I use it with pinterest without issue. When working with reddit, it does work for a while then exists with: gallery-dl exited with code 4 Always after the same image. It I run the same container again (without docker system prune), I get: gallery-dl exited with code 5 Here is my config file:

{
    "extractor": {
        "reddit": {
            "video": true,
            "comments": false,
            "client-id": "XXXXXXXXXXXXXXX",
            "user-agent": "Python:gallery-dl_installedapp:v1.0 (by /u/username)",
            "refresh-token": "XXXXXXXXXXXXXXX"
        }
    },
    "output": {
        "mode": "auto",
        "path": "/gallery-dl",
        "progress": true
    },
    "downloader": {
        "http": {
            "rate": "100k",
            "timeout": 30,
            "retries": 4,
            "verify": true
        }
    }
}

Any idea why I get this and how to fix it? Thank you for helping.

mikf commented 3 weeks ago

Exit code 4 means that one or more file downloads failed during gallery-dl's runtime. Exit code 1 means that one or more unspecified errors happened during gallery-dl's runtime. Exit code 5 is code 4 + 1 combined.

Check the error log to find out specifics (e.g. --write-log), but I couldn't tell you how to properly use this with Docker and make the log available outside the container afterwards.

kriss6557 commented 3 weeks ago

Hi, here is the log (skipping the authentication output):

[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/i6bqcqr80c3d1
[downloader.ytdl][debug] [generic] i6bqcqr80c3d1: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/sketches/comments/1d37rg6/some_sketches/?rdt=38314
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/sketches/comments/1d37rg6/some_sketches/?rdt=38314
[downloader.ytdl][debug] [Reddit] 1d37rg6: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] 1d37rg6: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] 1d37rg6: Downloading MPD manifest
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/771wc5whwpxc1
[downloader.ytdl][debug] [generic] 771wc5whwpxc1: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/sketches/comments/1ch9sfl/my_sketchbook_is_full_and_these_are_some_of_my/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/sketches/comments/1ch9sfl/my_sketchbook_is_full_and_these_are_some_of_my/
[downloader.ytdl][debug] [Reddit] 1ch9sfl: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] 1ch9sfl: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] 1ch9sfl: Downloading MPD manifest
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/ssnuz30i6oqc1
[downloader.ytdl][debug] [generic] ssnuz30i6oqc1: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/dioramas/comments/1bo8r0z/how_to_roll_out_terrain_and_tiles/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/dioramas/comments/1bo8r0z/how_to_roll_out_terrain_and_tiles/
[downloader.ytdl][debug] [Reddit] 1bo8r0z: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] 1bo8r0z: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] 1bo8r0z: Downloading MPD manifest
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/n14o97kc8cnc1
[downloader.ytdl][debug] [generic] n14o97kc8cnc1: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/Sculpture/comments/1bam1y8/self_my_latest_head_sculpt/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/Sculpture/comments/1bam1y8/self_my_latest_head_sculpt/
[downloader.ytdl][debug] [Reddit] 1bam1y8: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] 1bam1y8: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] 1bam1y8: Downloading MPD manifest
[imgur][debug] Using ImgurImageExtractor for 'https://i.imgur.com/zt7vT1A.png'
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/8d1qzvf2x9ec1
[downloader.ytdl][debug] [generic] 8d1qzvf2x9ec1: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/sketches/comments/19e2a16/hi_party_people_can_i_please_get_your_opinion_on/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/sketches/comments/19e2a16/hi_party_people_can_i_please_get_your_opinion_on/
[downloader.ytdl][debug] [Reddit] 19e2a16: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] 19e2a16: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] 19e2a16: Downloading MPD manifest
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/ormmvqi1cftb1
[downloader.ytdl][debug] [generic] ormmvqi1cftb1: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/sketches/comments/174tax2/_/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/sketches/comments/174tax2/_/
[downloader.ytdl][debug] [Reddit] 174tax2: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] 174tax2: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] 174tax2: Downloading MPD manifest
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/m3h1mu0csnqa1
[downloader.ytdl][debug] [generic] m3h1mu0csnqa1: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/dioramas/comments/125kc5t/how_to_make_some_highly_detailed_ruins/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/dioramas/comments/125kc5t/how_to_make_some_highly_detailed_ruins/
[downloader.ytdl][debug] [Reddit] 125kc5t: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] 125kc5t: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] 125kc5t: Downloading MPD manifest
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/xybqsb6jbam91
[downloader.ytdl][debug] [generic] xybqsb6jbam91: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/homelab/comments/x7ih1f/plex_jellyfin_sonarr_radarr_transmission_and_more/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/homelab/comments/x7ih1f/plex_jellyfin_sonarr_radarr_transmission_and_more/
[downloader.ytdl][debug] [Reddit] x7ih1f: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] x7ih1f: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] x7ih1f: Downloading MPD manifest
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/wl79k0pyy5g91
[downloader.ytdl][debug] [generic] wl79k0pyy5g91: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/RemarkableTablet/comments/whz96l/remarkable_highlights/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/RemarkableTablet/comments/whz96l/remarkable_highlights/
[downloader.ytdl][debug] [Reddit] whz96l: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] whz96l: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] whz96l: Downloading MPD manifest
[imgur][debug] Using ImgurImageExtractor for 'https://i.imgur.com/gKhNtuf.png'
[imgur][debug] Using ImgurImageExtractor for 'https://i.imgur.com/OxM0jgI.png'
[imgur][debug] Using ImgurImageExtractor for 'https://i.imgur.com/HkKFheF.jpg'
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/lhav7180ax961
[downloader.ytdl][debug] [generic] lhav7180ax961: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/Sculpture/comments/ksem0c/self_hello_new_to_sculpting_looking_for_friends/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/Sculpture/comments/ksem0c/self_hello_new_to_sculpting_looking_for_friends/
[downloader.ytdl][debug] [Reddit] ksem0c: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] ksem0c: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] ksem0c: Downloading MPD manifest
[imgur][debug] Using ImgurImageExtractor for 'https://i.imgur.com/LS7jXs1.png'
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/9bt0ztl55bo61
[downloader.ytdl][debug] [generic] 9bt0ztl55bo61: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/nextfuckinglevel/comments/m9o90l/making_an_epoxy_ocean_table/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/nextfuckinglevel/comments/m9o90l/making_an_epoxy_ocean_table/
[downloader.ytdl][debug] [Reddit] m9o90l: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] m9o90l: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] m9o90l: Downloading MPD manifest
[imgur][debug] Using ImgurImageExtractor for 'https://i.imgur.com/B6yvgkw.jpg'
[imgur][debug] Using ImgurImageExtractor for 'https://i.imgur.com/KAgj0zb.jpg'
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/il7u7hwjhmj61
[downloader.ytdl][debug] [generic] il7u7hwjhmj61: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/TerrainBuilding/comments/ls6a5x/goblin_grotto_cavern_combining_for_3d_printing_in/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/TerrainBuilding/comments/ls6a5x/goblin_grotto_cavern_combining_for_3d_printing_in/
[downloader.ytdl][debug] [Reddit] ls6a5x: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] ls6a5x: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] ls6a5x: Downloading MPD manifest
[imgur][debug] Using ImgurImageExtractor for 'https://i.imgur.com/BU1cF1c.jpg'
[imgur][debug] Using ImgurImageExtractor for 'https://i.imgur.com/we7SaI8.jpg'
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/fil02axreff61
[downloader.ytdl][debug] [generic] fil02axreff61: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/DnDIY/comments/lcc5r1/im_not_a_huge_fan_of_roads_on_top_of_terrain_so_i/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/DnDIY/comments/lcc5r1/im_not_a_huge_fan_of_roads_on_top_of_terrain_so_i/
[downloader.ytdl][debug] [Reddit] lcc5r1: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] lcc5r1: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] lcc5r1: Downloading MPD manifest
[imgur][debug] Using ImgurImageExtractor for 'https://i.imgur.com/T1PTPPd.jpg'
[reddit][debug] Sleeping 0.59 seconds (request)
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/bswxpd62xad61
[downloader.ytdl][debug] [generic] bswxpd62xad61: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/nextfuckinglevel/comments/l41rt4/this_handmade_miniature_sign/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/nextfuckinglevel/comments/l41rt4/this_handmade_miniature_sign/
[downloader.ytdl][debug] [Reddit] l41rt4: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] l41rt4: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] l41rt4: Downloading MPD manifest
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/css65lxkz6d61
[downloader.ytdl][debug] [generic] css65lxkz6d61: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/Sculpture/comments/l3qlrg/big_belly_boy_is_almost_complete_self/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/Sculpture/comments/l3qlrg/big_belly_boy_is_almost_complete_self/
[downloader.ytdl][debug] [Reddit] l3qlrg: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] l3qlrg: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] l3qlrg: Downloading MPD manifest
[imgur][debug] Using ImgurImageExtractor for 'https://i.imgur.com/cHTtfDv.jpg'
[redgifs][debug] Using RedgifsImageExtractor for 'https://gfycat.com/illiterateultimateamericancicada'
[redgifs][error] HttpError: '404 Not Found' for 'https://api.redgifs.com/v2/gifs/illiterateultimateamericancicada'
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/h35au2kvi9a61
[downloader.ytdl][debug] [generic] h35au2kvi9a61: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/Sculpture/comments/ktmrui/this_poor_body_shamed_big_boy_needs_a_new_body/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/Sculpture/comments/ktmrui/this_poor_body_shamed_big_boy_needs_a_new_body/
[downloader.ytdl][debug] [Reddit] ktmrui: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] ktmrui: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] ktmrui: Downloading MPD manifest
[imgur][debug] Using ImgurImageExtractor for 'https://i.imgur.com/KOIFAIK.jpg'
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/znc4qy7qee661
[downloader.ytdl][debug] [generic] znc4qy7qee661: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/Workbenches/comments/kh14w9/first_bench_build_complete_always_thought_these/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/Workbenches/comments/kh14w9/first_bench_build_complete_always_thought_these/
[downloader.ytdl][debug] [Reddit] kh14w9: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] kh14w9: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] kh14w9: Downloading MPD manifest
[imgur][debug] Using ImgurImageExtractor for 'https://i.imgur.com/JTaAplK.jpg'
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/x16m9ktq0u561
[downloader.ytdl][debug] [generic] x16m9ktq0u561: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/DnDIY/comments/kf90y0/a_simpler_and_faster_virtual_tabletop/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/DnDIY/comments/kf90y0/a_simpler_and_faster_virtual_tabletop/
[downloader.ytdl][debug] [Reddit] kf90y0: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] kf90y0: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] kf90y0: Downloading MPD manifest
[downloader.ytdl][debug] [generic] Extracting URL: https://v.redd.it/f4lsjqj3yh561
[downloader.ytdl][debug] [generic] f4lsjqj3yh561: Downloading webpage
[downloader.ytdl][debug] [redirect] Following redirect to https://www.reddit.com/r/sketches/comments/ke4coc/sketching_a_character_for_our_game_timelapse/
[downloader.ytdl][debug] [Reddit] Extracting URL: https://www.reddit.com/r/sketches/comments/ke4coc/sketching_a_character_for_our_game_timelapse/
[downloader.ytdl][debug] [Reddit] ke4coc: Downloading JSON metadata
[downloader.ytdl][debug] [Reddit] ke4coc: Downloading m3u8 information
[downloader.ytdl][debug] [Reddit] ke4coc: Downloading MPD manifest
[imgur][debug] Using ImgurImageExtractor for 'https://imgur.com/llJ186o.jpg'
[imgur][debug] Using ImgurAlbumExtractor for 'http://imgur.com/a/foBFmfc'
[twitter][debug] Using TwitterTweetExtractor for 'https://twitter.com/othermaciej/status/1293806712537804800'
[twitter][info] Requesting guest token
[twitter][info] No results for https://twitter.com/othermaciej/status/1293806712537804800