mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.34k stars 923 forks source link

[kemono.party] extractor doesn't automatically creates directory and fails #2576

Closed Gigas002 closed 2 years ago

Gigas002 commented 2 years ago

Running the command: gallery-dl "https://kemono.party/fantia/user/493" (link content NSFW)

Result: 100% 2.52MB 191.63kB/s kemonoparty: Unable to download data: FileNotFoundError: [Errno 2] No such file or directory: '/home/username/gallery-dl/kemonoparty/fantia/493/1235606_2022年GW新刊『ひなのちゃんちの事情』一部先行公開_01_ひなのちゃんちの事情_特典用16-20.zip'

When directory (~/gallery-dl/kemonoparty/fantia/493) created manually, download successful.

BTW, is there a way to extract from kemono to custom path? Tried following config:

            "directory": ["{artist}", "{user[name]} ({user[id]})"],
            "filename": "{filename} - {title}.{extension}",
            "metadata": true

but it doesn't see any metadata from kemono, e.g. path: /home/username/gallery-dl/None/None (None)/c03a9d7e-619d-4d1f-8da5-3903678690f8 - 人間は変わったコミュニケーションをするッピね(カラー版).jpg

Gigas002 commented 2 years ago

Same error with directory occurs for pixiv and exhentai. Tried selecting custom path with -D option, but it still fails to create directory. twitter extractor works well for both custom and default path with or without folder existing.

kattjevfel commented 2 years ago

Related to 99cb28724f7576aa49a3e8313bf12c8ae19c16ff perhaps?

mikf commented 2 years ago

Related to 99cb287 perhaps?

That and using part-directory

mikf commented 2 years ago
        "directory": ["{artist}", "{user[name]} ({user[id]})"],

None of these fields are defined. kemono only has user, and username with metadata enabled. Use -K to get an overview of all available metadata fields for that URL.

mikf commented 2 years ago

Should be fixed with https://github.com/mikf/gallery-dl/commit/9c8647a4fd83eeec181aa705ed1cf9b31ea595a7

Gigas002 commented 2 years ago

Yes, seems resolved :+1:

AlttiRi commented 2 years ago

"filename": "{filename} - {title}.{extension}"

Patreon's post may contain two different files (a file and one of attachments) with the same filename. You will download only one file in this case.

Gigas002 commented 2 years ago

Upd: downloading ugoira from pixiv still broken:

gallery-dl "https://www.pixiv.net/artworks/93872466"                                                                                                                    ✔  7s  
100%   5.32MB   2.29MB/s ffmpeg version n5.0 Copyright (c) 2000-2022 the FFmpeg developersr down.mkv
  built with gcc 11.2.0 (GCC)
  configuration: --prefix=/usr --disable-debug --disable-static --disable-stripping --enable-amf --enable-avisynth --enable-cuda-llvm --enable-lto --enable-fontconfig --enable-gmp --enable-gnutls --enable-gpl --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libdav1d --enable-libdrm --enable-libfreetype --enable-libfribidi --enable-libgsm --enable-libiec61883 --enable-libjack --enable-libmfx --enable-libmodplug --enable-libmp3lame --enable-libopencore_amrnb --enable-libopencore_amrwb --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librav1e --enable-librsvg --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libtheora --enable-libv4l2 --enable-libvidstab --enable-libvmaf --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxcb --enable-libxml2 --enable-libxvid --enable-libzimg --enable-nvdec --enable-nvenc --enable-shared --enable-version3 --enable-vulkan --enable-libglslang
  libavutil      57. 17.100 / 57. 17.100
  libavcodec     59. 18.100 / 59. 18.100
  libavformat    59. 16.100 / 59. 16.100
  libavdevice    59.  4.100 / 59.  4.100
  libavfilter     8. 24.100 /  8. 24.100
  libswscale      6.  4.100 /  6.  4.100
  libswresample   4.  3.100 /  4.  3.100
  libpostproc    56.  3.100 / 56.  3.100
Input #0, concat, from '/tmp/tmp0rbce8bw/ffconcat.txt':
  Duration: 00:00:03.75, start: 0.000000, bitrate: 1 kb/s
  Stream #0:0: Video: mjpeg (Baseline), yuvj444p(pc, bt470bg/unknown/unknown), 1300x1030 [SAR 1:1 DAR 130:103], 25 fps, 25 tbr, 25 tbn
/home/username/gallery-dl/pixiv/HyperLoliCrisis (55312990)/93872466_ugoira1920x1080 - Rin hair down.mkv: No such file or directory

postprocessor.ugoira: Non-zero exit status when running ['ffmpeg', '-f', 'concat', '-r', '1000/150', '-i', '/tmp/tmp0rbce8bw/ffconcat.txt', '-c', 'copy', '/home/username/gallery-dl/pixiv/HyperLoliCrisis (55312990)/93872466_ugoira1920x1080 - Rin hair down.mkv'] (1)
/home/username/gallery-dl/pixiv/HyperLoliCrisis (55312990)/93872466_ugoira1920x1080 - Rin hair down.mkv
kattjevfel commented 2 years ago

That's a completely different issue though, please create a new ticket for that. (And close this one)

Gigas002 commented 2 years ago

That's a completely different issue though, please create a new ticket for that. (And close this one)

I thought that could be related, since it has error with output directory. After I create the following directory for pixiv ugoira, it downloads successfully.

kattjevfel commented 2 years ago

Oh, my bad then. I see now that there's an error but it's not in English (and thus I just skimmed past it). Yeah that's related then.

Gigas002 commented 2 years ago

Oh, my bad then. I see now that there's an error but it's not in English (and thus I just skimmed past it). Yeah that's related then.

Sorry for that, I've fixed the error message.

mikf commented 2 years ago

The second bug should be fixed with https://github.com/mikf/gallery-dl/commit/6ca998fc2bd9591864d71f95e0149753dd532858

Gigas002 commented 2 years ago

Seems to work as expected