FFMPEG fails with "Aborted (core dumped)" or sometimes even without an error message

JohnnyDeeee commented 7 months ago

Describe the bug FFMPEG command fails with error Aborted (core dumped)

To Reproduce Steps to reproduce the behavior: I'm not sure yet what causes this. It fails 10/10 on the same file in my case. I can share a small part of the video if that is necessary.

Expected behavior FFMPEG should not fail.

Screenshots N.A

Please provide the following information:

Config files

{
 "serverPort": "8266",
 "webUIPort": "8265",
 "serverIP": "0.0.0.0",
 "handbrakePath": "",
 "ffmpegPath": "",
 "logLevel": "INFO",
 "mkvpropeditPath": "",
 "ccextractorPath": "",
 "openBrowser": true,
 "cronPluginUpdate": ""
}

Job reports vpGBwme6D-log.txt

This specific job did not have a specific ffmpeg error (it just failed) I ran the ffmpeg command inside the container shell and got the following output:

output

ffmpeg version 6.0-Jellyfin Copyright (c) 2000-2023 the FFmpeg developers
built with gcc 9 (Ubuntu 9.4.0-1ubuntu1~20.04.2)
configuration: --prefix=/usr/lib/jellyfin-ffmpeg --target-os=linux --extra-version=Jellyfin --disable-doc --disable-ffplay --disable-ptx-compression --disable-static --disable-libxcb --disable-sdl2 --disable-xlib --enable-lto --enable-gpl --enable-version3 --enable-shared --enable-gmp --enable-gnutls --enable-chromaprint --enable-libdrm --enable-libass --enable-libfreetype --enable-libfribidi --enable-libfontconfig --enable-libbluray --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libopenmpt --enable-libdav1d --enable-libwebp --enable-libvpx --enable-libx264 --enable-libx265 --enable-libzvbi --enable-libzimg --enable-libfdk-aac --arch=amd64 --enable-libsvtav1 --enable-libshaderc --enable-libplacebo --enable-vulkan --enable-opencl --enable-vaapi --enable-amf --enable-libvpl --enable-ffnvcodec --enable-cuda --enable-cuda-llvm --enable-cuvid --enable-nvdec --enable-nvenc
libavutil      58.  2.100 / 58.  2.100
libavcodec     60.  3.100 / 60.  3.100
libavformat    60.  3.100 / 60.  3.100
libavdevice    60.  1.100 / 60.  1.100
libavfilter     9.  3.100 /  9.  3.100
libswscale      7.  1.100 /  7.  1.100
libswresample   4. 10.100 /  4. 10.100
libpostproc    57.  1.100 / 57.  1.100
Input #0, matroska,webm, from 'According.to.Jim.S01E02.1080p.WEB-DL.x264.Rus.Eng.mkv':
Metadata:
  title           : According.to.Jim.S01E02.1080p.WEB-DL.x264-TrollHD-ParovozN
  encoder         : libebml v1.3.5 + libmatroska v1.4.8
  creation_time   : 2018-06-07T16:37:19.000000Z
Duration: 00:21:45.64, start: 0.000000, bitrate: 15453 kb/s
Stream #0:0: Video: h264 (High), yuv420p(tv, bt709, progressive), 1920x1080 [SAR 19999:20000 DAR 19999:11250], Closed Captions, SAR 1:1 DAR 16:9, 23.98 fps, 23.98 tbr, 1k tbn (default)
  Metadata:
    title           : According to Jim S01E02
    BPS-eng         : 14682971
    DURATION-eng    : 00:21:45.638000000
    NUMBER_OF_FRAMES-eng: 31304
    NUMBER_OF_BYTES-eng: 2396330693
    _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
    _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
    _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
Stream #0:1(rus): Audio: ac3, 48000 Hz, stereo, fltp, 192 kb/s (default)
  Metadata:
    title           : MVO (FOX)
    BPS-eng         : 192000
    DURATION-eng    : 00:21:45.600000000
    NUMBER_OF_FRAMES-eng: 40800
    NUMBER_OF_BYTES-eng: 31334400
    _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
    _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
    _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
Stream #0:2(rus): Audio: ac3, 48000 Hz, stereo, fltp, 192 kb/s
  Metadata:
    title           : MVO (СТС)
    BPS-eng         : 192000
    DURATION-eng    : 00:21:45.600000000
    NUMBER_OF_FRAMES-eng: 40800
    NUMBER_OF_BYTES-eng: 31334400
    _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
    _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
    _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
Stream #0:3(eng): Audio: ac3, 48000 Hz, 5.1(side), fltp, 384 kb/s
  Metadata:
    BPS-eng         : 384000
    DURATION-eng    : 00:21:45.600000000
    NUMBER_OF_FRAMES-eng: 40800
    NUMBER_OF_BYTES-eng: 62668800
    _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
    _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
    _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
Stream #0:4(eng): Subtitle: subrip (default)
  Metadata:
    title           : English
    BPS-eng         : 80
    DURATION-eng    : 00:21:29.918000000
    NUMBER_OF_FRAMES-eng: 463
    NUMBER_OF_BYTES-eng: 13023
    _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
    _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
    _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
File 'out.mkv' already exists. Overwrite? [y/N] y
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> hevc (libx265))
Stream #0:1 -> #0:1 (copy)
Stream #0:2 -> #0:2 (copy)
Stream #0:3 -> #0:3 (copy)
Stream #0:4 -> #0:4 (copy)
Press [q] to stop, [?] for help
x265 [info]: HEVC encoder version 3.2.1+1-b5c86a64bbbe
x265 [info]: build info [Linux][GCC 9.3.0][64 bit] 8bit+10bit+12bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast LZCNT SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
x265 [info]: Main profile, Level-4 (High tier)
x265 [info]: Thread pool created using 4 threads
x265 [info]: Slices                              : 1
x265 [info]: frame threads / pool features       : 2 / wpp(17 rows)
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
x265 [info]: Coding QT: max CU size, min CU size : 64 / 8
x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
x265 [info]: ME / range / subpel / merge         : hex / 57 / 2 / 3
x265 [info]: Keyframe min / max / scenecut / bias: 23 / 250 / 40 / 5.00
x265 [info]: Lookahead / bframes / badapt        : 20 / 4 / 2
x265 [info]: b-pyramid / weightp / weightb       : 1 / 1 / 0
x265 [info]: References / ref-limit  cu / depth  : 3 / off / on
x265 [info]: AQ: mode / str / qg-size / cu-tree  : 2 / 1.0 / 32 / 1
x265 [info]: Rate Control / qCompress            : ABR-7186 kbps / 0.60
x265 [info]: VBV/HRD buffer / max-rate / init    : 14372 / 9341 / 0.750
x265 [info]: tools: rd=3 psy-rd=2.00 early-skip rskip signhide tmvp b-intra
x265 [info]: tools: strong-intra-smoothing lslices=6 deblock sao
Output #0, matroska, to 'out.mkv':
Metadata:
  title           : According.to.Jim.S01E02.1080p.WEB-DL.x264-TrollHD-ParovozN
  encoder         : Lavf60.3.100
Stream #0:0: Video: hevc, yuv420p(tv, bt709, progressive), 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 7186 kb/s, 23.98 fps, 1k tbn (default)
  Metadata:
    title           : According to Jim S01E02
    BPS-eng         : 14682971
    DURATION-eng    : 00:21:45.638000000
    NUMBER_OF_FRAMES-eng: 31304
    NUMBER_OF_BYTES-eng: 2396330693
    _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
    _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
    _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
    encoder         : Lavc60.3.100 libx265
  Side data:
    cpb: bitrate max/min/avg: 9341000/0/7186000 buffer size: 14372000 vbv_delay: N/A
Stream #0:1(rus): Audio: ac3 ([0] [0][0] / 0x2000), 48000 Hz, stereo, fltp, 192 kb/s (default)
  Metadata:
    title           : MVO (FOX)
    BPS-eng         : 192000
    DURATION-eng    : 00:21:45.600000000
    NUMBER_OF_FRAMES-eng: 40800
    NUMBER_OF_BYTES-eng: 31334400
    _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
    _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
    _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
Stream #0:2(rus): Audio: ac3 ([0] [0][0] / 0x2000), 48000 Hz, stereo, fltp, 192 kb/s
  Metadata:
    title           : MVO (СТС)
    BPS-eng         : 192000
    DURATION-eng    : 00:21:45.600000000
    NUMBER_OF_FRAMES-eng: 40800
    NUMBER_OF_BYTES-eng: 31334400
    _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
    _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
    _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
Stream #0:3(eng): Audio: ac3 ([0] [0][0] / 0x2000), 48000 Hz, 5.1(side), fltp, 384 kb/s
  Metadata:
    BPS-eng         : 384000
    DURATION-eng    : 00:21:45.600000000
    NUMBER_OF_FRAMES-eng: 40800
    NUMBER_OF_BYTES-eng: 62668800
    _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
    _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
    _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
Stream #0:4(eng): Subtitle: subrip (default)
  Metadata:
    title           : English
    BPS-eng         : 80
    DURATION-eng    : 00:21:29.918000000
    NUMBER_OF_FRAMES-eng: 463
    NUMBER_OF_BYTES-eng: 13023
    _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
    _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
    _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
corrupted size vs. prev_sizeize=       5kB time=00:00:02.49 bitrate=  16.8kbits/s speed=0.608x
Aborted (core dumped)

Log files I dont have these anymore
- OS: Linux (running in docker)
- Browser: Firefox
- Version: Tdarr version 2.17.01

Additional context N/A

JohnnyDeeee commented 7 months ago

i also got the corrupted double linked list and invalid chunk size errors.. Could be related to https://github.com/reticivis-net/mediaforge/issues/147, but this is the output from the free command on my host machine

              total        used        free      shared  buff/cache   available
Mem:        5925288      286912     5281600        2212      356776     5368960
Swap:       2097152           0     2097152

and inside the tdarr docker container (if that even matters)

              total        used        free      shared  buff/cache   available
Mem:        7834896     4728496      590928      149384     2515472     2811912
Swap:       4194300     1628132     2566168

JohnnyDeeee commented 7 months ago

This is the stat output of the video file

  File: According.to.Jim.S01E02.1080p.WEB-DL.x264.Rus.Eng.mkv
  Size: 2522125571      Blocks: 4926032    IO Block: 4096   regular file
Device: 26h/38d Inode: 1942768501107309336  Links: 1
Access: (0774/-rwxrwxr--)  Uid: ( 1000/     abc)   Gid: (   46/ plugdev)
Access: 2024-02-28 00:59:52.787695200 +0000
Modify: 2024-02-27 20:27:23.568908000 +0000
Change: 2024-02-28 00:59:19.112993300 +0000
 Birth: -

JohnnyDeeee commented 7 months ago

Using ffmpeg version 2.8.17-0ubuntu0.1 on another machine i got this output

ffmpeg version 2.8.17-0ubuntu0.1 Copyright (c) 2000-2020 the FFmpeg developers
  built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.12) 20160609
  configuration: --prefix=/usr --extra-version=0ubuntu0.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
  libavutil      54. 31.100 / 54. 31.100
  libavcodec     56. 60.100 / 56. 60.100
  libavformat    56. 40.101 / 56. 40.101
  libavdevice    56.  4.100 / 56.  4.100
  libavfilter     5. 40.101 /  5. 40.101
  libavresample   2.  1.  0 /  2.  1.  0
  libswscale      3.  1.101 /  3.  1.101
  libswresample   1.  2.101 /  1.  2.101
  libpostproc    53.  3.100 / 53.  3.100
Input #0, matroska,webm, from 'According.to.Jim.S01E02.1080p.WEB-DL.x264.Rus.Eng.mkv':
  Metadata:
    title           : According.to.Jim.S01E02.1080p.WEB-DL.x264-TrollHD-ParovozN
    encoder         : libebml v1.3.5 + libmatroska v1.4.8
    creation_time   : 2018-06-07 16:37:19
  Duration: 00:21:45.64, start: 0.000000, bitrate: 15453 kb/s
    Stream #0:0: Video: h264 (High), yuv420p(tv, bt709), 1920x1080 [SAR 19999:20000 DAR 19999:11250], Closed Captions, SAR 1:1 DAR 16:9, 23.98 fps, 23.98 tbr, 1k tbn, 47.95 tbc (default)
    Metadata:
      title           : According to Jim S01E02
      BPS-eng         : 14682971
      DURATION-eng    : 00:21:45.638000000
      NUMBER_OF_FRAMES-eng: 31304
      NUMBER_OF_BYTES-eng: 2396330693
      _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
      _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
      _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
    Stream #0:1(rus): Audio: ac3, 48000 Hz, stereo, fltp, 192 kb/s (default)
    Metadata:
      title           : MVO (FOX)
      BPS-eng         : 192000
      DURATION-eng    : 00:21:45.600000000
      NUMBER_OF_FRAMES-eng: 40800
      NUMBER_OF_BYTES-eng: 31334400
      _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
      _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
      _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
    Stream #0:2(rus): Audio: ac3, 48000 Hz, stereo, fltp, 192 kb/s
    Metadata:
      title           : MVO (СТС)
      BPS-eng         : 192000
      DURATION-eng    : 00:21:45.600000000
      NUMBER_OF_FRAMES-eng: 40800
      NUMBER_OF_BYTES-eng: 31334400
      _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
      _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
      _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
    Stream #0:3(eng): Audio: ac3, 48000 Hz, 5.1(side), fltp, 384 kb/s
    Metadata:
      BPS-eng         : 384000
      DURATION-eng    : 00:21:45.600000000
      NUMBER_OF_FRAMES-eng: 40800
      NUMBER_OF_BYTES-eng: 62668800
      _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
      _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
      _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
    Stream #0:4(eng): Subtitle: subrip (default)
    Metadata:
      title           : English
      BPS-eng         : 80
      DURATION-eng    : 00:21:29.918000000
      NUMBER_OF_FRAMES-eng: 463
      NUMBER_OF_BYTES-eng: 13023
      _STATISTICS_WRITING_APP-eng: mkvmerge v22.0.0 ('At The End Of The World') 64-bit
      _STATISTICS_WRITING_DATE_UTC-eng: 2018-06-07 16:37:19
      _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
x265 [info]: HEVC encoder version 1.9
x265 [info]: build info [Linux][GCC 5.3.1][64 bit] 8bit+10bit+12bit
x265 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX AVX2 FMA3 LZCNT BMI2
x265 [info]: Main profile, Level-4 (Main tier)
Segmentation fault

HaveAGitGat commented 7 months ago

Seems internal FFmpeg bug so we'd need to open a bug report here most likely where we can add input file: https://ffmpeg.org/bugreports.html

HaveAGitGat commented 6 months ago

Re-open if needed with sample file ty.

HaveAGitGat / Tdarr

FFMPEG fails with "Aborted (core dumped)" or sometimes even without an error message #976