Open mxsrm opened 3 years ago
@mxsrm It's a piping related error, does it work with any other chunk method?
Not specifying any chunk method leads to SIGSEGV termination (valgrind showed some problems with python libraries used):
fish: Job 1, 'av1an --encoder aom --target-qu…' terminated by signal SIGSEGV (Address boundary error)
ffms2 same error:
av1an --encoder aom --target-quality 96 --min-q 8 --max-q 35 -i "ingl.mkv" --chunk-method ffms2
Scene detection
[00:00:48] [########################################################################################] 100% 7221/7221 (147.63 fps, eta 0s)
Queue: 48 Workers: 8 Passes: 2
Params: --threads=8 --cpu-used=6 --end-usage=q --cq-level=30 --tile-columns=2 --tile-rows=1 --kf-max-dist=240 --kf-min-dist=12
⠉ [00:00:00] [---------------------------------------------------------------------------------------------] 0% 0/7221 (0.00 fps, eta 0s)
thread '<unnamed>' panicked at 'called `Result::unwrap()` on an `Err` value: "Encoder encountered an error on chunk 43: Output { status: ExitStatus(ExitStatus(256)), stdout: \"\", stderr: \"Fatal: Specify stream dimensions with --width (-w) and --height (-h)\\n\" }"', av1an-core/src/target_quality.rs:217:45
hybrid too:
av1an --encoder aom --target-quality 96 --min-q 8 --max-q 35 -i "ingl.mkv" --chunk-method hybrid --resume --keep
Queue: 48 Workers: 8 Passes: 2
Params: --threads=8 --cpu-used=6 --end-usage=q --cq-level=30 --tile-columns=2 --tile-rows=1 --kf-max-dist=240 --kf-min-dist=12
⠉ [00:00:00] [---------------------------------------------------------------------------------------------] 0% 0/7221 (0.00 fps, eta 0s)
thread 'thread '<unnamed>' panicked at '<unnamed>called `Result::unwrap()` on an `Err` value: "Encoder encountered an error on chunk 41: Output { status: ExitStatus(ExitStatus(256)), stdout: \"\", stderr: \"Fatal: Specify stream dimensions with --width (-w) and --height (-h)\\n\" }"' panicked at '', called `Result::unwrap()` on an `Err` value: "Encoder encountered an error on chunk 42: Output { status: ExitStatus(ExitStatus(256)), stdout: \"\", stderr: \"Fatal: Specify stream dimensions with --width (-w) and --height (-h)\\n\" }"av1an-core/src/target_quality.rs', :av1an-core/src/target_quality.rs217::21745:
select too:
av1an --encoder aom --target-quality 96 --min-q 8 --max-q 35 -i "ingl.mkv" --chunk-method select --resume --keep
Queue: 48 Workers: 8 Passes: 2
Params: --threads=8 --cpu-used=6 --end-usage=q --cq-level=30 --tile-columns=2 --tile-rows=1 --kf-max-dist=240 --kf-min-dist=12
⠉ [00:00:00] [---------------------------------------------------------------------------------------------] 0% 0/7221 (0.00 fps, eta 0s)
thread '<unnamed>' panicked at 'called `Result::unwrap()` on an `Err` value: "Encoder encountered an error on chunk 44: Output { status: ExitStatus(ExitStatus(256)), stdout: \"\", stderr: \"Fatal: Specify stream dimensions with --width (-w) and --height (-h)\\n\" }"', av1an-core/src/target_quality.rs:217:45
segment fails with a different error:
av1an --encoder aom --target-quality 96 --min-q 8 --max-q 35 -i "ingl.mkv" --chunk-method segment
Scene detection
[00:00:42] [########################################################################################] 100% 7221/7221 (169.64 fps, eta 0s)
thread 'main' panicked at 'FFmpeg failed to segment: Output {
status: ExitStatus(
ExitStatus(
256,
),
),
stdout: "",
stderr: "Input #0, matroska,webm, from 'ingl.mkv':\n Metadata:\n title : Inglourious Basterds\n ENCODER : Lavf58.76.100\n Duration: 00:05:01.18, start: 0.000000, bitrate: 30823 kb/s\n Chapters:\n Chapter #0:0: start 0.000000, end 300.000000\n Metadata:\n title : Chapter 02\n Stream #0:0(eng): Video: h264 (High), yuv420p(tv, bt709, progressive), 1920x1080 [SAR 1:1 DAR 16:9], 23.98 fps, 23.98 tbr, 1k tbn, 47.95 tbc (default)\n Metadata:\n BPS-eng : 21586071\n DURATION-eng : 02:32:52.163000000\n NUMBER_OF_FRAMES-eng: 219912\n NUMBER_OF_BYTES-eng: 24748870971\n SOURCE_ID-eng : 001011\n _STATISTICS_WRITING_APP-eng: MakeMKV v1.16.4 linux(x64-release)\n _STATISTICS_WRITING_DATE_UTC-eng: 2021-10-17 14:50:42\n _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES SOURCE_ID\n DURATION : 00:05:01.175000000\n Stream #0:1(eng): Audio: dts (DTS-HD MA), 48000 Hz, 5.1(side), s32p (24 bit) (default)\n Metadata:\n title : Surround 5.1\n BPS-eng : 3513281\n DURATION-eng : 02:32:52.170666666\n NUMBER_OF_FRAMES-eng: 859891\n NUMBER_OF_BYTES-eng: 4028051612\n SOURCE_ID-eng : 001100\n _STATISTICS_WRITING_APP-eng: MakeMKV v1.16.4 linux(x64-release)\n _STATISTICS_WRITING_DATE_UTC-eng: 2021-10-17 14:50:42\n _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES SOURCE_ID\n DURATION : 00:05:00.921000000\n[segment @ 0x560abb2e4400] Opening '.e132d9c/split/00000.mkv' for writing\nOutput #0, segment, to '.e132d9c/split/%05d.mkv':\n Metadata:\n title : Inglourious Basterds\n encoder : Lavf58.76.100\n Chapters:\n Chapter #0:0: start 0.000000, end 300.000000\n Metadata:\n title : Chapter 02\n Stream #0:0(eng): Video: h264 (High), yuv420p(tv, bt709, progressive), 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 23.98 fps, 23.98 tbr, 1k tbn, 23.98 tbc (default)\n Metadata:\n BPS-eng : 21586071\n DURATION-eng : 02:32:52.163000000\n NUMBER_OF_FRAMES-eng: 219912\n NUMBER_OF_BYTES-eng: 24748870971\n SOURCE_ID-eng : 001011\n _STATISTICS_WRITING_APP-eng: MakeMKV v1.16.4 linux(x64-release)\n _STATISTICS_WRITING_DATE_UTC-eng: 2021-10-17 14:50:42\n _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES SOURCE_ID\n DURATION : 00:05:01.175000000\nStream mapping:\n Stream #0:0 -> #0:0 (copy)\nPress [q] to stop, [?] for help\nframe= 1 fps=0.0 q=-1.0 size=N/A time=-00:00:00.16 bitrate=N/A speed=N/A \r[segment @ 0x560abb2e4400] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly\n[matroska @ 0x560abb3570c0] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly\n[matroska @ 0x560abb3570c0] Can't write packet with unknown timestamp\nav_interleaved_write_frame(): Invalid argument\nframe= 2 fps=0.0 q=-1.0 Lsize=N/A time=-00:00:00.12 bitrate=N/A speed=N/A \nvideo:4kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown\nConversion failed!\n",
}', av1an-core/src/split.rs:55:3
The source file is procduced directly by ffmpeg; I used mkvmerge to create a new copy of it with correct timestamps and all the above methods failed anyways.
System information:
@mxsrm If av1an segfaults it's almost definitely an issue with vapoursynth or an ABI mismatch when using dynamic linking (which the official arch package uses). Can you post the output of this command please?
ffmpeg -i ingl.mkv -vf select=between(n\,50\,100),setpts=PTS-STARTPTS -pix_fmt yuv420p10le -strict -1 -f yuv4mpegpipe - | ffmpeg -i - -f null -
I added colons because otherwise it would not start:
ffmpeg -i ingl.mkv -vf 'select=between(n\,50\,100),setpts=PTS-STARTPTS' -pix_fmt yuv420p10le -strict -1 -f yuv4mpegpipe - | ffmpeg -i - -f null -
ffmpeg version 4.4 Copyright (c) 2000-2021 the FFmpeg developersffmpeg version 4.4
Copyright (c) 2000-2021 the FFmpeg developers built with gcc 11.1.0 (GCC)
built with gcc 11.1.0 (GCC)
configuration: --prefix=/usr --enable-lto --disable-rpath --enable-gpl --enable-version3 --enable-nonfree --enable-shared --disable-static --disable-stripping --enable-gray --enable-avresample --enable-alsa --enable-avisynth --enable-bzlib --enable-chromaprint --enable-frei0r --enable-gcrypt --enable-gmp --enable-gnutls --enable-iconv --enable-ladspa --enable-libaom --enable-libaribb24 --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcelt --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libdavs2 --enable-libdc1394 --enable-libfdk-aac --enable-libflite --enable-fontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libiec61883 --enable-libilbc --enable-libjack --enable-libklvanc --enable-libkvazaar --enable-liblensfun --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --disable-libopencv --enable-libopenh264 --enable-libopenjpeg --enable-libopenmpt --disable-libopenvino --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librav1e --enable-librist --enable-librsvg --enable-librubberband --enable-librtmp --enable-libshine --enable-libsmbclient --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libsvthevc --enable-libsvtav1 --disable-libtensorflow --enable-libtesseract --enable-libtheora --disable-libtls --enable-libtwolame --enable-libuavs3d --enable-libv4l2 --enable-libvidstab --enable-libvmaf --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libsvtvp9 --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxavs2 --enable-libxcb --enable-libxcb-shm --enable-libxcb-xfixes --enable-libxcb-shape --enable-libxvid --enable-libxml2 --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-lzma --enable-decklink --disable-mbedtls --enable-libmysofa --enable-openal --enable-opencl --enable-opengl --disable-openssl --enable-pocketsphinx --enable-sndio --enable-sdl2 --enable-vapoursynth --enable-vulkan --enable-xlib --enable-zlib --enable-amf --disable-cuda-nvcc --disable-cuda-llvm --disable-cuvid --disable-ffnvcodec --enable-libdrm --disable-libmfx --disable-libnpp --disable-nvdec --disable-nvenc --enable-omx --disable-rkmpp --enable-v4l2-m2m --enable-vaapi --enable-vdpau
configuration: --prefix=/usr --enable-lto --disable-rpath --enable-gpl --enable-version3 --enable-nonfree --enable-shared --disable-static --disable-stripping --enable-gray --enable-avresample --enable-alsa --enable-avisynth --enable-bzlib --enable-chromaprint --enable-frei0r --enable-gcrypt --enable-gmp --enable-gnutls --enable-iconv --enable-ladspa --enable-libaom --enable-libaribb24 --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcelt --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libdavs2 --enable-libdc1394 --enable-libfdk-aac --enable-libflite --enable-fontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libiec61883 --enable-libilbc --enable-libjack --enable-libklvanc --enable-libkvazaar --enable-liblensfun --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --disable-libopencv --enable-libopenh264 --enable-libopenjpeg --enable-libopenmpt --disable-libopenvino --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librav1e --enable-librist --enable-librsvg --enable-librubberband --enable-librtmp --enable-libshine --enable-libsmbclient --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libsvthevc --enable-libsvtav1 --disable-libtensorflow --enable-libtesseract --enable-libtheora --disable-libtls --enable-libtwolame --enable-libuavs3d --enable-libv4l2 --enable-libvidstab --enable-libvmaf --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libsvtvp9 --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxavs2 --enable-libxcb --enable-libxcb-shm --enable-libxcb-xfixes --enable-libxcb-shape --enable-libxvid --enable-libxml2 --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-lzma --enable-decklink --disable-mbedtls --enable-libmysofa --enable-openal --enable-opencl --enable-opengl --disable-openssl --enable-pocketsphinx --enable-sndio --enable-sdl2 --enable-vapoursynth --enable-vulkan --enable-xlib --enable-zlib --enable-amf --disable-cuda-nvcc --disable-cuda-llvm --disable-cuvid --disable-ffnvcodec --enable-libdrm --disable-libmfx --disable-libnpp --disable-nvdec --disable-nvenc --enable-omx --disable-rkmpp --enable-v4l2-m2m --enable-vaapi --enable-vdpau
libavutil 56. 70.100 / 56. 70.100
libavcodec 58.134.100 / 58.134.100
libavformat 58. 76.100 / 58. 76.100
libavdevice 58. 13.100 / 58. 13.100
libavfilter 7.110.100 / 7.110.100
libavutil 56. 70.100 / 56. 70.100
libavresample 4. 0. 0 / 4. 0. 0
libavcodec 58.134.100 / 58.134.100
libswscale 5. 9.100 / 5. 9.100
libavformat 58. 76.100 / 58. 76.100
libswresample 3. 9.100 / 3. 9.100
libavdevice 58. 13.100 / 58. 13.100
libpostproc 55. 9.100 / 55. 9.100
libavfilter 7.110.100 / 7.110.100
libavresample 4. 0. 0 / 4. 0. 0
libswscale 5. 9.100 / 5. 9.100
libswresample 3. 9.100 / 3. 9.100
libpostproc 55. 9.100 / 55. 9.100
Input #0, matroska,webm, from 'ingl.mkv':
Metadata:
encoder : libebml v1.4.2 + libmatroska v1.6.3
creation_time : 2021-11-02T14:32:55.000000Z
Duration: 00:05:01.26, start: 0.083000, bitrate: 30810 kb/s
Chapters:
Chapter #0:0: start 0.083000, end 300.083000
Metadata:
title : Chapter 02
Stream #0:0(eng): Video: h264 (High), yuv420p(tv, bt709, progressive), 1920x1080 [SAR 1:1 DAR 16:9], 23.98 fps, 23.98 tbr, 1k tbn, 47.95 tbc (default)
Metadata:
BPS : 27264268
DURATION : 00:05:01.259000000
NUMBER_OF_FRAMES: 7221
NUMBER_OF_BYTES : 1026700783
_STATISTICS_WRITING_APP: mkvmerge v62.0.0 ('Apollo') 64-bit
_STATISTICS_WRITING_DATE_UTC: 2021-11-02 14:32:55
_STATISTICS_TAGS: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
Stream #0:1(eng): Audio: dts (DTS-HD MA), 48000 Hz, 5.1(side), s32p (24 bit) (default)
Metadata:
BPS : 3546788
DURATION : 00:05:00.916000000
NUMBER_OF_FRAMES: 28211
NUMBER_OF_BYTES : 133410672
_STATISTICS_WRITING_APP: mkvmerge v62.0.0 ('Apollo') 64-bit
_STATISTICS_WRITING_DATE_UTC: 2021-11-02 14:32:55
_STATISTICS_TAGS: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> wrapped_avframe (native))
Press [q] to stop, [?] for help
[yuv4mpegpipe @ 0x55aa0a92bb80] Warning: generating non standard YUV stream. Mjpegtools will not work.
Output #0, yuv4mpegpipe, to 'pipe:':
Metadata:
encoder : Lavf58.76.100
Chapters:
Chapter #0:0: start 0.000000, end 300.000000
Metadata:
title : Chapter 02
Stream #0:0(eng): Video: wrapped_avframe, yuv420p10le(tv, bt709, progressive), 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 23.98 fps, 23.98 tbn (default)
Metadata:
BPS : 27264268
DURATION : 00:05:01.259000000
NUMBER_OF_FRAMES: 7221
NUMBER_OF_BYTES : 1026700783
_STATISTICS_WRITING_APP: mkvmerge v62.0.0 ('Apollo') 64-bit
_STATISTICS_WRITING_DATE_UTC: 2021-11-02 14:32:55
_STATISTICS_TAGS: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
encoder : Lavc58.134.100 wrapped_avframe
Input #0, yuv4mpegpipe, from 'pipe:':075kB time=00:00:00.04 bitrate=1193227.2kbits/s speed=0.848x
Duration: N/A, start: 0.000000, bitrate: N/A
Stream #0:0: Video: rawvideo (Y3[11][10] / 0xA0B3359), yuv420p10le(tv, progressive), 1920x1080, SAR 1:1 DAR 16:9, 23.98 fps, 23.98 tbr, 23.98 tbn, 23.98 tbc
Stream mapping:
Stream #0:0 -> #0:0 (rawvideo (native) -> wrapped_avframe (native))
Output #0, null, to 'pipe:':
Metadata:
encoder : Lavf58.76.100
Stream #0:0: Video: wrapped_avframe, yuv420p10le(tv, progressive), 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 23.98 fps, 23.98 tbn
Metadata:
encoder : Lavc58.134.100 wrapped_avframe
frame= 51 fps=5.2 q=-0.0 Lsize= 309825kB time=00:00:02.12 bitrate=1193201.9kbits/s speed=0.216x
video:27kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 1160498.500000%
frame= 51 fps=5.2 q=-0.0 Lsize=N/A time=00:00:02.12 bitrate=N/A speed=0.217x
video:27kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
There is something seriously wrong if av1an segfaults without specifying the chunk method. If you don't specify it, it uses the vapoursynth C API to check if lsmash or ffms2 are available. Are you using any custom build or git version of vapoursynth, and do you have vapoursynth-plugin-lsmashsource
installed?
Both are installed from the community repository of arch:
yay -S vapoursynth vapoursynth-plugin-lsmashsource
warning: vapoursynth-R57-1 is up to date -- reinstalling
warning: vapoursynth-plugin-lsmashsource-20210423-1 is up to date -- reinstalling
resolving dependencies...
looking for conflicting packages...
Package (2) Old Version New Version Net Change
community/vapoursynth R57-1 R57-1 0.00 MiB
community/vapoursynth-plugin-lsmashsource 20210423-1 20210423-1 0.00 MiB
Total Installed Size: 2.89 MiB
Net Upgrade Size: 0.00 MiB
:: Proceed with installation? [Y/n]
@mxsrm Do you happen to also have vapoursynth installed through pip? If so that could cause issues
I'm using the latest release from arch community repository (
av1an 0.2.1-2
). When trying to encoding anything in aom I get this error:Command used:
av1an --chunk-method lsmash --encoder aom --target-quality 96 --min-q 8 --max-q 35 -i "ingl.mkv"
Specifiying video params with width and height does not fix anything.
The file to be encoded:
Edit: aomenc version
av1 - AOMedia Project AV1 Encoder v3.2.0 (default)