Alterak
commented
2 years ago In release 4.1.1, the problem is also present.
Closed Alterak closed 2 years ago
Alterak
commented
2 years ago In release 4.1.1, the problem is also present.
Alterak
commented
2 years ago On the test server, I installed the previous version 4.1.0, everything works well there ... at the moment my live video works well for 51 minutes, and the number of segments is already 761. There were no breaks.
Chocobozzz
commented
2 years ago Hello,
This is not a peertube error: ffmpeg crashed:
[hls @ 0x5563be0a3040] Opening '/var/www/peertube/storage-fs/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000042.ts' for writing
[hls @ 0x5563be0a3040] Failed to open file '/var/www/peertube/storage-fs/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000042.ts'
av_interleaved_write_frame(): No such file or directory
[hls @ 0x5563be0a3040] Opening '/var/www/peertube/storage-fs/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000042.ts' for writing
[hls @ 0x5563be0a3040] Failed to open file '/var/www/peertube/storage-fs/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000042.ts'
[hls muxer @ 0x5563be09d280] failed to delete old segment /var/www/peertube/storage-fs/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000026.ts: No such file or directory
[hls @ 0x5563be0a3040] Opening '/var/www/peertube/storage-fs/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8.tmp' for writing
[hls @ 0x5563be0a3040] failed to rename file /var/www/peertube/storage-fs/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8.tmp to /var/www/peertube/storage-fs/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8: No such file or directory
frame=10751 fps= 60 q=-1.0 Lsize=N/A time=00:02:59.18 bitrate=N/A speed=1.01x
video:98792kB audio:136kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
Conversion failed!I'm pretty sure that https://github.com/Chocobozzz/PeerTube/issues/4902 and this issue comes from your NFS mount point since ffmpeg does heavy IO. So please stop using an NFS mount point, and use the local disk instead. You can also use official remote storage peertube support. If using the local disk does not fix your issue, please comment this ticket.
Alterak
commented
2 years ago I'm pretty sure that #4902 and this issue comes from your NFS mount point since ffmpeg does heavy IO. So please stop using an NFS mount point, and use the local disk instead. You can also use official remote storage peertube support. If using the local disk does not fix your issue, please comment this ticket.
Make a local disk - it did not help. The peertube server is running on my Proxmox virtual machine. The system drive is on an SSD, and for storage I use 2 HDDs (ZFS). I allocated an additional disk for the virtual machine, a 100GB disk, transferred all the data to it (for the test server), this is what happened:
peertube@media:~$ df -h
Файловая система Размер Использовано Дост Использовано% Cмонтировано в
udev 973M 0 973M 0% /dev
tmpfs 198M 584K 198M 1% /run
/dev/sda2 14G 12G 1,4G 90% /
tmpfs 989M 16K 989M 1% /dev/shm
tmpfs 5,0M 0 5,0M 0% /run/lock
/dev/sda1 511M 3,5M 508M 1% /boot/efi
tmpfs 198M 0 198M 0% /run/user/1001
/dev/sdb1 98G 6,1G 87G 7% /var/www/peertube/storage-disk
peertube@media:~$ lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 15G 0 disk
├─sda1 8:1 0 512M 0 part /boot/efi
├─sda2 8:2 0 13,5G 0 part /
└─sda3 8:3 0 976M 0 part [SWAP]
sdb 8:16 0 100G 0 disk
└─sdb1 8:17 0 100G 0 part /var/www/peertube/storage-disk
sr0 11:0 1 1024M 0 rom
peertube@media:~$I did a lot of tests and I got the error again
I am sure that this is not the problem, because even on version 4.1.0 the live broadcast worked well, there were no breaks. I have live video processing disabled, so ffmpeg is not used.
Chocobozzz
commented
2 years ago ffmpeg is always used for lives for muxing, even if transcoding is not enabled what is the error on server?
Alterak
commented
2 years ago I re-launched the live video. So far, it has been working well for 22 minutes. At the moment it has reached
Refetching sha segments for 0-000337.ts.
There haven't been any crashes yet.
ffmpeg is always used for lives for muxing, even if transcoding is not enabled what is the error on server?
Here I turned on, but then turned off the processing, maybe I started a new broadcast when the previous segments did not end.
If you enable processing, then even on a local disk it gives errors
error[02.05.2022, 15:36:25] Live transcoding error.
{
"err": {
"stack": "Error: ffmpeg exited with code 1: frame= 361 fps= 70 q=-1.0 Lsize=N/A time=00:00:06.01 bitrate=N/A speed=1.16x \nvideo:4460kB audio:12kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown\nConversion failed!\n\n at ChildProcess.<anonymous> (/var/www/peertube/versions/peertube-nightly-2022-04-28/node_modules/fluent-ffmpeg/lib/processor.js:182:22)\n at ChildProcess.emit (node:events:526:28)\n at ChildProcess.emit (node:domain:475:12)\n at Process.ChildProcess._handle.onexit (node:internal/child_process:291:12)",
"message": "ffmpeg exited with code 1: frame= 361 fps= 70 q=-1.0 Lsize=N/A time=00:00:06.01 bitrate=N/A speed=1.16x \nvideo:4460kB audio:12kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown\nConversion failed!\n"
},
"stdout": "",
"stderr": "ffmpeg version 4.3.3-0+deb11u1 Copyright (c) 2000-2021 the FFmpeg developers\n built with gcc 10 (Debian 10.2.1-6)\n configuration: --prefix=/usr --extra-version=0+deb11u1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared\n libavutil 56. 51.100 / 56. 51.100\n libavcodec 58. 91.100 / 58. 91.100\n libavformat 58. 45.100 / 58. 45.100\n libavdevice 58. 10.100 / 58. 10.100\n libavfilter 7. 85.100 / 7. 85.100\n libavresample 4. 0. 0 / 4. 0. 0\n libswscale 5. 7.100 / 5. 7.100\n libswresample 3. 7.100 / 3. 7.100\n libpostproc 55. 7.100 / 55. 7.100\nInput #0, flv, from 'rtmp://127.0.0.1:1937/live/54588ecd-e74c-455d-8bca-026c0182301f':\n Metadata:\n fileSize : 0\n audiochannels : 2\n 2.1 : false\n 3.1 : false\n 4.0 : false\n 4.1 : false\n 5.1 : false\n 7.1 : false\n encoder : obs-output module (libobs version 27.2.1)\n Duration: 00:00:00.00, start: 0.000000, bitrate: N/A\n Stream #0:0: Data: none\n Stream #0:1: Audio: aac (LC), 44100 Hz, stereo, fltp, 163 kb/s\n Stream #0:2: Video: h264 (Main), yuv420p(tv, bt709, progressive), 2560x1440 [SAR 1:1 DAR 16:9], 5632 kb/s, 60 fps, 60 tbr, 1k tbn, 120 tbc\nOutput #0, hls, to '/var/www/peertube/storage-disk/streaming-playlists/hls/84c0b431-23de-4870-adca-ca4ac100aac1/%v.m3u8':\n Metadata:\n fileSize : 0\n audiochannels : 2\n 2.1 : false\n 3.1 : false\n 4.0 : false\n 4.1 : false\n 5.1 : false\n 7.1 : false\n encoder : Lavf58.45.100\n Stream #0:0: Audio: aac (LC), 44100 Hz, stereo, fltp, 163 kb/s\n Stream #0:1: Video: h264 (Main), yuv420p(tv, bt709, progressive), 2560x1440 [SAR 1:1 DAR 16:9], q=2-31, 5632 kb/s, 60 fps, 60 tbr, 90k tbn, 60 tbc\nStream mapping:\n Stream #0:1 -> #0:0 (copy)\n Stream #0:2 -> #0:1 (copy)\nPress [q] to stop, [?] for help\nframe= 82 fps=0.0 q=-1.0 size=N/A time=00:00:01.36 bitrate=N/A speed=2.72x \nframe= 117 fps=108 q=-1.0 size=N/A time=00:00:01.94 bitrate=N/A speed=1.79x \nframe= 152 fps= 91 q=-1.0 size=N/A time=00:00:02.53 bitrate=N/A speed=1.51x \nframe= 187 fps= 83 q=-1.0 size=N/A time=00:00:03.11 bitrate=N/A speed=1.38x \nframe= 222 fps= 78 q=-1.0 size=N/A time=00:00:03.69 bitrate=N/A speed= 1.3x \nframe= 257 fps= 75 q=-1.0 size=N/A time=00:00:04.28 bitrate=N/A speed=1.25x \nframe= 292 fps= 73 q=-1.0 size=N/A time=00:00:04.86 bitrate=N/A speed=1.22x \nframe= 327 fps= 71 q=-1.0 size=N/A time=00:00:05.44 bitrate=N/A speed=1.19x \n[hls @ 0x55b85c075e80] Opening '/var/www/peertube/storage-disk/streaming-playlists/hls/84c0b431-23de-4870-adca-ca4ac100aac1/0-000000.ts' for writing\n[hls @ 0x55b85c075e80] Failed to open file '/var/www/peertube/storage-disk/streaming-playlists/hls/84c0b431-23de-4870-adca-ca4ac100aac1/0-000000.ts'\nav_interleaved_write_frame(): No such file or directory\n[hls @ 0x55b85c075e80] Opening '/var/www/peertube/storage-disk/streaming-playlists/hls/84c0b431-23de-4870-adca-ca4ac100aac1/0-000000.ts' for writing\n[hls @ 0x55b85c075e80] Failed to open file '/var/www/peertube/storage-disk/streaming-playlists/hls/84c0b431-23de-4870-adca-ca4ac100aac1/0-000000.ts'\n[hls @ 0x55b85c075e80] Opening '/var/www/peertube/storage-disk/streaming-playlists/hls/84c0b431-23de-4870-adca-ca4ac100aac1/0.m3u8.tmp' for writing\n[hls @ 0x55b85c075e80] failed to rename file /var/www/peertube/storage-disk/streaming-playlists/hls/84c0b431-23de-4870-adca-ca4ac100aac1/0.m3u8.tmp to /var/www/peertube/storage-disk/streaming-playlists/hls/84c0b431-23de-4870-adca-ca4ac100aac1/0.m3u8: No such file or directory\n[hls @ 0x55b85c075e80] Opening '/var/www/peertube/storage-disk/streaming-playlists/hls/84c0b431-23de-4870-adca-ca4ac100aac1/master.m3u8' for writing\n[hls @ 0x55b85c075e80] Failed to open master play list file '/var/www/peertube/storage-disk/streaming-playlists/hls/84c0b431-23de-4870-adca-ca4ac100aac1/master.m3u8'\n[hls @ 0x55b85c075e80] Master playlist creation failed\nframe= 361 fps= 70 q=-1.0 Lsize=N/A time=00:00:06.01 bitrate=N/A speed=1.16x \nvideo:4460kB audio:12kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown\nConversion failed!\n",
"ffmpegShellCommand": "ffmpeg -n 5 /usr/bin/ffmpeg -i rtmp://127.0.0.1:1937/live/54588ecd-e74c-455d-8bca-026c0182301f -y -threads 4 -c:v copy -c:a copy -map 0:a? -map 0:v? -hls_time 4 -hls_list_size 15 -hls_flags delete_segments+independent_segments+program_date_time -hls_segment_filename /var/www/peertube/storage-disk/streaming-playlists/hls/84c0b431-23de-4870-adca-ca4ac100aac1/%v-%06d.ts -master_pl_name master.m3u8 -f hls /var/www/peertube/storage-disk/streaming-playlists/hls/84c0b431-23de-4870-adca-ca4ac100aac1/%v.m3u8",
"tags": [
"live",
"3N9GCAKK",
"84c0b431-23de-4870-adca-ca4ac100aac1"
]
}When I connected a local drive, the live video no longer cuts out. You were right.
Alterak
commented
2 years ago I'm pretty sure that #4902 and this issue comes from your NFS mount point since ffmpeg does heavy IO
Hello, the peertube version is nightly-2022-05-10 worked well. Today I put a version of peertube-nightly-2022-05-14 and the mistake began to repeat itself again
error[14.05.2022, 21:04:30] Live transcoding error.
{
"err": {
"stack": "Error: ffmpeg exited with code 1: frame=12362 fps= 60 q=-1.0 Lsize=N/A time=00:03:26.03 bitrate=N/A speed= 1x \nvideo:163811kB audio:53kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown\nConversion failed!\n\n at ChildProcess.<anonymous> (/var/www/peertube/versions/peertube-nightly-2022-05-14/node_modules/fluent-ffmpeg/lib/processor.js:182:22)\n at ChildProcess.emit (events.js:400:28)\n at ChildProcess.emit (domain.js:475:12)\n at Process.ChildProcess._handle.onexit (internal/child_process.js:282:12)",
"message": "ffmpeg exited with code 1: frame=12362 fps= 60 q=-1.0 Lsize=N/A time=00:03:26.03 bitrate=N/A speed= 1x \nvideo:163811kB audio:53kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown\nConversion failed!\n"
},
"stdout": "",
"stderr": "frame=10001 fps= 60 q=-1.0 size=N/A time=00:02:46.68 bitrate=N/A speed=1.01x \nframe=10036 fps= 60 q=-1.0 size=N/A time=00:02:47.26 bitrate=N/A speed=1.01x \nframe=10071 fps= 60 q=-1.0 size=N/A time=00:02:47.84 bitrate=N/A speed=1.01x \nframe=10106 fps= 60 q=-1.0 size=N/A time=00:02:48.43 bitrate=N/A speed=1.01x \nframe=10141 fps= 60 q=-1.0 size=N/A time=00:02:49.01 bitrate=N/A speed=1.01x \nframe=10170 fps= 60 q=-1.0 size=N/A time=00:02:49.49 bitrate=N/A speed=1.01x \n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000041.ts' for writing\n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8.tmp' for writing\nframe=10205 fps= 60 q=-1.0 size=N/A time=00:02:50.08 bitrate=N/A speed=1.01x \nframe=10240 fps= 60 q=-1.0 size=N/A time=00:02:50.66 bitrate=N/A speed=1.01x \nframe=10275 fps= 60 q=-1.0 size=N/A time=00:02:51.24 bitrate=N/A speed=1.01x \nframe=10310 fps= 60 q=-1.0 size=N/A time=00:02:51.83 bitrate=N/A speed=1.01x \nframe=10345 fps= 60 q=-1.0 size=N/A time=00:02:52.41 bitrate=N/A speed=1.01x \nframe=10380 fps= 60 q=-1.0 size=N/A time=00:02:52.99 bitrate=N/A speed=1.01x \nframe=10415 fps= 60 q=-1.0 size=N/A time=00:02:53.58 bitrate=N/A speed=1.01x \n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000042.ts' for writing\n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8.tmp' for writing\nframe=10450 fps= 60 q=-1.0 size=N/A time=00:02:54.16 bitrate=N/A speed=1.01x \nframe=10485 fps= 60 q=-1.0 size=N/A time=00:02:54.74 bitrate=N/A speed=1.01x \nframe=10520 fps= 60 q=-1.0 size=N/A time=00:02:55.33 bitrate=N/A speed=1.01x \nframe=10555 fps= 60 q=-1.0 size=N/A time=00:02:55.91 bitrate=N/A speed=1.01x \nframe=10589 fps= 60 q=-1.0 size=N/A time=00:02:56.48 bitrate=N/A speed=1.01x \nframe=10624 fps= 60 q=-1.0 size=N/A time=00:02:57.06 bitrate=N/A speed=1.01x \nframe=10659 fps= 60 q=-1.0 size=N/A time=00:02:57.64 bitrate=N/A speed=1.01x \n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000043.ts' for writing\n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8.tmp' for writing\nframe=10694 fps= 60 q=-1.0 size=N/A time=00:02:58.23 bitrate=N/A speed=1.01x \nframe=10729 fps= 60 q=-1.0 size=N/A time=00:02:58.81 bitrate=N/A speed=1.01x \nframe=10764 fps= 60 q=-1.0 size=N/A time=00:02:59.39 bitrate=N/A speed=1.01x \nframe=10799 fps= 60 q=-1.0 size=N/A time=00:02:59.98 bitrate=N/A speed=1.01x \nframe=10834 fps= 60 q=-1.0 size=N/A time=00:03:00.56 bitrate=N/A speed=1.01x \nframe=10869 fps= 60 q=-1.0 size=N/A time=00:03:01.14 bitrate=N/A speed=1.01x \nframe=10904 fps= 60 q=-1.0 size=N/A time=00:03:01.73 bitrate=N/A speed=1.01x \n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000044.ts' for writing\n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8.tmp' for writing\nframe=10939 fps= 60 q=-1.0 size=N/A time=00:03:02.31 bitrate=N/A speed=1.01x \nframe=10974 fps= 60 q=-1.0 size=N/A time=00:03:02.89 bitrate=N/A speed=1.01x \nframe=11009 fps= 60 q=-1.0 size=N/A time=00:03:03.48 bitrate=N/A speed=1.01x \nframe=11044 fps= 60 q=-1.0 size=N/A time=00:03:04.06 bitrate=N/A speed=1.01x \nframe=11078 fps= 60 q=-1.0 size=N/A time=00:03:04.63 bitrate=N/A speed=1.01x \nframe=11113 fps= 60 q=-1.0 size=N/A time=00:03:05.21 bitrate=N/A speed=1.01x \nframe=11148 fps= 60 q=-1.0 size=N/A time=00:03:05.79 bitrate=N/A speed=1.01x \n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000045.ts' for writing\n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8.tmp' for writing\nframe=11183 fps= 60 q=-1.0 size=N/A time=00:03:06.38 bitrate=N/A speed=1.01x \nframe=11218 fps= 60 q=-1.0 size=N/A time=00:03:06.96 bitrate=N/A speed=1.01x \nframe=11253 fps= 60 q=-1.0 size=N/A time=00:03:07.54 bitrate=N/A speed=1.01x \nframe=11288 fps= 60 q=-1.0 size=N/A time=00:03:08.13 bitrate=N/A speed=1.01x \nframe=11323 fps= 60 q=-1.0 size=N/A time=00:03:08.71 bitrate=N/A speed=1.01x \nframe=11358 fps= 60 q=-1.0 size=N/A time=00:03:09.29 bitrate=N/A speed=1.01x \nframe=11393 fps= 60 q=-1.0 size=N/A time=00:03:09.88 bitrate=N/A speed=1.01x \n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000046.ts' for writing\n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8.tmp' for writing\nframe=11428 fps= 60 q=-1.0 size=N/A time=00:03:10.46 bitrate=N/A speed=1.01x \nframe=11463 fps= 60 q=-1.0 size=N/A time=00:03:11.04 bitrate=N/A speed=1.01x \nframe=11498 fps= 60 q=-1.0 size=N/A time=00:03:11.63 bitrate=N/A speed=1.01x \nframe=11533 fps= 60 q=-1.0 size=N/A time=00:03:12.21 bitrate=N/A speed= 1x \nframe=11567 fps= 60 q=-1.0 size=N/A time=00:03:12.78 bitrate=N/A speed= 1x \nframe=11602 fps= 60 q=-1.0 size=N/A time=00:03:13.36 bitrate=N/A speed= 1x \nframe=11637 fps= 60 q=-1.0 size=N/A time=00:03:13.94 bitrate=N/A speed= 1x \n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000047.ts' for writing\n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8.tmp' for writing\nframe=11672 fps= 60 q=-1.0 size=N/A time=00:03:14.53 bitrate=N/A speed= 1x \nframe=11707 fps= 60 q=-1.0 size=N/A time=00:03:15.11 bitrate=N/A speed= 1x \nframe=11736 fps= 60 q=-1.0 size=N/A time=00:03:15.59 bitrate=N/A speed= 1x \nframe=11771 fps= 60 q=-1.0 size=N/A time=00:03:16.18 bitrate=N/A speed= 1x \nframe=11806 fps= 60 q=-1.0 size=N/A time=00:03:16.76 bitrate=N/A speed= 1x \nframe=11841 fps= 60 q=-1.0 size=N/A time=00:03:17.34 bitrate=N/A speed= 1x \nframe=11876 fps= 60 q=-1.0 size=N/A time=00:03:17.93 bitrate=N/A speed= 1x \n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000048.ts' for writing\n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8.tmp' for writing\nframe=11911 fps= 60 q=-1.0 size=N/A time=00:03:18.51 bitrate=N/A speed= 1x \nframe=11946 fps= 60 q=-1.0 size=N/A time=00:03:19.09 bitrate=N/A speed= 1x \nframe=11981 fps= 60 q=-1.0 size=N/A time=00:03:19.68 bitrate=N/A speed= 1x \nframe=12016 fps= 60 q=-1.0 size=N/A time=00:03:20.26 bitrate=N/A speed= 1x \nframe=12051 fps= 60 q=-1.0 size=N/A time=00:03:20.84 bitrate=N/A speed= 1x \nframe=12086 fps= 60 q=-1.0 size=N/A time=00:03:21.43 bitrate=N/A speed= 1x \nframe=12121 fps= 60 q=-1.0 size=N/A time=00:03:22.01 bitrate=N/A speed= 1x \n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000049.ts' for writing\n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8.tmp' for writing\nframe=12155 fps= 60 q=-1.0 size=N/A time=00:03:22.58 bitrate=N/A speed= 1x \nframe=12190 fps= 60 q=-1.0 size=N/A time=00:03:23.16 bitrate=N/A speed= 1x \nframe=12225 fps= 60 q=-1.0 size=N/A time=00:03:23.74 bitrate=N/A speed= 1x \nframe=12260 fps= 60 q=-1.0 size=N/A time=00:03:24.33 bitrate=N/A speed= 1x \nframe=12289 fps= 60 q=-1.0 size=N/A time=00:03:24.81 bitrate=N/A speed= 1x \nframe=12324 fps= 60 q=-1.0 size=N/A time=00:03:25.39 bitrate=N/A speed= 1x \nframe=12359 fps= 60 q=-1.0 size=N/A time=00:03:25.98 bitrate=N/A speed= 1x \n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000050.ts' for writing\n[hls @ 0x5560fbbc0400] Failed to open file '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000050.ts'\nav_interleaved_write_frame(): No such file or directory\n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000050.ts' for writing\n[hls @ 0x5560fbbc0400] Failed to open file '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000050.ts'\n[hls muxer @ 0x5560fb94f880] failed to delete old segment /data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000034.ts: No such file or directory\n[hls @ 0x5560fbbc0400] Opening '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8.tmp' for writing\n[hls @ 0x5560fbbc0400] failed to rename file /data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8.tmp to /data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0.m3u8: No such file or directory\nframe=12362 fps= 60 q=-1.0 Lsize=N/A time=00:03:26.03 bitrate=N/A speed= 1x \nvideo:163811kB audio:53kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown\nConversion failed!\n",
"ffmpegShellCommand": "ffmpeg -n 5 /usr/bin/ffmpeg -i rtmp://127.0.0.1:1935/live/2111296f-ed23-40e3-a7f3-d35a0b19af6a -y -threads 8 -c:v copy -c:a copy -map 0:a? -map 0:v? -hls_time 4 -hls_list_size 15 -hls_flags delete_segments+independent_segments+program_date_time -hls_segment_filename /data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/%v-%06d.ts -master_pl_name master.m3u8 -f hls /data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/%v.m3u8",
"tags": [
"live",
"U9SYY9U3",
"a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b"
]
}
error[14.05.2022, 21:04:31] Cannot process segments in /data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b
{
"err": {
"stack": "Error: ENOENT: no such file or directory, open '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000049.ts'",
"message": "ENOENT: no such file or directory, open '/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000049.ts'",
"errno": -2,
"code": "ENOENT",
"syscall": "open",
"path": "/data/peervideo/storage/streaming-playlists/hls/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b/0-000049.ts"
},
"tags": [
"live",
"U9SYY9U3",
"a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b"
]
}The storage is located on a local disk. Live video processing is completely disabled.
I put the nightly version back on-2022-05-10 the live video has stopped being cut off, but such errors constantly appear in the logs
error[14.05.2022, 21:22:13] Cannot execute job 371815 in queue activitypub-http-unicast.
{
"payload": {
"uri": "https://peertube.bgzashtita.es/inbox",
"signatureActorId": 1,
"body": {
"to": [
"https://www.w3.org/ns/activitystreams#Public",
"https://peervideo.ru/video-channels/games/followers",
"https://peervideo.ru/accounts/peertube/followers",
"https://peervideo.ru/accounts/onix/followers"
],
"cc": [],
"id": "https://peervideo.ru/accounts/peertube/views/videos/238571/629730d257db12a0856d8e6fdefaf2d1506960b66f250975b68246cdcf8009e4",
"type": "View",
"actor": "https://peervideo.ru/accounts/peertube",
"object": "https://peervideo.ru/videos/watch/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b",
"expires": "2022-05-14T18:23:06.338Z"
},
"contextType": "View"
},
"err": {
"stack": "RequestError: Timeout awaiting 'request' for 7000ms\n at ClientRequest.<anonymous> (/var/www/peertube/versions/peertube-nightly-2022-05-10/node_modules/got/dist/source/core/index.js:962:65)\n at Object.onceWrapper (events.js:520:26)\n at ClientRequest.emit (events.js:412:35)\n at ClientRequest.emit (domain.js:475:12)\n at ClientRequest.origin.emit (/var/www/peertube/versions/peertube-nightly-2022-05-10/node_modules/@szmarczak/http-timer/dist/source/index.js:43:20)\n at TLSSocket.socketErrorListener (_http_client.js:475:9)\n at TLSSocket.emit (events.js:400:28)\n at TLSSocket.emit (domain.js:475:12)\n at emitErrorNT (internal/streams/destroy.js:106:8)\n at emitErrorCloseNT (internal/streams/destroy.js:74:3)\n at processTicksAndRejections (internal/process/task_queues.js:82:21)\n at Timeout.timeoutHandler [as _onTimeout] (/var/www/peertube/versions/peertube-nightly-2022-05-10/node_modules/got/dist/source/core/utils/timed-out.js:36:25)\n at listOnTimeout (internal/timers.js:559:11)\n at processTimers (internal/timers.js:500:7)",
"message": "Timeout awaiting 'request' for 7000ms",
"name": "TimeoutError"
}
}
error[14.05.2022, 21:23:18] Cannot execute job 371819 in queue activitypub-http-unicast.
{
"payload": {
"uri": "https://peertube.bgzashtita.es/inbox",
"signatureActorId": 1,
"body": {
"to": [
"https://www.w3.org/ns/activitystreams#Public",
"https://peervideo.ru/video-channels/games/followers",
"https://peervideo.ru/accounts/peertube/followers",
"https://peervideo.ru/accounts/onix/followers"
],
"cc": [],
"id": "https://peervideo.ru/accounts/peertube/views/videos/238571/629730d257db12a0856d8e6fdefaf2d1506960b66f250975b68246cdcf8009e4",
"type": "View",
"actor": "https://peervideo.ru/accounts/peertube",
"object": "https://peervideo.ru/videos/watch/a1ea93fc-570a-4bfb-8cd8-adb2ce7fa40b",
"expires": "2022-05-14T18:24:11.341Z"
},
"contextType": "View"
},
"err": {
"stack": "RequestError: Timeout awaiting 'request' for 7000ms\n at ClientRequest.<anonymous> (/var/www/peertube/versions/peertube-nightly-2022-05-10/node_modules/got/dist/source/core/index.js:962:65)\n at Object.onceWrapper (events.js:520:26)\n at ClientRequest.emit (events.js:412:35)\n at ClientRequest.emit (domain.js:475:12)\n at ClientRequest.origin.emit (/var/www/peertube/versions/peertube-nightly-2022-05-10/node_modules/@szmarczak/http-timer/dist/source/index.js:43:20)\n at TLSSocket.socketErrorListener (_http_client.js:475:9)\n at TLSSocket.emit (events.js:400:28)\n at TLSSocket.emit (domain.js:475:12)\n at emitErrorNT (internal/streams/destroy.js:106:8)\n at emitErrorCloseNT (internal/streams/destroy.js:74:3)\n at processTicksAndRejections (internal/process/task_queues.js:82:21)\n at Timeout.timeoutHandler [as _onTimeout] (/var/www/peertube/versions/peertube-nightly-2022-05-10/node_modules/got/dist/source/core/utils/timed-out.js:36:25)\n at listOnTimeout (internal/timers.js:559:11)\n at processTimers (internal/timers.js:500:7)",
"message": "Timeout awaiting 'request' for 7000ms",
"name": "TimeoutError"
}
}
Describe the current behavior Constant errors during live video. In the server settings for live videos, transcoding is disabled. During breaks, the directory with .ts media files disappears, but other directories are available and open at this time. Networking between peertube and storage is stable. Also the connection between obs studio and peertube is stable. My storage is NFS mounted from a file server. All servers are on the same network. The first break occurred immediately after the start of the live broadcast. The second break is about 3 minutes later.
I recorded a video of it happening. https://peervideo.ru/w/sZAbmTLQFSMHX7FniLnujY
Steps to reproduce:
Describe the expected behavior There should be no interruptions in the connection.
PeerTube instance:
Link to server log if relevant (
journalctlor/var/www/peertube/storage/logs/):If necessary, I will show my OBS settings