Ive been working on a project for my Orange pi 5 Plus for computer vison and wanted to use the HDMI input for real time video input without network pipelining. from all my testings ive come across 0 solution to get real time sub frame latency, best i could accomplish was 2 seconds at 30fps.
Ive used gstreamer, v4l2 test utility, ffmpeg, mpv, ffplay and even orange pi's test_hdmiin.sh
Ive used this repo from nyanmisaka which was the furthest to getting realtime i could get
https://github.com/nyanmisaka/ffmpeg-rockchip which uses MPP and RGA
my ffmpeg command line was ffmpeg -re -f v4l2 /dev/video20 -c:v hevc_rkmpp -qp_init 10 /root/Desktop/test.mp4
I've used Parsec, Moonlight & Sunshine for low latency gaming which pipelines video via at home network LAN by software to software, id like to be able to plug and play my HDMI cable to the input to process in whatever way possible to achieve desirability for hardware to hardware. i just dont understand how software to software pipeline is better than hardware to hardware pipeline..?
Im currently using Orangepi5plus_1.0.8_ubuntu_jammy_desktop_xfce_linux5.10.160 -- 5.10.160-rockchip-rk3588
Thanks guys, get back to me soon.
Ive posted the same issue on rockchip-linux/mpp and got no response
below is a example video of what id like to accomplish, this is a latency test using parsec.
N0tiK44
commented
2 weeks ago
Hi all
Ive been working on a project for my Orange pi 5 Plus for computer vison and wanted to use the HDMI input for real time video input without network pipelining. from all my testings ive come across 0 solution to get real time sub frame latency, best i could accomplish was 2 seconds at 30fps.
Ive used gstreamer, v4l2 test utility, ffmpeg, mpv, ffplay and even orange pi's test_hdmiin.sh Ive used this repo from nyanmisaka which was the furthest to getting realtime i could get https://github.com/nyanmisaka/ffmpeg-rockchip which uses MPP and RGA my ffmpeg command line was ffmpeg -re -f v4l2 /dev/video20 -c:v hevc_rkmpp -qp_init 10 /root/Desktop/test.mp4
I've used Parsec, Moonlight & Sunshine for low latency gaming which pipelines video via at home network LAN by software to software, id like to be able to plug and play my HDMI cable to the input to process in whatever way possible to achieve desirability for hardware to hardware. i just dont understand how software to software pipeline is better than hardware to hardware pipeline..?
Im currently using Orangepi5plus_1.0.8_ubuntu_jammy_desktop_xfce_linux5.10.160 -- 5.10.160-rockchip-rk3588
Thanks guys, get back to me soon.
Ive posted the same issue on rockchip-linux/mpp and got no response
below is a example video of what id like to accomplish, this is a latency test using parsec.
https://github.com/rockchip-linux/kernel/assets/141003308/e6b0e1c5-317c-4e74-ab35-1b8ae4704148