perform alignment on GPU

bmegli / realsense-network-hardware-video-encoder

Realsense hardware encoded color/ir H.264 and color/ir/depth HEVC streaming

Mozilla Public License 2.0

23 stars 3 forks source link

Open bmegli opened 4 years ago

bmegli commented 4 years ago

Part of #23

There was some work in librealsense for GLSL processing blocks. There is also GLSL example.

bmegli commented 4 years ago

Side note:

rs2_gl_create_yuy_decoder could be used when aligning to depth
because we can't align to depth with YUYV
and currently we probably use software conversion path in librealsense (needs checking)

bmegli commented 4 years ago

And the C++ version rs2::gl::align

bmegli commented 4 years ago

We clearly need development headers and link with realsense2-gl for this:

# Ubuntu 18.04
sudo apt-get install librealsense2-gl-dev

# CMake
target_link_libraries(realsense-nhve-depth-color nhve realsense2 realsense2-gl)

bmegli commented 4 years ago

Proof of concept implemented in 99bb1f7.

By watching htop, intel_gpu_top and nvidia-smi with and without GL acceleration I can see that:

bmegli commented 4 years ago

On the receiving side I get black screen with GL acceleration enabled (on sender).

There is some problem - maybe the data is not downloaded to CPU side for sending.

xsol commented 1 year ago

It seems like you didn't call rs2::init_rendering(), for me this made the difference between blank screen and output as described here https://github.com/IntelRealSense/librealsense/issues/11827

Arun-Prasad-V commented 7 months ago

Hi @bmegli, Please refer the PR https://github.com/IntelRealSense/librealsense/pull/12556. An example for Align-GL has been added to the development branch.

Thanks.