search

jdibenes / hl2ss

HoloLens 2 Sensor Streaming. Real-time streaming of HoloLens 2 sensor data over WiFi. Research Mode and External USB-C A/V supported.
Other
203 stars 51 forks source link

AHAT depth camera VideoProfile configuration modes #50

Open vstadnytskyi-FDA opened 1 year ago

vstadnytskyi-FDA commented 1 year ago

The example for AHAT depth camera configuration has several modes for VideoProfile profile = hl2ss.VideoProfile.H265_MAIN

What do these settings do?

jdibenes commented 1 year ago

RAW: Video frames are sent as-is, without compression or preprocessing. Best quality images but very high bandwidth usage resulting in network saturation, high latency, and low framerates. H264: Video frames are compressed using the H264 encoder. Compression is lossy but bandwidth usage is reduced significantly (by a factor between 50x-100x) enabling full framerate streaming. Higher profiles (BASE < MAIN < HIGH) = more efficient encoding. H265: Video frames are compressed using the HEVC encoder. More efficient than H264. Also full framerate. mro: that's a Python thing, not a video profile. For AHAT in particular, the depth and AB frames are preprocessed to fit both (16 bpp each) into a single NV12 frame (12 bpp).