IntelRealSense / librealsense

Intel® RealSense™ SDK
https://www.intelrealsense.com/
Apache License 2.0
7.58k stars 4.82k forks source link

D415 HDR on Color Sensor #11748

Closed electro-logic closed 1 year ago

electro-logic commented 1 year ago

Hello, The OV2740 sensor used by D415 according to the Omnivision product brief has some kind of HDR support https://www.ovt.com/wp-content/uploads/2023/03/OV2740-PB-v1.3b-WEB.pdf Any chance of having HDR on the color channel too?

MartyG-RealSense commented 1 year ago

Hi @electro-logic I will ask my Intel RealSense colleagues about your request. Thanks!

electro-logic commented 1 year ago

Thanks a lot

MartyG-RealSense commented 1 year ago

Hi @electro-logic My colleagues have responded to your question. The HDR that you mentioned will need to use a companion ISP (Image Signal Processing) chip which is not in RealSense products. It is therefore not supported.

electro-logic commented 1 year ago

Hello Marty, Thank you for your response. I am wondering if maybe we can only get the raw "row interleaved HDR", without merging the two half-resolution frames. Please see https://forums.developer.nvidia.com/t/jetson-xavier-nx-interleave-hdr/185225 for an example of row interleaved HDR. Thanks.

MartyG-RealSense commented 1 year ago

I will consult again with my colleagues about your suggestion. Thank you.

MartyG-RealSense commented 1 year ago

My colleagues responded that if “row interleaved HDR” is done at the host side then you are welcome to try it out in manual exposure mode.

electro-logic commented 1 year ago

Hello, thank you for asking. Is there a way to access the color OV2740 cmos sensor register? By writing the bit 0 to 0x3820 is possible to enable the HDR-lite mode that i'm interested in. Thank you again

MartyG-RealSense commented 1 year ago

I have passed your question to my colleagues.

MartyG-RealSense commented 1 year ago

The answer was no, you cannot change the OV2740 register, unfortunately.

electro-logic commented 1 year ago

Oks, thank you for asking anyway.

Camilochiang commented 1 year ago

Hei @MartyG-RealSense but actually tthere is a ISP chip in the D4 board....

MartyG-RealSense commented 1 year ago

@Camilochiang Yes, there is an ISP chip on the D4 board for processing color data but the D4 board is not designed with the capability of processing HDR for RGB. An ISP with HDR capability would likely be required.

The data sheet document for the 400 Series cameras states that the ISP used on the D4 board is a component called RTS5845. RT is Realtek. There is not a publicly available data sheet for this particular component's specifications though.