search

realizator / StereoPi-ROS-depth-map-test

Quick test of DM building in ROS
20 stars 6 forks source link

Usage on CM4 and RPI camera 3 wide noir #2

Open roy-Rik99 opened 5 days ago

roy-Rik99 commented 5 days ago

Can I use this on a RPI CM4 with two RPI Camera 3 wide noir with 1280x720, fps=60-90?

I am building an uav with this setup to do simple object tracking. I am also thinking of using vl53l0x sensor for 3D mapping.

realizator commented 5 days ago

The hardware part is a bottleneck: 1280x720 at 60 FPS is hard to achieve. Even if you tune it, the CPU won't be able to process this amount of data. The only way is to stream the video to a powerful PC for post-processing.

roy-Rik99 commented 4 days ago

What if I used the latest AI camera and the upcoming CM5? Would it be possible?

realizator commented 3 days ago

I believe CM5 will let you capture HD@60, but I'm not sure about processing power. AI camera is a very specific thing; it won't help in this case. You can "emulate" this test using RPi5. Main point: CM5 and RPi5 do not support old video subsystem MMAL/raspivid/raspistill. This means you need to use two libcamera instances, which are hard to synchronize (until you go with the hardware cameras to sync).