Open Vench1 opened 4 weeks ago
I have the same issue with one frame has been sent
but no display.
Are you using a real camera? I have tried resizing my rpi cam v2 down to 640 x 480 but still get the same result even though I am waiting and it does detect a frame being sent. So this leads me to believe something is wrong with tracking: https://github.com/zang09/ORB_SLAM3_ROS2/blob/00c54335ccc010d74c1e24e336aa817604124947/src/monocular/monocular-slam-node.cpp#L42
However as soon as I switch from real camera to a ros2 bag file (Viconeasy 101 easy for example) it tracks fine and I see the images + tracking path
Having the same issue. Any breakthroughs?
I have the same issue with
one frame has been sent
but no display.Are you using a real camera? I have tried resizing my rpi cam v2 down to 640 x 480 but still get the same result even though I am waiting and it does detect a frame being sent. So this leads me to believe something is wrong with tracking:
However as soon as I switch from real camera to a ros2 bag file (Viconeasy 101 easy for example) it tracks fine and I see the images + tracking path
Hi, @dirksavage88. Yes, I'm using a real camera. I think 640 x 480 is adequate as well. Recently I realized that I just have to wait about 15-25 minutes and the picture will appear, but it is unbearable.
I found another solution:
ros2 run orbslam3 mono /your/path/to/ORBvoc.txt /your/path/to/TUM1. yaml
After that, you need to go and move your robot or camera around a bit (translate and rotate a certain distance). Surprisingly, it's very quick to get a picture (10 seconds or so).I think it's orb-slam3 that needs the camera to have a certain translation when it's initialized, although this seems to be often used to initialize imu, but this worked for me. So you might as well try moving your robot or camera at the beginning when using a real camera.
Having the same issue. Any breakthroughs?
Hi, @mruck03 . After running your code, you can try to move your robot or camera to make it have a certain translation and rotation. This seems to make orb-slam3 initialize quickly. When I tried it, I found that it can run normally in about 10 seconds. For details, please refer to the reply above. I hope it helps you.
@Vench1 thanks, it was just a matter of moving the camera and then waiting patiently. It looks like even with an rpi cam it can work! Definitely doesn't do well with motion blur and any blank walls, but those are known limitations
I tried to test orb-slam3 using
ros2 run orbslam3 mono /home/zjp/ORB/ORB_SLAM3/Vocabulary/ORBvoc.txt /home/zjp/ORB/ORB_SLAM3/Examples/Monocular/TUM1.yaml
. I modified the image topic in _ORB_SLAM3ROS2/src/monocular/monocular-slam-node.cpp in advance to the topic published by my oak-d camera. I also checked it withrqt_graph
, but it still shows a black screen and WAITING FOR IMAGES. It is also blank in the map viewer.I saw someone say it is because of the camera resolution, but I actually only use 320×180 images. I checked the bandwidth and it is only 2M. Someone else said that you can try it a little longer. He mentioned that he went to the bathroom to wash his hands and came back to find that it was running normally (here). Now, my hands are as clean as they can be, but I am still WAITING FOR IMAGES.
Does anyone have any thoughts on this issue?