princeton-vl / DROID-SLAM

BSD 3-Clause "New" or "Revised" License
1.65k stars 272 forks source link

Take real-time footage from gopro camera on demo.py #99

Open zapmxl opened 1 year ago

zapmxl commented 1 year ago

Hello there I'd like edit the demo.py to take the live footage from my camera I found the code to make the camera work wirelessly but i don't know how to implement it inside demo.py and make live-SLAM (since i'm still a novice) any help would be greatly apreciated

moaazassali commented 1 year ago

I am facing the same issue. Have you found any solution?

pytholic commented 1 year ago

@zapmxl @moaazassali Hi. Have you guys found a way to run it with a live camera feed from something like GoPro or a webcam?

zhangjd1029 commented 1 year ago

@pytholic @moaazassali @zachteed Hello, have you solved it yet? Can you share the code

pytholic commented 1 year ago

@zhangjd1029 Hi. I don't have access to that codebase anymore, it is private. But it wasn't hard. You need to change image_stream function to use webcam instead of reading from directory. I was also able to send these images to YoloV8 and get realtime segmentation. You can also use some other devices. I was using IP Webcam app on S8 ultra tablet.

zhangjd1029 commented 1 year ago

@pytholic Okay, thank you. I will try according to your suggestion. In addition, I am also using a webcam to do some remote SLAM, but the results are always affected by the camera's pixels and distortion, which may be related to the cheaper camera I use. Do you have this confusion? What brand of webcam are you using? thanks

pytholic commented 1 year ago

@zhangjd1029 I would recommend using 1080p cam. I was using Anker webcam.

pytholic commented 1 year ago

@zhangjd1029 Distortion and low quality will definitely cause some issues.

zhangjd1029 commented 1 year ago

@pytholic ok! Thank you