search

tum-vision / lsd_slam

LSD-SLAM
GNU General Public License v3.0
2.62k stars 1.23k forks source link

how to use DJI Phantom 4 for live LSD SLAM #291

Open Nish160 opened 6 years ago

Nish160 commented 6 years ago

Hi, I have been able to successfully run LSD SLAM on example datasets and my own datasets. I have also tried out Live LSD SLAM with my laptop's webcam. Now I want to run Live LSD SLAM with my drone- DJI Phantom 4 so that when I am flying the drone , the video stream generated is sampled into frames and directly fed to live LSD SLAM for point cloud generation in real time.

Any idea how to get started?

bespoke-code commented 6 years ago

If I am not mistaken, you can't get Phantom's video stream to be shown on a PC using DJI's app or any other physical or wireless connection.

To access the image stream in code, you'll need DJI's SDK. AFAIK, DJI's SDK is supported only on certain mobile device platforms. This may mean that you'd have to build an Android/iOS app around LSD-SLAM's code in order to run the algorithm in real-time.

I'd skip real-time mapping with the drone because porting from ROS to Android/iOS + developing an app would mean a lot of effort and time to get it tested. Why not run LSD-SLAM on a dataset after recording a video instead?

If you're into porting LSD-SLAM to android/iOS, please have a go! :)