RosettaDrone / rosettadrone

MAVlink and H.264 Video for DJI drones
BSD 3-Clause "New" or "Revised" License
306 stars 116 forks source link

Camera feed is compatible with MAVLink? #220

Open angel-ayala opened 2 months ago

angel-ayala commented 2 months ago

Is your feature request related to a problem? Please describe.

Hi, I was wondering if the camera feed are in the MAVLink protocol, to have a centralized sensor communication as standard. I found this repo and it seems interesting to be appearing the drones video feed.

Describe the solution you'd like

Describe alternatives you've considered

No response

Additional context

As mentioned in #219, that the video feed freezes when the YUV data is decoded and transmitted. Maybe can be assured a full MAVLink compatibility, proxying the drone sensors and actuators through the protocol.

kripper commented 2 months ago

I don't know if the MAVLink messages regarding video streaming are mature or supported by QGC. I would test gstreamer with WebRTC and provide the QGC team with the gstreamer command-line to support RD + WebRTC. And also ask them if they support some MAVLink messages to setup QGC's video stream receiver.

kripper commented 2 months ago

I'm not sure If I understood correctly your issue.

angel-ayala commented 2 months ago

I don't know if the MAVLink messages regarding video streaming are mature or supported by QGC.

I also don't know that, I just was wondering if the current code of RD has enabled the camera service to centralize the sensor readings. My idea is to get all readings through a python script using DroneKit-Python. If QGC supports it is also an open question.

However, I was thinking that maybe the MAVLink camera manager could be used to check the camera services availability.

kripper commented 2 months ago

I implemented some camera trigger and movement mavlink messages for the MissionManager class, but I didn't do anything with the camera discovery messages.

If you need them, it's good to implement the corresponding mavlink messages.

If the mavlink messages definition is incomplete, you can contact the mavlink team and propose adding new messages and parameters.