search

dji-sdk / Manifold-Cam

The project realizes to get the video data from X3 camera on M100.
34 stars 25 forks source link

Possible on NVIDIA Jetson TK1 (very close to manifold)? #8

Open Shikhargupta opened 8 years ago

Shikhargupta commented 8 years ago

'A Nvidia provided decoding chip is necessary together with a .so library, which is also from Nvidia. And the cable/port is specially designed.'

Jetson has the decoding chip and .so library but lacks in port. Is there any way to get it work using GPIO or anything else?

lanyusea commented 8 years ago

yes but sorry I cannot tell you :( It's confidential

Shikhargupta commented 8 years ago

Found it. :)

apollo-time commented 8 years ago

Could you connect the DJI camera into NVIDIA Jetson TK1 and successfully catch frame data from the TK1 board real-time? Please teach me thanks.

apollo-time commented 8 years ago

Can I draw output some custom information such as detected face rectangle on the camera frame with the manifold?

lanyusea commented 8 years ago

yes you can, with Manifold.

apollo-time commented 8 years ago

How can I it? Please teach me.

lanyusea commented 8 years ago

check the code in this repo for reading video streams check opencv tutorial for face detection and drawing rectangle

apollo-time commented 8 years ago

I found the manifold_cam_read api, but can't found the manifold_cam_write. Which buffer I can draw output on?

lanyusea commented 8 years ago

You may need to try Mobile SDK if you want to display in on the DJI GO of you Mobile device.

The Manifold only has decoding module to decode the video buffer received from the drone, but has not encoding module to encode video and send it to your mobile.

apollo-time commented 8 years ago

I can detect face on the Manifold with camera frame real-time. Now how can receive the face detection result from manifold on the Mobile SDK? Can I send the meta data such as face position from Manifold to mobile device via wireless?

lanyusea commented 8 years ago

I mean you can do the detection and drawing on Mobile SDK directly.

If you want to transmit the result from Manifold to Mobile device, you can use Data Transparent Transmission.

maxsmo3 commented 8 years ago

Wouldn't it be difficult to transmit an image using Data Transparent Transmission, having to break it up into 100 Byte packets?

lanyusea commented 8 years ago

yes difficult. so you can just send the result

apollo-time commented 8 years ago

How can I capture the camera frame real-time on my mobile device or windows PC? And what is max frame resolution with streaming on client? Is support RTSP protocol the camera on the drone?

lanyusea commented 8 years ago

there are some APIs in DJI Mobile SDK to help you get the real-time video buffer

CWOA commented 6 years ago

@Shikhargupta did you ever manage to get the camera image in OpenCV using an alternative computer? I'm trying to use the Jetson TX2 with a Zenmuse X3 camera onboard a M100

Shikhargupta commented 6 years ago

@CWOA No, I couldn't.

zhuangxinfa commented 4 years ago

'A Nvidia provided decoding chip is necessary together with a .so library, which is also from Nvidia. And the cable/port is specially designed.'

Jetson has the decoding chip and .so library but lacks in port. Is there any way to get it work using GPIO or anything else?

Do you have a solution? I need your advice