search

luxonis / depthai-python

DepthAI Python Library
MIT License
361 stars 192 forks source link

OAK-FFC-6P + AR0234: Not even the startup guide works #818

Closed peci1 closed 1 year ago

peci1 commented 1 year ago

Hi, I've just received OAK-FFC-6P. I connected two AR0234 to ports A and B, the 5 V supply and USB cable.

I succesfully ssh'd into the board and updated OS to 1.8 and firmware to the latest.

Then I followed this tutorial: https://docs.google.com/document/d/1r3en4EqgDG3hum8o5yS1DJ5vSCb6aNqyA38tIM8723U/edit . None of the "end-commands" worked - neither "save 10 frames", neither "start RTSP".

Then I tried this tutorial: https://docs.luxonis.com/projects/hardware/en/latest/pages/DM3390.html#developing-with-the-oak-ffc . The command said it can't find any camera. I even forced the correct IP address via custom DeviceInfo in the script, but still no joy. Wireshark shows that when I run the script, one UDP packet is sent via unicast to the camera (a few bytes), and one UDP packet is sent back (~60 bytes). Then ARP comms follow, successfully returning the MAC of the board. As I said, the link layer works, as I can ssh into the board.

I also noticed the board likes to change its SSH host key so that I have to often manually remove the previously remembered key before ssh lets me in the next time.

Here's a log of my try:

[M:3rd:map:common:subt] (rvc3_develop *=)$ ssh root@192.168.197.55
The authenticity of host '192.168.197.55 (192.168.197.55)' can't be established.
ECDSA key fingerprint is SHA256:xDSjNGAWRKt/QQRjFP9JlNnMK9U6pQOv+hXZoCUgIZs.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '192.168.197.55' (ECDSA) to the list of known hosts.
root@keembay:~# source ./res/env_set.sh 
-sh: /opt/openvino/bin/setupvars.sh: No such file or directory
Setting environment for B0 unified stack
root@keembay:~# StartVpu vpu_ipc_b0.bin 

Callback signal handler installed

Opening XLink Device File
Num devices: 1
Failed to reset vpu slice: 0
Loading VPU Firmware file: vpu_ipc_b0.bin for vpu slice 0(status:0)
Started vpu slice 0(status:2)
root@keembay:~# mediapipe2 -l res/launch_camera_rtsp.txt -c res/config_rtsp.json
Config file is res/config_rtsp.json
Launch file is res/launch_camera_rtsp.txt
Config file is res/config_rtsp.json
Launch file is res/launch_camera_rtsp.txt
vaapi driver info: Found Core[0] HwBuildID: 0x1f50
vaapi driver info: Found Core[1] HwBuildID: 0x1f51
vaapi driver info: Found Core[0] HwBuildID: 0x1f50
vaapi driver info: Found Core[1] HwBuildID: 0x1f51

(gst-plugin-scanner:784): GStreamer-WARNING **: 13:52:17.475: Failed to load plugin '/usr/lib/gstreamer-1.0/libgstvideoanalytics.so': libopencv_imgproc.so.405: cannot open shared object file: No such file or directory

(gst-plugin-scanner:784): GStreamer-WARNING **: 13:52:17.809: Failed to load plugin '/usr/lib/gstreamer-1.0/libgstvas.so': libopencv_imgproc.so.405: cannot open shared object file: No such file or directory

(gst-plugin-scanner:784): GStreamer-WARNING **: 13:52:17.855: Failed to load plugin '/usr/lib/gstreamer-1.0/libgvatrack.so': libopencv_core.so.405: cannot open shared object file: No such file or directory

(gst-plugin-scanner:784): GStreamer-WARNING **: 13:52:18.790: Failed to load plugin '/usr/lib/gstreamer-1.0/libgstaudioanalytics.so': libopenvino.so: cannot open shared object file: No such file or directory

(gst-plugin-scanner:784): GStreamer-WARNING **: 13:52:18.792: Failed to load plugin '/usr/lib/gstreamer-1.0/libgstremoteoffload.so': libgstremoteoffloadcore.so: cannot open shared object file: No such file or directory
KMB_ERR:  kmb_media_populate_eeprom_devices:239 Read eeprom device id /sys/bus/i2c/devices//0-0051/of_node/phandle does not have phandle 

(gst-plugin-scanner:784): GStreamer-WARNING **: 13:52:19.105: Failed to load plugin '/usr/lib/gstreamer-1.0/libgstgapiosd.so': libopencv_imgproc.so.405: cannot open shared object file: No such file or directory
KMB_ERR:  kmb_media_populate_eeprom_devices:239 Read eeprom device id /sys/bus/i2c/devices//0-0051/of_node/phandle does not have phandle 

vaapi driver info: Found Core[0] HwBuildID: 0x1f50
vaapi driver info: Found Core[1] HwBuildID: 0x1f51
vaapi driver info: Found Core[0] HwBuildID: 0x1f50
vaapi driver info: Found Core[1] HwBuildID: 0x1f51
[INFO] module_list: [ mp_element_module mp_rtsp_module mp_openvino_tracking_module mp_mix3_module mp_encoder_module mp_changeformat_module mp_onvif_module ]
Set element: src1_caps caps=video/x-raw(memory:DMABuf),format=NV12,width=4056,height=3040
Set element: enc1_caps caps=video/x-h264,stream-format=byte-stream,profile=main
Set element: src2_caps caps=video/x-raw(memory:DMABuf),format=NV12,width=1920,height=1080
Set element: enc2_caps caps=video/x-h264,stream-format=byte-stream,profile=high
Set element: src3_caps caps=video/x-raw(memory:DMABuf),format=NV12,width=1280,height=720
Set element: enc3_caps caps=video/x-h264,stream-format=byte-stream,profile=high
[WARNING] ### set propety failed Can not find element 'enc4_caps' ###

rtsp address: rtsp://(null):8554/test1
rtsp address: rtsp://(null):8554/test2
rtsp address: rtsp://(null):8554/test3
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_rtsp.c, line168: json_get_int failed
[WARNING] Add callback failed, can not find element "enc4"
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_rtsp.c, line540: create_callback_context failed
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_rtsp.c, line176: mediapipe_rtsp_server_new failed
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_rtsp.c, line189: json_get_int failed
[WARNING] Add callback failed, can not find element "enc4"
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_rtsp.c, line677: create_callback_context failed
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_rtsp.c, line197: mediapipe_merge_av_rtsp_server_new failed
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_rtsp.c, line189: json_get_int failed
[WARNING] Add callback failed, can not find element "enc4"
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_rtsp.c, line677: create_callback_context failed
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_rtsp.c, line197: mediapipe_merge_av_rtsp_server_new failed
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_rtsp.c, line189: json_get_int failed
[WARNING] Add callback failed, can not find element "enc4"
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_rtsp.c, line677: create_callback_context failed
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_rtsp.c, line197: mediapipe_merge_av_rtsp_server_new failed
[WARNING] Add callback failed, can not find element "mix1_src"
[WARNING] Add callback failed, can not find element "mix2_src"
[WARNING] Add callback failed, can not find element "mix3_src"
[WARNING] Onvif json object of config file have no video_enc1!
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_onvif.c, line1634: get_element_name_from_mp_config failed
[WARNING] Onvif json object of config file have no video_enc2!
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_onvif.c, line1638: get_element_name_from_mp_config failed
[WARNING] Onvif json object of config file have no video_enc3!
[WARNING] /usr/src/debug/ipc-mediapipe/1.0.1+AUTOINC+99bd562d33-git/git/src/modules/mp_onvif.c, line1642: get_element_name_from_mp_config failed
[INFO] Communication server listen at: 8889
vaapi driver info: Found Core[0] HwBuildID: 0x1f50
vaapi driver info: Found Core[1] HwBuildID: 0x1f51
vaapi driver info: Found Core[0] HwBuildID: 0x1f50
vaapi driver info: Found Core[1] HwBuildID: 0x1f51
KMB_ERR:  kmb_media_get_name_by_type:530 Invalid camera id 0!
KMB_ERR:  kmb_media_get_name_by_type:530 Invalid camera id 0!
KMB_ERR:  kmb_isp_guzzi_create:1343 Cannot create ISP adapter without ISP subdevice name!
KMB_ERR:  kmb_ctrl_guzzi_adapters_create:3153 Error! Could not create isp adapter!

[ERROR] ERROR: Cannot create control adapter!

[ERROR] [Debug details: kmbcamsrc.c(4318): kmbcamsrc_create_adapters (): /GstPipeline:pipeline0/KmbCamSrc:kmbsrc:
system error: No such file or directory]

root@keembay:~# logout
Connection to 192.168.197.55 closed.
peci1@cras-17:/media/data/depthai/depthai-python
[M:3rd:map:common:subt] (rvc3_develop *=)$ PYTHONPATH= python3.6 utilities/cam_test.py --cameras rgb,c left,c
Enabled cameras:
    rgb : color
   left : color
DepthAI version: 2.21.2.0
DepthAI path: /home/peci1/.local/lib/python3.6/site-packages/depthai.cpython-36m-x86_64-linux-gnu.so
Traceback (most recent call last):
  File "utilities/cam_test.py", line 206, in <module>
    with dai.Device(pipeline, device_info) as device:
RuntimeError: Cannot find any device with given deviceInfo
Erol444 commented 1 year ago

Hi @peci1 , We apologize for the inconvenience. We updated the tutorial last week, could you perhaps try it out? https://docs.luxonis.com/projects/hardware/en/latest/pages/DM3390.html#getting-started Thanks, Erik

kuepe-sl commented 6 months ago

I'm afraid that this is still an issue.

I was trying to use the AR0234 camera with

Most of the guide works well now and the cam_test.py script connects to the board just fine.
But it is unable to find the camera, no matter at which port you connect it: Connected cameras: []

According to the support forum, the AR0234 camera is not supported with the OAK-FFC-6P. (reference)

It would be nice if you could keep the issue open until there is a firmware update that adds support for the camera.

Erol444 commented 6 months ago

Hi @kuepe-sl , I believe it's best to refund for the cam module. AR0234 itself is supported, but the FFC-AR0234 is not, and with RVC4 around the corner we rather spend engineering effort on that platform. Thank you for understanding.