luxonis / depthai-ros

Official ROS Driver for DepthAI Sensors.
MIT License
239 stars 173 forks source link

[BUG] Camera frequency not respected since 2.8.1 #429

Closed BriceRenaudeau closed 7 months ago

BriceRenaudeau commented 8 months ago

Branch: ROS Iron Camera: OAK-D-Pro W

Describe the bug Since release 2.8.1 the camera topic frequency has been wrong and unstable (should be 15Hz): camera_info_wrong_frequency

Expected behavior It was working great on 2.8.0: camera_info_right_frequency

BriceRenaudeau commented 8 months ago
/**:
  ros__parameters:
    rgb:
      i_disable_node: true # no rgb
    camera:
      i_enable_imu: false
      i_enable_ir: true
      i_floodlight_brightness: 0
      i_ip: ''
      i_laser_dot_brightness: 1100 #1100
      i_mx_id: ''
      i_nn_type: none
      i_pipeline_type: depth
      i_usb_port_id: ''
      i_usb_speed: HIGH
      i_pipeline_dump: true
      i_calibration_dump: false
      i_external_calibration_path: ''
    left:
      i_board_socket_id: 1
      i_calibration_file: ''
      i_get_base_device_timestamp: false
      i_fps: 15.0
      i_height: 720
      i_low_bandwidth: false # To reduce bandwith for POE cam
      i_low_bandwidth_quality: 50
      i_max_q_size: 30
      i_publish_topic: true
      i_simulate_from_topic: false
      i_disable_node: false
      i_resolution: '400'
      i_width: 1280
      r_exposure: 1000
      r_iso: 800
      r_set_man_exposure: false
    right:
      i_board_socket_id: 2
      i_calibration_file: ''
      i_get_base_device_timestamp: false
      i_fps: 15.0
      i_height: 720
      i_low_bandwidth: false
      i_low_bandwidth_quality: 50
      i_max_q_size: 30
      i_publish_topic: false
      i_simulate_from_topic: false
      i_disable_node: false
      i_resolution: '400'
      i_width: 1280
      r_exposure: 1000
      r_iso: 800
      r_set_man_exposure: false
    stereo:
      i_align_depth: false                      # Align with color, not needeed
      i_subpixel: true                          # Allowing further maximum distance, and better accuracy w/in given range. https://docs.luxonis.com/projects/api/en/latest/tutorials/configuring-stereo-depth/#stereo-subpixel-mode
      i_get_base_device_timestamp: false
      i_output_disparity: false                 # For WSL filter
      i_bilateral_sigma: 0                      # For Bilateral Sigma filter
      i_board_socket_id: 2
      i_depth_filter_size: 0                    # For median filter. Disabled as no compatible with extended disparity
      i_disparity_width: DISPARITY_96           # Disparity search range: 64 or 96 pixels are supported by the HW.
      i_set_disparity_to_depth_use_spec_translation: false # To use calibration setero entrax
      i_enable_companding: true                # Disparity companding using sparse matching. Matching pixel by pixel for N disparities. Matching every 2nd pixel for M disparitites. Matching every 4th pixel for T disparities. In case of 96 disparities: N=48, M=32, T=16. This way the search range is extended to 176 disparities, by sparse matching. Note: when enabling this flag only depth map will be affected, disparity map is not
      i_extended_disp: true                     # Supporting closer-in minimum depth (by a factor of 2): Extended disparity
      i_subpixel_fractional_bits: 5              # Increase to 5 to reduce layering effect
      # i_depth_preset: HIGH_ACCURACY           # Conflicts with some other params when manually set. HIGH_ACCURACY: prefers accuracy over density. More invalid depth values, but less outliers.
      i_enable_decimation_filter: false         # For decimation filter
      i_decimation_filter_decimation_factor: 2  # For decimation filter. Not used
      i_enable_distortion_correction: true      # For correcting lense distorsion, should be left to true
      i_enable_spatial_filter: false            # For Spation filter. Not used
      i_spatial_filter_hole_filling_radius: 2   #
      i_spatial_filter_alpha: 0.5               #
      i_spatial_filter_delta: 20                #
      i_spatial_filter_iterations: 1            #
      i_enable_speckle_filter: false            # For speckle filter. To check
      i_speckle_filter_speckle_range: 200
      i_enable_temporal_filter: false           # For temporal filter, not used (no sense on a moving robot)
      i_enable_threshold_filter: true          # For range filtering. To check
      i_threshold_filter_min_range: 0
      i_threshold_filter_max_range: 5000
      i_height: 720
      i_low_bandwidth: false
      i_low_bandwidth_quality: 50
      i_lr_check: true                        # Eliminating shadowing from running disparity in only one direction: left/right check (runs disparity in both directions)
      i_lrc_threshold: 10
      i_max_q_size: 30
      i_rectify_edge_fill_color: 0
      i_stereo_conf_threshold: 150
      i_width: 1280
      i_enable_brightness_filter: true
      i_brightness_filter_min_brightness: 10
      i_brightness_filter_max_brightness: 254
Serafadam commented 8 months ago

Hi, thanks for the report few minor questions:

BriceRenaudeau commented 8 months ago

We are using:

..._pipeline.json:

{"connections":[{"node1Id":7,"node1Output":"out","node1OutputGroup":"","node2Id":8,"node2Input":"in","node2InputGroup":""},{"node1Id":3,"node1Output":"out","node1OutputGroup":"","node2Id":5,"node2Input":"right","node2InputGroup":""},{"node1Id":0,"node1Output":"out","node1OutputGroup":"","node2Id":5,"node2Input":"left","node2InputGroup":""},{"node1Id":5,"node1Output":"depth","node1OutputGroup":"","node2Id":6,"node2Input":"in","node2InputGroup":""},{"node1Id":4,"node1Output":"out","node1OutputGroup":"","node2Id":3,"node2Input":"inputControl","node2InputGroup":""},{"node1Id":2,"node1Output":"out","node1OutputGroup":"","node2Id":0,"node2Input":"inputControl","node2InputGroup":""},{"node1Id":0,"node1Output":"out","node1OutputGroup":"","node2Id":1,"node2Input":"in","node2InputGroup":""}],"globalProperties":{"calibData":null,"cameraTuningBlobSize":null,"cameraTuningBlobUri":"","leonCssFrequencyHz":700000000.0,"leonMssFrequencyHz":700000000.0,"pipelineName":null,"pipelineVersion":null,"sippBufferSize":18432,"sippDmaBufferSize":16384,"xlinkChunkSize":-1},"nodes":[[0,{"id":0,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":30,"name":"out","queueSize":8,"type":0,"waitForMessage":false}],[["","raw"],{"blocking":false,"group":"","id":29,"name":"raw","queueSize":8,"type":0,"waitForMessage":false}],[["","frameEvent"],{"blocking":false,"group":"","id":28,"name":"frameEvent","queueSize":8,"type":0,"waitForMessage":false}],[["","inputControl"],{"blocking":true,"group":"","id":27,"name":"inputControl","queueSize":8,"type":3,"waitForMessage":false}]],"name":"MonoCamera","properties":{"boardSocket":1,"cameraName":"","fps":15.0,"imageOrientation":0,"initialControl":{"aeLockMode":false,"aeRegion":{"height":0,"priority":0,"width":0,"x":0,"y":0},"afRegion":{"height":0,"priority":0,"width":0,"x":0,"y":0},"antiBandingMode":0,"autoFocusMode":3,"awbLockMode":false,"awbMode":0,"brightness":0,"chromaDenoise":0,"cmdMask":0,"contrast":0,"effectMode":0,"expCompensation":0,"expManual":{"exposureTimeUs":0,"frameDurationUs":0,"sensitivityIso":0},"frameSyncMode":0,"lensPosAutoInfinity":0,"lensPosAutoMacro":0,"lensPosition":0,"lowPowerNumFramesBurst":0,"lowPowerNumFramesDiscard":0,"lumaDenoise":0,"saturation":0,"sceneMode":0,"sharpness":0,"strobeConfig":{"activeLevel":0,"enable":0,"gpioNumber":0},"strobeTimings":{"durationUs":0,"exposureBeginOffsetUs":0,"exposureEndOffsetUs":0},"wbColorTemp":0},"isp3aFps":0,"numFramesPool":3,"numFramesPoolRaw":3,"rawPacked":null,"resolution":1}}],[1,{"id":1,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":26,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":{"maxFpsLimit":-1.0,"metadataOnly":false,"streamName":"left_mono"}}],[2,{"id":2,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":25,"name":"out","queueSize":8,"type":0,"waitForMessage":false}]],"name":"XLinkIn","properties":{"maxDataSize":5242880,"numFrames":8,"streamName":"left_control"}}],[3,{"id":3,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":24,"name":"out","queueSize":8,"type":0,"waitForMessage":false}],[["","raw"],{"blocking":false,"group":"","id":23,"name":"raw","queueSize":8,"type":0,"waitForMessage":false}],[["","frameEvent"],{"blocking":false,"group":"","id":22,"name":"frameEvent","queueSize":8,"type":0,"waitForMessage":false}],[["","inputControl"],{"blocking":true,"group":"","id":21,"name":"inputControl","queueSize":8,"type":3,"waitForMessage":false}]],"name":"MonoCamera","properties":{"boardSocket":2,"cameraName":"","fps":15.0,"imageOrientation":0,"initialControl":{"aeLockMode":false,"aeRegion":{"height":0,"priority":0,"width":0,"x":0,"y":0},"afRegion":{"height":0,"priority":0,"width":0,"x":0,"y":0},"antiBandingMode":0,"autoFocusMode":3,"awbLockMode":false,"awbMode":0,"brightness":0,"chromaDenoise":0,"cmdMask":0,"contrast":0,"effectMode":0,"expCompensation":0,"expManual":{"exposureTimeUs":0,"frameDurationUs":0,"sensitivityIso":0},"frameSyncMode":0,"lensPosAutoInfinity":0,"lensPosAutoMacro":0,"lensPosition":0,"lowPowerNumFramesBurst":0,"lowPowerNumFramesDiscard":0,"lumaDenoise":0,"saturation":0,"sceneMode":0,"sharpness":0,"strobeConfig":{"activeLevel":0,"enable":0,"gpioNumber":0},"strobeTimings":{"durationUs":0,"exposureBeginOffsetUs":0,"exposureEndOffsetUs":0},"wbColorTemp":0},"isp3aFps":0,"numFramesPool":3,"numFramesPoolRaw":3,"rawPacked":null,"resolution":1}}],[4,{"id":4,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":20,"name":"out","queueSize":8,"type":0,"waitForMessage":false}]],"name":"XLinkIn","properties":{"maxDataSize":5242880,"numFrames":8,"streamName":"right_control"}}],[5,{"id":5,"ioInfo":[[["","depth"],{"blocking":false,"group":"","id":19,"name":"depth","queueSize":8,"type":0,"waitForMessage":false}],[["","rectifiedLeft"],{"blocking":false,"group":"","id":17,"name":"rectifiedLeft","queueSize":8,"type":0,"waitForMessage":false}],[["","syncedLeft"],{"blocking":false,"group":"","id":18,"name":"syncedLeft","queueSize":8,"type":0,"waitForMessage":false}],[["","syncedRight"],{"blocking":false,"group":"","id":14,"name":"syncedRight","queueSize":8,"type":0,"waitForMessage":false}],[["","rectifiedRight"],{"blocking":false,"group":"","id":13,"name":"rectifiedRight","queueSize":8,"type":0,"waitForMessage":false}],[["","outConfig"],{"blocking":false,"group":"","id":11,"name":"outConfig","queueSize":8,"type":0,"waitForMessage":false}],[["","debugExtDispLrCheckIt2"],{"blocking":false,"group":"","id":10,"name":"debugExtDispLrCheckIt2","queueSize":8,"type":0,"waitForMessage":false}],[["","debugDispCostDump"],{"blocking":false,"group":"","id":12,"name":"debugDispCostDump","queueSize":8,"type":0,"waitForMessage":false}],[["","confidenceMap"],{"blocking":false,"group":"","id":9,"name":"confidenceMap","queueSize":8,"type":0,"waitForMessage":false}],[["","debugDispLrCheckIt2"],{"blocking":false,"group":"","id":8,"name":"debugDispLrCheckIt2","queueSize":8,"type":0,"waitForMessage":false}],[["","debugDispLrCheckIt1"],{"blocking":false,"group":"","id":15,"name":"debugDispLrCheckIt1","queueSize":8,"type":0,"waitForMessage":false}],[["","debugExtDispLrCheckIt1"],{"blocking":false,"group":"","id":7,"name":"debugExtDispLrCheckIt1","queueSize":8,"type":0,"waitForMessage":false}],[["","disparity"],{"blocking":false,"group":"","id":16,"name":"disparity","queueSize":8,"type":0,"waitForMessage":false}],[["","inputConfig"],{"blocking":false,"group":"","id":6,"name":"inputConfig","queueSize":4,"type":3,"waitForMessage":false}],[["","left"],{"blocking":false,"group":"","id":5,"name":"left","queueSize":8,"type":3,"waitForMessage":true}],[["","right"],{"blocking":false,"group":"","id":4,"name":"right","queueSize":8,"type":3,"waitForMessage":true}]],"name":"StereoDepth","properties":{"alphaScaling":null,"baseline":null,"depthAlignCamera":-1,"depthAlignmentUseSpecTranslation":true,"disparityToDepthUseSpecTranslation":true,"enableRectification":true,"enableRuntimeStereoModeSwitch":false,"focalLength":null,"focalLengthFromCalibration":true,"height":null,"initialConfig":{"algorithmControl":{"centerAlignmentShiftFactor":null,"customDepthUnitMultiplier":1000.0,"depthAlign":0,"depthUnit":2,"disparityShift":0,"enableExtended":false,"enableLeftRightCheck":true,"enableSubpixel":true,"leftRightCheckThreshold":10,"numInvalidateEdgePixels":0,"subpixelFractionalBits":5},"censusTransform":{"enableMeanMode":true,"kernelMask":0,"kernelSize":-1,"threshold":0},"costAggregation":{"divisionFactor":1,"horizontalPenaltyCostP1":250,"horizontalPenaltyCostP2":500,"verticalPenaltyCostP1":250,"verticalPenaltyCostP2":500},"costMatching":{"confidenceThreshold":150,"disparityWidth":1,"enableCompanding":true,"invalidDisparityValue":0,"linearEquationParameters":{"alpha":0,"beta":2,"threshold":127}},"postProcessing":{"bilateralSigmaValue":0,"brightnessFilter":{"maxBrightness":254,"minBrightness":10},"decimationFilter":{"decimationFactor":1,"decimationMode":0},"median":0,"spatialFilter":{"alpha":0.5,"delta":0,"enable":false,"holeFillingRadius":2,"numIterations":1},"speckleFilter":{"enable":false,"speckleRange":50},"temporalFilter":{"alpha":0.4000000059604645,"delta":0,"enable":false,"persistencyMode":3},"thresholdFilter":{"maxRange":5000,"minRange":0}}},"mesh":{"meshLeftUri":"","meshRightUri":"","meshSize":null,"stepHeight":16,"stepWidth":16},"numFramesPool":3,"numPostProcessingMemorySlices":-1,"numPostProcessingShaves":-1,"outHeight":720,"outKeepAspectRatio":true,"outWidth":1280,"rectificationUseSpecTranslation":false,"rectifyEdgeFillColor":0,"useHomographyRectification":false,"width":null}}],[6,{"id":6,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":3,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":{"maxFpsLimit":-1.0,"metadataOnly":false,"streamName":"stereo_stereo"}}],[7,{"id":7,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":2,"name":"out","queueSize":8,"type":0,"waitForMessage":false}]],"name":"SystemLogger","properties":{"rateHz":1.0}}],[8,{"id":8,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":1,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":{"maxFpsLimit":-1.0,"metadataOnly":false,"streamName":"sys_logger_queue"}}]]}

log_system_information.json:

{
    "architecture": "64bit ELF",
    "machine": "x86_64",
    "platform": "Linux-6.1.35-x86_64-with-glibc2.35",
    "processor": "x86_64",
    "python_build": "main May 29 2023 11:10:38",
    "python_compiler": "GCC 11.3.0",
    "python_implementation": "CPython",
    "python_version": "3.10.6",
    "release": "6.1.35",
    "system": "Linux",
    "version": "#1 SMP PREEMPT_DYNAMIC Thu Jun 22 18:03:13 UTC 2023",
    "win32_ver": "",
    "packages": [
        "action-msgs==1.6.0",
        "actionlib-msgs==5.0.0",
        "actuator-msgs==0.0.1",
        "-e git+https://git.robocc.com/robocc/robocc-ros.git@7c7fc06ae31c8f9bafc586d097423a116a52f6cc#egg=alerter&subdirectory=.build/build/alerter",
        "ament-cmake-test==2.0.3",
        "ament-copyright==0.14.1",
        "ament-cppcheck==0.14.1",
        "ament-cpplint==0.14.1",
        "ament-flake8==0.14.1",
        "ament-index-python==1.5.2",
        "ament-lint==0.14.1",
        "ament-lint-cmake==0.14.1",
        "ament-package==0.15.3",
        "ament-pep257==0.14.1",
        "ament-uncrustify==0.14.1",
        "ament-xmllint==0.14.1",
        "angles==1.16.0",
        "annotated-types==0.5.0",
        "-e git+https://git.robocc.com/robocc/robocc-ros.git@7c7fc06ae31c8f9bafc586d097423a116a52f6cc#egg=api_generator&subdirectory=.build/build/external_api_generation",
        "app==0.0.0",
        "appdirs==1.4.4",
        "argcomplete==1.8.1",
        "argparse==1.4.0",
        "asgiref==3.5.0",
        "attrs==23.1.0",
        "Babel==2.8.0",
        "beniget==0.4.1",
        "black==21.10b0",
        "bond==4.0.0",
        "Brotli==1.0.9",
        "builtin-interfaces==1.6.0",
        "camera-calibration==3.0.1",
        "cartographer-ros-msgs==2.0.9001",
        "catkin-pkg-modules==0.5.2",
        "certifi==2023.7.22",
        "charset-normalizer==3.2.0",
        "click==8.1.7",
        "colcon-argcomplete==0.3.3",
        "colcon-bash==0.4.2",
        "colcon-cd==0.1.1",
        "colcon-cmake==0.2.27",
        "colcon-common-extensions==0.3.0",
        "colcon-core==0.12.1",
        "colcon-defaults==0.2.8",
        "colcon-devtools==0.2.3",
        "colcon-library-path==0.2.1",
        "colcon-metadata==0.2.5",
        "colcon-mixin==0.2.3",
        "colcon-notification==0.2.15",
        "colcon-output==0.2.13",
        "colcon-package-information==0.3.3",
        "colcon-package-selection==0.2.10",
        "colcon-parallel-executor==0.2.4",
        "colcon-pkg-config==0.1.0",
        "colcon-powershell==0.3.7",
        "colcon-python-setup-py==0.2.8",
        "colcon-recursive-crawl==0.2.1",
        "colcon-ros==0.3.23",
        "colcon-test-result==0.3.8",
        "colcon-zsh==0.4.0",
        "colorama==0.4.4",
        "composition-interfaces==1.6.0",
        "control-msgs==5.0.0",
        "controller-manager-msgs==3.15.0",
        "cryptography==3.4.8",
        "cv-bridge==3.4.0",
        "cycler==0.11.0",
        "data-manager==0.0.0",
        "data-manager-django==0.0.0",
        "dbus-python==1.2.18",
        "decorator==4.4.2",
        "depthai-ros-driver==2.8.1",
        "depthai-ros-msgs==2.8.1",
        "diagnostic-msgs==5.0.0",
        "diagnostic-updater==3.1.2",
        "diff-drive-controller-driver==0.0.0",
        "distlib==0.3.4",
        "distro==1.7.0",
        "Django==3.2.12",
        "docutils==0.17.1",
        "domain-coordinator==0.11.2",
        "dwb-msgs==1.2.0",
        "empy==3.3.4",
        "flake8==4.0.1",
        "fonttools==4.29.1",
        "foxglove-msgs==2.1.1",
        "fs==2.4.12",
        "gast==0.5.2",
        "geometry-msgs==5.0.0",
        "idna==3.4",
        "image-geometry==3.4.0",
        "importlib-metadata==4.6.4",
        "iniconfig==1.1.1",
        "interactive-markers==2.4.0",
        "Jinja2==3.0.3",
        "joint-state-publisher==2.3.0",
        "jsonschema==3.2.0",
        "kiwisolver==1.3.2",
        "lark==1.1.1",
        "laser-geometry==2.5.0",
        "launch==2.0.1",
        "launch-ros==0.24.0",
        "launch-testing==2.0.1",
        "launch-testing-ros==0.24.0",
        "launch-xml==2.0.1",
        "launch-yaml==2.0.1",
        "lifecycle-msgs==1.6.0",
        "lxml==4.8.0",
        "lz4==3.1.3+dfsg",
        "map-msgs==2.2.0",
        "MarkupSafe==2.0.1",
        "matplotlib==3.5.1",
        "matrix-client==0.4.0",
        "mccabe==0.6.1",
        "message-filters==4.7.0",
        "more-itertools==8.10.0",
        "mpi4py==3.1.3",
        "mpmath==0.0.0",
        "mypy-extensions==0.4.3",
        "nav-2d-msgs==1.2.0",
        "nav-msgs==5.0.0",
        "nav2-common==1.2.0",
        "nav2-msgs==1.2.0",
        "nav2-simple-commander==1.0.0",
        "netifaces==0.11.0",
        "network-manager==0.0.0",
        "network-manager-node==0.0.0",
        "notify2==0.3",
        "numpy==1.21.5",
        "osrf-pycommon==2.1.2",
        "packaging==21.3",
        "pathspec==0.9.0",
        "pcl-msgs==1.0.0",
        "Pillow==9.0.1",
        "pip==23.2.1",
        "platformdirs==2.5.1",
        "plotjuggler-msgs==0.2.3",
        "pluggy==0.13.0",
        "ply==3.11",
        "psutil==5.9.0",
        "py==1.10.0",
        "pycairo==1.20.1",
        "pycodestyle==2.8.0",
        "pydantic==2.2.0",
        "pydantic_core==2.6.0",
        "pydocstyle==6.1.1",
        "pydot==1.4.2",
        "pyflakes==2.4.0",
        "Pygments==2.11.2",
        "pyparsing==2.4.7",
        "PyQt5==5.15.6",
        "PyQt5-sip==12.9.1",
        "pyrsistent==0.18.1",
        "pytest==6.2.5",
        "python-ctags3==1.6.0",
        "python-dateutil==2.8.1",
        "python-qt-binding==1.2.3",
        "pythran==0.10.0",
        "pytz==2022.1",
        "PyYAML==6.0.1",
        "qt-dotgraph==2.4.2",
        "qt-gui==2.4.2",
        "qt-gui-cpp==2.4.2",
        "qt-gui-py-common==2.4.2",
        "rcl-interfaces==1.6.0",
        "rclpy==4.1.1",
        "rcutils==6.2.1",
        "referencing==0.30.2",
        "requests==2.31.0",
        "resource-retriever==3.2.2",
        "rmw-dds-common==2.0.1",
        "robocc-network==0.0.3",
        "roman==3.3",
        "ros-gz-interfaces==0.245.0",
        "ros-image-to-qimage==0.4.1",
        "ros2-graph==0.0.4",
        "ros2action==0.25.1",
        "ros2bag==0.22.1",
        "ros2bag-mcap-cli==0.22.1",
        "ros2bag-sqlite3-cli==0.22.1",
        "ros2cli==0.25.1",
        "ros2component==0.25.1",
        "ros2doctor==0.25.1",
        "ros2interface==0.25.1",
        "ros2launch==0.24.0",
        "ros2lifecycle==0.25.1",
        "ros2multicast==0.25.1",
        "ros2node==0.25.1",
        "ros2param==0.25.1",
        "ros2pkg==0.25.1",
        "ros2run==0.25.1",
        "ros2service==0.25.1",
        "ros2topic==0.25.1",
        "rosbag2-interfaces==0.22.1",
        "rosbag2-py==0.22.1",
        "rosdep==0.22.2",
        "rosdep-modules==0.22.2",
        "rosdistro-modules==0.9.0",
        "rosgraph-msgs==1.6.0",
        "rosidl-adapter==4.0.0",
        "rosidl-cli==4.0.0",
        "rosidl-cmake==4.0.0",
        "rosidl-generator-c==4.0.0",
        "rosidl-generator-cpp==4.0.0",
        "rosidl-generator-py==0.18.0",
        "rosidl-generator-type-description==4.0.0",
        "rosidl-parser==4.0.0",
        "rosidl-pycommon==4.0.0",
        "rosidl-runtime-py==0.12.0",
        "rosidl-typesupport-c==3.0.0",
        "rosidl-typesupport-cpp==3.0.0",
        "rosidl-typesupport-fastrtps-c==3.0.0",
        "rosidl-typesupport-fastrtps-cpp==3.0.0",
        "rosidl-typesupport-introspection-c==4.0.0",
        "rosidl-typesupport-introspection-cpp==4.0.0",
        "rospkg==1.5.0",
        "rospkg-modules==1.5.0",
        "rpds-py==0.9.2",
        "rpyutils==0.3.2",
        "rqt==1.3.3",
        "rqt-action==2.1.2",
        "rqt-bag==1.3.2",
        "rqt-bag-plugins==1.3.2",
        "rqt-console==2.1.1",
        "rqt-controller-manager==3.15.0",
        "rqt-graph==1.4.2",
        "rqt-gui==1.3.3",
        "rqt-gui-py==1.3.3",
        "rqt-joint-trajectory-controller==3.10.1",
        "rqt-moveit==1.0.1",
        "rqt-msg==1.3.1",
        "rqt-plot==1.2.3",
        "rqt-publisher==1.6.3",
        "rqt-py-common==1.3.3",
        "rqt-py-console==1.1.1",
        "rqt-reconfigure==1.3.3",
        "rqt-robot-dashboard==0.5.8",
        "rqt-robot-monitor==1.0.5",
        "rqt-robot-steering==1.0.0",
        "rqt-runtime-monitor==1.0.0",
        "rqt-service-caller==1.1.1",
        "rqt-shell==1.1.1",
        "rqt-srv==1.1.1",
        "rqt-tf-tree==1.0.4",
        "rqt-topic==1.6.1",
        "scipy==1.8.0",
        "sdbus==0.11.0",
        "sdbus-networkmanager==2.0.0",
        "sensor-msgs==5.0.0",
        "sensor-msgs-py==5.0.0",
        "service-msgs==1.6.0",
        "setuptools==59.6.0",
        "shape-msgs==5.0.0",
        "six==1.16.0",
        "smclib==4.0.0",
        "snowballstemmer==2.2.0",
        "sqlparse==0.4.2",
        "sros2==0.11.3",
        "statistics-msgs==1.6.0",
        "std-msgs==5.0.0",
        "std-srvs==5.0.0",
        "stereo-msgs==5.0.0",
        "sympy==1.9",
        "test-msgs==1.6.0",
        "tf2-geometry-msgs==0.31.3",
        "tf2-msgs==0.31.3",
        "tf2-py==0.31.3",
        "tf2-ros-py==0.31.3",
        "tf2-sensor-msgs==0.31.3",
        "theora-image-transport==3.1.0",
        "toml==0.10.2",
        "tomli==1.2.2",
        "trajectory-msgs==5.0.0",
        "type-description-interfaces==1.6.0",
        "typing_extensions==4.7.1",
        "ufoLib2==0.13.1",
        "unicodedata2==14.0.0",
        "unique-identifier-msgs==2.3.2",
        "urllib3==1.26.16",
        "vcstool==0.3.0",
        "vision-msgs==4.1.0",
        "visualization-msgs==5.0.0",
        "wheel==0.37.1",
        "xacro==2.0.9",
        "zipp==1.0.0"
    ],
    "usb": [
        "NoLib"
    ],
    "uname": [
        "Linux 000351f 6.1.35 #1 SMP PREEMPT_DYNAMIC Thu Jun 22 18:03:13 UTC 2023 x86_64 x86_64"
    ]
}

I also tried the Humble branch and I have the same issue

BriceRenaudeau commented 8 months ago

Debug logs:

[INFO] [launch]: All log files can be found below /root/.ros/log/2023-10-11-08-26-51-115683-000351f-291598
[INFO] [launch]: Default logging verbosity is set to INFO
[INFO] [component_container-1]: process started with pid [291613]
[component_container-1] [INFO] [1697012811.466670258] [front_depth_container]: Load Library: /src/robocc-ros/.build/install/depthai_ros_driver/lib/libdepthai_ros_driver.so
[component_container-1] [INFO] [1697012811.513448152] [front_depth_container]: Found class: rclcpp_components::NodeFactoryTemplate<depthai_ros_driver::Camera>
[component_container-1] [INFO] [1697012811.513484956] [front_depth_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<depthai_ros_driver::Camera>
[component_container-1] [2023-10-11 08:26:51.515] [depthai] [info] DEPTHAI_DEBUG enabled, lowered DEPTHAI_LEVEL to 'debug'
[component_container-1] [2023-10-11 08:26:51.515] [depthai] [debug] Library information - version: 2.22.0, commit:  from , build: 2023-06-22 19:15:47 +0000
[component_container-1] [2023-10-11 08:26:51.517] [depthai] [debug] Initialize - finished
[component_container-1] [2023-10-11 08:26:51.585] [depthai] [debug] Resources - Archive 'depthai-bootloader-fwp-0.0.26.tar.xz' open: 2ms, archive read: 67ms
[component_container-1] [2023-10-11 08:26:51.886] [depthai] [debug] Resources - Archive 'depthai-device-fwp-f033fd9c7eb0b3578d12f90302e87759c78cfb36.tar.xz' open: 1ms, archive read: 369ms
[component_container-1] [INFO] [1697012812.024717887] [cameras.oak_front]: Connecting to the camera using USB ID: 3.5
[component_container-1] [2023-10-11 08:26:53.454] [depthai] [debug] Searching for booted device: DeviceInfo(name=3.5, mxid=1844301021C1AF0E00, X_LINK_BOOTED, X_LINK_USB_VSC, X_LINK_MYRIAD_X, X_LINK_SUCCESS), name used as hint only
[component_container-1] [1844301021C1AF0E00] [3.5] [1.133] [system] [warning] PRINT:LeonCss: BootloaderConfig.options1 checksum doesn't match. Is: 0x10304418 should be: 0x5E7D3A77
[component_container-1] GPIO boot mode 0x3, interface SPI_MASTER_EFF
[component_container-1] Setting aons(0..4) back to boot from flash (offset = 0)
[component_container-1] ====ENABLE WATCHDOG====1
[component_container-1] initial keepalive, countdown: 10
[component_container-1] PLL0: 700000 AUX_IO0: 24000 AUX_IO1: 24000 MCFG: 24000 MECFG: 24000
[component_container-1] Board init ret 3
[component_container-1] DepthAI Firmware - version: f033fd9c7eb0b3578d12f90302e87759c78cfb36
[component_container-1] eeprom configuration version: 55AA0007
[component_container-1] Reading VERSION 7 --- ->
[component_container-1] eeprom configuration load from user area, status: 0
[component_container-1] Reading VERSION 7 --- ->
[component_container-1] PMIC read  reg 0x19, val 0xb8
[component_container-1] PMIC read  reg 0x23, val 0x10
[component_container-1] PMIC read  reg 0x31, val 0x08
[component_container-1] PMIC read  reg 0x33, val 0x28
[component_container-1] Found a device/board entry matching the eeprom data - Board: OAK-D S2/Pro (R6 - generic) Device: 
[component_container-1] Board options: 00000004
[component_container-1] --> brdInit ...
[component_container-1] brdInitAuxDevices: Error: SC = 27: io_initialize expander_cam_gpios_1 [OK]
[component_container-1] 
[component_container-1] spi_N25Q_init: Flash JEDEC ID: c2 25 3a
[component_container-1] SR CR: 40 07
[component_container-1] QUAD mode already enabled. Dummy cfg: 0x00
[component_container-1] Initialized pin: 56, mode: 7, level: 1, pad: 0x00000010
[component_container-1] inited hal ---
[component_container-1] def: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
[component_container-1] val: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
[component_container-1] Opening bus for IR driver: 1
[component_container-1] Failed to probe IR driver LM3644
[component_container-1] Opening bus for IR driver: 2
[component_container-1] LM3644 detected, ID = 0x02
[component_container-1] ===== IR write bus 2: 0x07 = 0x89
[component_container-1] ===== IR write bus 2: 0x02 = 0x01
[component_container-1] ===== IR write bus 2: 0x03 = 0x00
[component_container-1] ===== IR write bus 2: 0x04 = 0x00
[component_container-1] ===== IR write bus 2: 0x05 = 0x00
[component_container-1] ===== IR write bus 2: 0x06 = 0x00
[component_container-1] ===== IR write bus 2: 0x07 = 0x09
[component_container-1] ===== IR write bus 2: 0x08 = 0x1a
[component_container-1] ===== IR write bus 2: 0x09 = 0x08
[component_container-1] ===== IR write bus 2: 0x01 = 0x24
[component_container-1] Opening bus for IR driver: 3
[component_container-1] Failed to probe IR driver LM3644
[component_container-1] Closing EEPROm!
[component_container-1] MyriaX board configuration
[component_container-1]         skipped OV7251
[component_container-1]         skipped AR0234
[component_container-1]         skipped S5K33D
[component_container-1]   >> Registered camera A12N02A (imx378) as /dev/Camera_0
[component_container-1] camera socket: 0, name: color
[component_container-1]         config - w: 1920, h: 1080, type: COLOR
[component_container-1]         config - w: 3840, h: 2160, type: COLOR
[component_container-1]         config - w: 1280, h: 720, type: COLOR
[component_container-1]         config - w: 1280, h: 800, type: MONO
[component_container-1]         config - w: 1280, h: 800, type: COLOR
[component_container-1] Adding socket 1: cam 5. Sen name: OV9282
[component_container-1] === Enumerating on socket: Cam_C / Right
[component_container-1]   >> Registered camera TG161B (ov9282) as /dev/Camera_2
[component_container-1] [1844301021C1AF0E00] [3.5] [1.136] [system] [info] Cpu Usage - LeonOS 74.73%, LeonRT: 1.55%                                                                                                                                     ue,"group":"","id":21,"name":"inputControl","queueSize":8,"type":3,"waitForMessage":false}]],"name":"MonoCamera","properties":[185,10,185,27,0,3,0,0,0,185,3,0,0,0,185,5,0,0,0,0,0,185,5,0,0,0,0,0,0,0,0,0,0,0,0,185,3,0,0,0,185,3,0,0,0,0,0,0,0,0,0,0,0,0,0,2,189,0,0,1,136,0,0,112,65,0,3,3,190]}],[4,{"id":4,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":20,"name":"out","queueSize":8,"type":0,"waitForMessage":false}]],"name":"XLinkIn","properties":[185,3,189,13,114,105,103,104,116,95,99,111,110,116,114,111,108,130,0,0,80,0,8]}],[5,{"id":5,"ioInfo":[[["","depth"],{"blocking":false,"group":"","id":19,"name":"depth","queueSize":8,"type":0,"waitForMessage":false}],[["","rectifiedLeft"],{"blocking":false,"group":"","id":17,"name":"rectifiedLeft","queueSize":8,"type":0,"waitForMessage":false}],[["","syncedLeft"],{"blocking":false,"group":"","id":18,"name":"syncedLeft","queueSize":8,"type":0,"waitForMessage":false}],[["","syncedRight"],{"blocking":false,"group":"","id":14,"name":"syncedRight","queueSize":8,"type":0,"waitForMessage":false}],[["","rectifiedRight"],{"blocking":false,"group":"","id":13,"name":"rectifiedRight","queueSize":8,"type":0,"waitForMessage":false}],[["","outConfig"],{"blocking":false,"group":"","id":11,"ize":8,"type":0,"waitForMessage":false}],[["","inputConfig"],{"blocking":false,"group":"","id":6,"name":"inputConfig","queueSize":4,"type":3,"waitForMessage":false}],[["","left"],{"blocking":false,"group":"","id":5,"name":"left","queueSize":8,"type
[component_container-1] [1844301021C1AF0E00] [3.5] [1.258] [system] [info] MonoCamera allocated resources: no shaves; cmx slices: [13-15] 
[component_container-1] StereoDepth allocated resources: shaves: [14-14] cmx slices: [10-12] 
[component_container-1] 
[component_container-1] [1844301021C1AF0E00] [3.5] [1.264] [system] [warning] PRINT:LeonCss: XLinkIn | Created plgPool as shared: 1
[component_container-1] XLinkIn | Created plgPool as shared: 1
[component_container-1] [1844301021C1AF0E00] [3.5] [1.264] [system] [warning] PRINT:LeonMss: sippPalThreadCreate: Thread /SIPP created
[component_container-1] [1844301021C1AF0E00] [3.5] [1.275] [system] [warning] PRINT:LeonCss: [1970-01-01 00:00:01.265] [info] Time taken to build the pipeline: 48ms
[component_container-1] == FSYNC enabled for cam mask 0x0
[component_container-1] CAM ID: 2, width: 1280, height: 800, orientation: 0
[component_container-1] == SW-SYNC: 0, cam mask 0x6
[component_container-1] !!! Master Slave config is: single_master_slave !!!
[component_container-1] Starting camera 1
[component_container-1] [E] app_guzzi_command_callback():173: command->id:1
[component_container-1] [E] app_guzzi_command_callback():193: command "1 1" sent
[component_container-1] 
[component_container-1] [1844301021C1AF0E00] [3.5] [1.276] [system] [warning] PRINT:LeonMss: LRT - build pipeline call
[component_container-1] [1844301021C1AF0E00] [3.5] [1.286] [system] [warning] PRINT:LeonCss: [E] iq_debug_create():161: iq_debug address 0x885286c0
[component_container-1] [E] set_dtp_ids():405: //VIV HAL: Undefined NVM DTP ID 0
[component_container-1] [E] set_dtp_ids():414: //VIV HAL: Undefined lights DTP ID 0
[component_container-1] [E] camera_control_start():347: Camera_id = 1 started.
[component_container-1] 
[component_container-1] [E] lens_move_to_def_pos_do():251: Error executing af_move_to_pos()!
[component_container-1] [1844301021C1AF0E00] [3.5] [1.297] [system] [warning] PRINT:LeonCss: Reading..........Reading VERSION 7 --- ->
[component_container-1] [E] vpipe_conv_config():1465: Exit Ok
[component_container-1] [E] callback():123: Camera CB START_DONE event.
[component_container-1] Starting camera 2
[component_container-1] [E] app_guzzi_command_callback():173: command->id:1
[component_container-1] [E] app_guzzi_command_callback():193: command "1 2" sent
[component_container-1] 
[component_container-1] [1844301021C1AF0E00] [3.5] [1.309] [system] [warning] PRINT:LeonCss: [E] iq_debug_create():161: iq_debug address 0x88088280
[component_container-1] [E] hai_cm_driver_load_dtp():852: Features for camera TG161B (ov9282) are received
[component_container-1] [E] set_dtp_ids():396: //VIV HAL: Undefined VCM DTP ID 0
[component_container-1] [E] set_dtp_ids():405: //VIV HAL: Undefined NVM DTP ID 0
[component_container-1] [E] set_dtp_ids():414: //VIV HAL: Undefined lights DTP ID 0
[component_container-1] [1844301021C1AF0E00] [3.5] [1.320] [system] [warning] PRINT:LeonCss: [E] camera_control_start():347: Camera_id = 2 started.
[component_container-1] 
[component_container-1] [E] lens_move_to_def_pos_do():251: Error executing af_move_to_pos()!
[component_container-1] [E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1280x800 at 0x0 fps min 0.000000 max 30.000000
[component_container-1] [E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1280x800 at 0x0 fps min 0.000000 max 30.000000
[component_container-1] === osDrvOV9282Control: set mode for Camera_2_sen
[component_container-1] inc_camera_process set exposure and gain
[component_container-1] [E] guzzi_event_send():324: Send: Event ID=20004 no registered recipient
[component_container-1] finished sippPrePrepareLinesFreeRT
[component_container-1] [1844301021C1AF0E00] [3.5] [1.411] [StereoDepth(5)] [info] Depth horizontal FOV: '96.98751', vertical FOV: '64.83628'
[component_container-1] [1844301021C1AF0E00] [3.5] [21.156] [system] [info] Cpu Usage - LeonOS 17.76%, LeonRT: 4.68%
[component_container-1] [1844301021C1AF0E00] [3.5] [25.160] [system] [info] Temperatures - Average: 40.04C, CSS: 41.89C, MSS 39.11C, UPA: 39.81C, DSS: 39.35C
[component_container-1] [1844301021C1AF0E00] [3.5] [25.160] [system] [info] Cpu Usage - LeonOS 17.70%, LeonRT: 3.77%
[component_container-1] [1844301021C1AF0E00] [3.5] [26.161] [system] [info] Cpu Usage - LeonOS 18.06%, LeonRT: 3.87%
[component_container-1] [1844301021C1AF0E00] [3.5] [27.162] [system] [info] Memory Usage - DDR: 114.94 / 337.18 MiB, CMX: 2.10 / 2.50 MiB, LeonOS Heap: 36.12 / 80.03 MiB, LeonRT Heap: 4.14 / 41.06 MiB
[component_container-1] [1844301021C1AF0E00] [3.5] [27.162] [system] [info] Temperatures - Average: 40.10C, CSS: 40.74C, MSS 39.35C, UPA: 41.20C, DSS: 39.11C
[component_container-1] [1844301021C1AF0E00] [3.5] [27.162] [system] [info] Cpu Usage - LeonOS 17.96%, LeonRT: 4.05%
[component_container-1] [1844301021C1AF0E00] [3.5] [28.163] [system] [info] Memory Usage - DDR: 114.94 / 337.18 MiB, CMX: 2.10 / 2.50 MiB, LeonOS Heap: 36.12 / 80.03 MiB, LeonRT Heap: 4.14 / 41.06 MiB
[component_container-1] [1844301021C1AF0E00] [3.5] [28.163] [system] [info] Temperatures - Average: 39.81C, CSS: 40.51C, MSS 39.11C, UPA: 40.04C, DSS: 39.58C
[component_container-1] [1844301021C1AF0E00] [3.5] [28.163] [system] [info] Cpu Usage - LeonOS 17.94%, LeonRT: 3.46%
[component_container-1] [1844301021C1AF0E00] [3.5] [29.164] [system] [info] Memory Usage - DDR: 114.94 / 337.18 MiB, CMX: 2.10 / 2.50 MiB, LeonOS Heap: 36.12 / 80.03 MiB, LeonRT Heap: 4.14 / 41.06 MiB
[component_container-1] [1844301021C1AF0E00] [3.5] [29.164] [system] [info] Temperatures - Average: 40.04C, CSS: 40.97C, MSS 39.35C, UPA: 40.04C, DSS: 39.81C
[component_container-1] [1844301021C1AF0E00] [3.5] [29.164] [system] [info] Cpu Usage - LeonOS 17.77%, LeonRT: 3.65%
[component_container-1] [1844301021C1AF0E00] [3.5] [30.166] [system] [info] Cpu Usage - LeonOS 17.72%, LeonRT: 3.49%
[component_container-1] [1844301021C1AF0E00] [3.5] [31.167] [system] [info] Memory Usage - DDR: 114.94 / 337.18 MiB, CMX: 2.10 / 2.50 MiB, LeonOS Heap: 36.12 / 80.03 MiB, LeonRT Heap: 4.14 / 41.06 MiB
[exited]
BriceRenaudeau commented 8 months ago

I reduced the search to the commit "update socket logic": #400

Serafadam commented 8 months ago

Hi @BriceRenaudeau, I've found the culprit, default resolution for stereo cameras has been switched to 800P which caused desynchronization. It's been reverted in https://github.com/luxonis/depthai-ros/tree/frequency_fix_iron and https://github.com/luxonis/depthai-ros/tree/frequency_fix_humble, you can test them and see if that works for you as well.

BriceRenaudeau commented 8 months ago

Hi, I tested the Iron branch.

It's better, the mean frequency is 15hz. But it"s still less stable than before: image

Serafadam commented 8 months ago

Could you show the debug logs now? One "bugfix" that was also introduced was to make the resolution naming the same, so instead of "400" it should be "400P" for the stereo cameras as well.

BriceRenaudeau commented 8 months ago

Thanks, I will try that at the end of the week.

BriceRenaudeau commented 8 months ago

On Iron branch using "720P" i_resolution parameters. The frequency issue is still here: Screenshot from 2023-10-20 11-52-24

Here are the debug Logs:

[INFO] [launch]: All log files can be found below /root/.ros/log/2023-10-20-09-50-19-602927-000351f-66933
[INFO] [launch]: Default logging verbosity is set to INFO
[INFO] [component_container-1]: process started with pid [66948]
[component_container-1] [INFO] [1697795419.985660887] [front_depth_container]: Load Library: /src/robocc-ros/.build/install/depthai_ros_driver/lib/libdepthai_ros_driver.so
[component_container-1] [INFO] [1697795420.070049494] [front_depth_container]: Found class: rclcpp_components::NodeFactoryTemplate<depthai_ros_driver::Camera>
[component_container-1] [INFO] [1697795420.070095280] [front_depth_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<depthai_ros_driver::Camera>
[component_container-1] [2023-10-20 09:50:20.071] [depthai] [info] DEPTHAI_DEBUG enabled, lowered DEPTHAI_LEVEL to 'debug'
[component_container-1] [2023-10-20 09:50:20.071] [depthai] [debug] Library information - version: 2.22.0, commit:  from , build: 2023-06-22 19:15:47 +0000
[component_container-1] [2023-10-20 09:50:20.072] [depthai] [debug] Initialize - finished
[component_container-1] [2023-10-20 09:50:20.140] [depthai] [debug] Resources - Archive 'depthai-bootloader-fwp-0.0.26.tar.xz' open: 1ms, archive read: 66ms
[component_container-1] [2023-10-20 09:50:20.442] [depthai] [debug] Resources - Archive 'depthai-device-fwp-f033fd9c7eb0b3578d12f90302e87759c78cfb36.tar.xz' open: 1ms, archive read: 369ms
[component_container-1] [INFO] [1697795420.578794613] [cameras.oak_front]: Connecting to the camera using USB ID: 3.5
[component_container-1] [2023-10-20 09:50:21.997] [depthai] [debug] Searching for booted device: DeviceInfo(name=3.5, mxid=1844301021C1AF0E00, X_LINK_BOOTED, X_LINK_USB_VSC, X_LINK_MYRIAD_X, X_LINK_SUCCESS), name used as hint only
[component_container-1] [INFO] [1697795423.152981489] [cameras.oak_front]: Ignoring device info: MXID: 19443010B13C481300, Name: 3.6
[component_container-1] [1844301021C1AF0E00] [3.5] [1.139] [system] [warning] PRINT:LeonCss: BootloaderConfig.options1 checksum doesn't match. Is: 0x10304418 should be: 0x5E7D3A77
[component_container-1] GPIO boot mode 0x3, interface SPI_MASTER_EFF
[component_container-1] Setting aons(0..4) back to boot from flash (offset = 0)
[component_container-1] ====ENABLE WATCHDOG====1
[component_container-1] initial keepalive, countdown: 10
[component_container-1] PLL0: 700000 AUX_IO0: 24000 AUX_IO1: 24000 MCFG: 24000 MECFG: 24000
[component_container-1] Board init ret 3
[component_container-1] DepthAI Firmware - version: f033fd9c7eb0b3578d12f90302e87759c78cfb36
[component_container-1] eeprom configuration version: 55AA0007
[component_container-1] Reading VERSION 7 --- ->
[component_container-1] eeprom configuration load from user area, status: 0
[component_container-1] Reading VERSION 7 --- ->
[component_container-1] PMIC read  reg 0x19, val 0xb8
[component_container-1] PMIC read  reg 0x23, val 0x10
[component_container-1] PMIC read  reg 0x31, val 0x08
[component_container-1] PMIC read  reg 0x33, val 0x28
[component_container-1] Found a device/board entry matching the eeprom data - Board: OAK-D S2/Pro (R6 - generic) Device: 
[component_container-1] Board options: 00000004
[component_container-1] --> brdInit ...
[component_container-1] brdInitAuxDevices: Error: SC = 27: io_initialize expander_cam_gpios_1 [OK]
[component_container-1] 
[component_container-1] spi_N25Q_init: Flash JEDEC ID: c2 25 3a
[component_container-1] SR CR: 40 07
[component_container-1] QUAD mode already enabled. Dummy cfg: 0x00
[component_container-1] Initialized pin: 56, mode: 7, level: 1, pad: 0x00000010
[component_container-1] inited hal ---
[component_container-1] def: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
[component_container-1] val: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
[component_container-1] Opening bus for IR driver: 1
[component_container-1] Failed to probe IR driver LM3644
[component_container-1] Opening bus for IR driver: 2
[component_container-1] LM3644 detected, ID = 0x02
[component_container-1] ===== IR write bus 2: 0x07 = 0x89
[component_container-1] ===== IR write bus 2: 0x02 = 0x01
[component_container-1] ===== IR write bus 2: 0x03 = 0x00
[component_container-1] ===== IR write bus 2: 0x04 = 0x00
[component_container-1] ===== IR write bus 2: 0x05 = 0x00
[component_container-1] ===== IR write bus 2: 0x06 = 0x00
[component_container-1] ===== IR write bus 2: 0x07 = 0x09
[component_container-1] ===== IR write bus 2: 0x08 = 0x1a
[component_container-1] ===== IR write bus 2: 0x09 = 0x08
[component_container-1] ===== IR write bus 2: 0x01 = 0x24
[component_container-1] Opening bus for IR driver: 3
[component_container-1] Failed to probe IR driver LM3644
[component_container-1] Closing EEPROm!
[component_container-1] MyriaX board configuration
[component_container-1] pll0 frequency: 700000, ref0 frequency: 24000
[component_container-1] Is booted from flash by bootloader: 0
[component_container-1] Networking not available...
[component_container-1] === Enumerating on socket: Cam_A / RGB / Center
[component_container-1]         skipped OV7251
[component_container-1]         skipped AR0234
[component_container-1]         skipped S5K33D
[component_container-1]   >> Registered camera A12N02A (imx378) as /dev/Camera_0
[component_container-1] camera socket: 0, name: color
[component_container-1]         config - w: 1920, h: 1080, type: COLOR
[component_container-1]         config - w: 3840, h: 2160, type: COLOR
[component_container-1]         config - w: 4056, h: 3040, type: COLOR
[component_container-1] Adding socket 0: cam 2. Sen name: IMX378
[component_container-1] === Enumerating on socket: Cam_B / Left
[component_container-1]   >> Registered camera TG161B (ov9282) as /dev/Camera_1
[component_container-1] camera socket: 1, name: left
[component_container-1]         config - w: 1280, h: 720, type: MONO
[component_container-1]         config - w: 1280, h: 720, type: COLOR
[component_container-1]         config - w: 1280, h: 800, type: MONO
[component_container-1]         config - w: 1280, h: 800, type: COLOR
[component_container-1] Adding socket 1: cam 5. Sen name: OV9282
[component_container-1] === Enumerating on socket: Cam_C / Right
[component_container-1]   >> Registered camera TG161B (ov9282) as /dev/Camera_2
[component_container-1] camera socket: 2, name: right
[component_container-1]         config - w: 1280, h: 720, type: MONO
[component_container-1]         config - w: 1280, h: 720, type: COLOR
[component_container-1]         config - w: 1280, h: 800, type: MONO
[component_container-1]         config - w: 1280, h: 800, type: COLOR
[component_container-1] Adding socket 2: cam 5. Sen name: OV9282
[component_container-1] Found a device/board entry matching the eeprom data - Board: OAK-D S2/Pro (R6 - generic) Device: 
[component_container-1] Initializing XLink...
[component_container-1] UsbPumpVscAppI_Event: 5 VSC2_EVENT_ATTACH
[component_container-1] UsbPumpVscAppI_Event: 2 VSC2_EVENT_SUSPEND
[component_container-1] UsbPumpVscAppI_Event: 3 VSC2_EVENT_RESUME
[component_container-1] UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
[component_container-1] UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
[component_container-1] initial keepalive, countdown: 9
[component_container-1] UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
[component_container-1] UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
[component_container-1] UsbPumpVscAppI_Event: 0 VSC2_EVENT_INTERFACE_UP
[component_container-1] Done!
[component_container-1] Usb connection speed: High - USB 2.0
[component_container-1] Temperature: Driver registered.
[component_container-1] Temperature: Initialized driver.
[component_container-1] Temperature: Sensor opened: CSS.
[component_container-1] Temperature: Sensor opened: MSS.
[component_container-1] Temperature: Sensor opened: UPA.
[component_container-1] Temperature: Sensor opened: DSS.
[component_container-1] [INFO] [1697795423.154241631] [cameras.oak_front]: Camera with MXID: 1844301021C1AF0E00 and Name: 3.5 connected!
[component_container-1] [INFO] [1697795423.155046340] [cameras.oak_front]: USB SPEED: HIGH
[component_container-1] [1844301021C1AF0E00] [3.5] [1.143] [system] [info] Memory Usage - DDR: 0.12 / 337.18 MiB, CMX: 2.04 / 2.50 MiB, LeonOS Heap: 7.51 / 80.03 MiB, LeonRT Heap: 2.89 / 41.06 MiB
[component_container-1] [1844301021C1AF0E00] [3.5] [1.143] [system] [info] Temperatures - Average: 29.41C, CSS: 31.04C, MSS 29.10C, UPA: 28.62C, DSS: 28.86C
[component_container-1] [1844301021C1AF0E00] [3.5] [1.143] [system] [info] Cpu Usage - LeonOS 50.81%, LeonRT: 1.54%
[component_container-1] [1844301021C1AF0E00] [3.5] [1.150] [system] [warning] PRINT:LeonCss: I: [Timesync] [   3024441] [XLin] startSync:130     Timesync | Callback not set
[component_container-1] Reading from Factory EEPROM contents
[component_container-1] Reading VERSION 7 --- ->
[component_container-1] [INFO] [1697795423.176313904] [cameras.oak_front]: Device type: OAK-D-PRO-W
[component_container-1] [INFO] [1697795423.178358950] [cameras.oak_front]: Pipeline type: depth
[component_container-1] [INFO] [1697795423.185671374] [cameras.oak_front]: Finished setting up pipeline.
[component_container-1] [INFO] [1697795423.186590098] [cameras.oak_front]: Saving pipeline schema to: /tmp/1844301021C1AF0E00_pipeline.json
[component_container-1] [1844301021C1AF0E00] [3.5] [1697795423.191] [host] [debug] Schema dump: {"connections":[{"node1Id":7,"node1Output":"out","node1OutputGroup":"","node2Id":8,"node2Input":"in","node2InputGroup":""},{"node1Id":3,"node1Output":"out","node1OutputGroup":"","node2Id":5,"node2Input":"right","node2InputGroup":""},{"node1Id":0,"node1Output":"out","node1OutputGroup":"","node2Id":5,"node2Input":"left","node2InputGroup":""},{"node1Id":5,"node1Output":"depth","node1OutputGroup":"","node2Id":6,"node2Input":"in","node2InputGroup":""},{"node1Id":4,"node1Output":"out","node1OutputGroup":"","node2Id":3,"node2Input":"inputControl","node2InputGroup":""},{"node1Id":2,"node1Output":"out","node1OutputGroup":"","node2Id":0,"node2Input":"inputControl","node2InputGroup":""},{"node1Id":0,"node1Output":"out","node1OutputGroup":"","node2Id":1,"node2Input":"in","node2InputGroup":""}],"globalProperties":{"calibData":null,"cameraTuningBlobSize":null,"cameraTuningBlobUri":"","leonCssFrequencyHz":700000000.0,"leonMssFrequencyHz":700000000.0,"pipelineName":null,"pipelineVersion":null,"sippBufferSize":18432,"sippDmaBufferSize":16384,"xlinkChunkSize":-1},"nodes":[[0,{"id":0,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":30,"name":"out","queueSize":8,"type":0,"waitForMessage":false}],[["","raw"],{"blocking":false,"group":"","id":29,"name":"raw","queueSize":8,"type":0,"waitForMessage":false}],[["","frameEvent"],{"blocking":false,"group":"","id":28,"name":"frameEvent","queueSize":8,"type":0,"waitForMessage":false}],[["","inputControl"],{"blocking":true,"group":"","id":27,"name":"inputControl","queueSize":8,"type":3,"waitForMessage":false}]],"name":"MonoCamera","properties":[185,10,185,27,0,3,0,0,0,185,3,0,0,0,185,5,0,0,0,0,0,185,5,0,0,0,0,0,0,0,0,0,0,0,0,185,3,0,0,0,185,3,0,0,0,0,0,0,0,0,0,0,0,0,0,1,189,0,255,0,136,0,0,112,65,0,3,3,190]}],[1,{"id":1,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":26,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,9,108,101,102,116,95,109,111,110,111,0]}],[2,{"id":2,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":25,"name":"out","queueSize":8,"type":0,"waitForMessage":false}]],"name":"XLinkIn","properties":[185,3,189,12,108,101,102,116,95,99,111,110,116,114,111,108,130,0,0,80,0,8]}],[3,{"id":3,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":24,"name":"out","queueSize":8,"type":0,"waitForMessage":false}],[["","raw"],{"blocking":false,"group":"","id":23,"name":"raw","queueSize":8,"type":0,"waitForMessage":false}],[["","frameEvent"],{"blocking":false,"group":"","id":22,"name":"frameEvent","queueSize":8,"type":0,"waitForMessage":false}],[["","inputControl"],{"blocking":true,"group":"","id":21,"name":"inputControl","queueSize":8,"type":3,"waitForMessage":false}]],"name":"MonoCamera","properties":[185,10,185,27,0,3,0,0,0,185,3,0,0,0,185,5,0,0,0,0,0,185,5,0,0,0,0,0,0,0,0,0,0,0,0,185,3,0,0,0,185,3,0,0,0,0,0,0,0,0,0,0,0,0,0,2,189,0,255,0,136,0,0,112,65,0,3,3,190]}],[4,{"id":4,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":20,"name":"out","queueSize":8,"type":0,"waitForMessage":false}]],"name":"XLinkIn","properties":[185,3,189,13,114,105,103,104,116,95,99,111,110,116,114,111,108,130,0,0,80,0,8]}],[5,{"id":5,"ioInfo":[[["","depth"],{"blocking":false,"group":"","id":19,"name":"depth","queueSize":8,"type":0,"waitForMessage":false}],[["","rectifiedLeft"],{"blocking":false,"group":"","id":17,"name":"rectifiedLeft","queueSize":8,"type":0,"waitForMessage":false}],[["","syncedLeft"],{"blocking":false,"group":"","id":18,"name":"syncedLeft","queueSize":8,"type":0,"waitForMessage":false}],[["","syncedRight"],{"blocking":false,"group":"","id":14,"name":"syncedRight","queueSize":8,"type":0,"waitForMessage":false}],[["","rectifiedRight"],{"blocking":false,"group":"","id":13,"name":"rectifiedRight","queueSize":8,"type":0,"waitForMessage":false}],[["","outConfig"],{"blocking":false,"group":"","id":11,"name":"outConfig","queueSize":8,"type":0,"waitForMessage":false}],[["","debugExtDispLrCheckIt2"],{"blocking":false,"group":"","id":10,"name":"debugExtDispLrCheckIt2","queueSize":8,"type":0,"waitForMessage":false}],[["","debugDispCostDump"],{"blocking":false,"group":"","id":12,"name":"debugDispCostDump","queueSize":8,"type":0,"waitForMessage":false}],[["","confidenceMap"],{"blocking":false,"group":"","id":9,"name":"confidenceMap","queueSize":8,"type":0,"waitForMessage":false}],[["","debugDispLrCheckIt2"],{"blocking":false,"group":"","id":8,"name":"debugDispLrCheckIt2","queueSize":8,"type":0,"waitForMessage":false}],[["","debugDispLrCheckIt1"],{"blocking":false,"group":"","id":15,"name":"debugDispLrCheckIt1","queueSize":8,"type":0,"waitForMessage":false}],[["","debugExtDispLrCheckIt1"],{"blocking":false,"group":"","id":7,"name":"debugExtDispLrCheckIt1","queueSize":8,"type":0,"waitForMessage":false}],[["","disparity"],{"blocking":false,"group":"","id":16,"name":"disparity","queueSize":8,"type":0,"waitForMessage":false}],[["","inputConfig"],{"blocking":false,"group":"","id":6,"name":"inputConfig","queueSize":4,"type":3,"waitForMessage":false}],[["","left"],{"blocking":false,"group":"","id":5,"name":"left","queueSize":8,"type":3,"waitForMessage":true}],[["","right"],{"blocking":false,"group":"","id":4,"name":"right","queueSize":8,"type":3,"waitForMessage":true}]],"name":"StereoDepth","properties":[185,22,185,5,185,11,0,2,136,0,0,122,68,1,0,1,10,5,0,190,0,185,8,0,0,185,5,0,2,136,0,0,0,63,0,1,185,4,0,3,136,205,204,204,62,0,185,2,0,133,136,19,185,2,10,133,254,0,185,2,0,50,185,2,1,0,185,4,255,0,1,0,185,5,1,1,0,128,150,185,3,0,2,127,185,5,1,128,250,129,244,1,128,250,129,244,1,255,1,0,190,190,133,0,5,133,208,2,1,185,5,189,0,189,0,190,16,16,0,3,255,255,1,0,190,190,1,0,1,136,0,0,0,0]}],[6,{"id":6,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":3,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,13,115,116,101,114,101,111,95,115,116,101,114,101,111,0]}],[7,{"id":7,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":2,"name":"out","queueSize":8,"type":0,"waitForMessage":false}]],"name":"SystemLogger","properties":[185,1,136,0,0,128,63]}],[8,{"id":8,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":1,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,16,115,121,115,95,108,111,103,103,101,114,95,113,117,101,117,101,0]}]]}
[component_container-1] [1844301021C1AF0E00] [3.5] [1697795423.191] [host] [debug] Asset map dump: {"map":{}}
[component_container-1] [1844301021C1AF0E00] [3.5] [1.224] [MonoCamera(0)] [info] Using board socket: 1, id: 1
[component_container-1] [1844301021C1AF0E00] [3.5] [1.225] [MonoCamera(3)] [info] Using board socket: 2, id: 2
[component_container-1] [1844301021C1AF0E00] [3.5] [1.227] [system] [info] SIPP (Signal Image Processing Pipeline) internal buffer size '18432'B, DMA buffer size: '16384'B
[component_container-1] [1844301021C1AF0E00] [3.5] [1.262] [system] [info] MonoCamera allocated resources: no shaves; cmx slices: [13-15] 
[component_container-1] StereoDepth allocated resources: shaves: [14-14] cmx slices: [10-12] 
[component_container-1] 
[component_container-1] [1844301021C1AF0E00] [3.5] [1.271] [system] [warning] PRINT:LeonCss: XLinkIn | Created plgPool as shared: 1
[component_container-1] XLinkIn | Created plgPool as shared: 1
[component_container-1] [1970-01-01 00:00:01.269] [info] Time taken to build the pipeline: 48ms
[component_container-1] [1844301021C1AF0E00] [3.5] [1.272] [system] [warning] PRINT:LeonMss: sippPalThreadCreate: Thread /SIPP created
[component_container-1] LRT - build pipeline call
[component_container-1] [1844301021C1AF0E00] [3.5] [1.282] [system] [warning] PRINT:LeonCss: == FSYNC enabled for cam mask 0x0
[component_container-1] CAM ID: 2, width: 1280, height: 720, orientation: 0
[component_container-1] CAM ID: 1, width: 1280, height: 720, orientation: 0
[component_container-1] Broadcast9282: Successfully registered camera TG161B (ov9282) as /dev/Camera_bcast0
[component_container-1] == SW-SYNC: 0, cam mask 0x6
[component_container-1] !!! Master Slave config is: single_master_slave !!!
[component_container-1] Starting camera 1
[component_container-1] [E] app_guzzi_command_callback():173: command->id:1
[component_container-1] [E] app_guzzi_command_callback():193: command "1 1" sent
[component_container-1] 
[component_container-1] [E] iq_debug_create():161: iq_debug address 0x885287c0
[component_container-1] [E] hai_cm_driver_load_dtp():852: Features for camera TG161B (ov9282) are received
[component_container-1] [E] set_dtp_ids():396: //VIV HAL: Undefined VCM DTP ID 0
[component_container-1] [E] set_dtp_ids():405: //VIV HAL: Undefined NVM DTP ID 0
[component_container-1] [E] set_dtp_ids():414: //VIV HAL: Undefined lights DTP ID 0
[component_container-1] [1844301021C1AF0E00] [3.5] [1.293] [system] [warning] PRINT:LeonCss: [E] camera_control_start():347: Camera_id = 1 started.
[component_container-1] 
[component_container-1] [E] lens_move_to_def_pos_do():251: Error executing af_move_to_pos()!
[component_container-1] [E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1280x720 at 0x0 fps min 0.000000 max 30.000000
[component_container-1] [E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1280x720 at 0x0 fps min 0.000000 max 30.000000
[component_container-1] === osDrvOV9282Control: set mode for Camera_1_sen
[component_container-1] [1844301021C1AF0E00] [3.5] [1.304] [system] [warning] PRINT:LeonCss: [E] vpipe_conv_config():1465: Exit Ok
[component_container-1] [E] callback():123: Camera CB START_DONE event.
[component_container-1] Starting camera 2
[component_container-1] [E] app_guzzi_command_callback():173: command->id:1
[component_container-1] [E] app_guzzi_command_callback():193: command "1 2" sent
[component_container-1] 
[component_container-1] [1844301021C1AF0E00] [3.5] [1.315] [system] [warning] PRINT:LeonCss: [E] iq_debug_create():161: iq_debug address 0x8808b200
[component_container-1] [E] hai_cm_driver_load_dtp():852: Features for camera TG161B (ov9282) are received
[component_container-1] [E] set_dtp_ids():396: //VIV HAL: Undefined VCM DTP ID 0
[component_container-1] [E] set_dtp_ids():405: //VIV HAL: Undefined NVM DTP ID 0
[component_container-1] [E] set_dtp_ids():414: //VIV HAL: Undefined lights DTP ID 0
[component_container-1] [E] camera_control_start():347: Camera_id = 2 started.
[component_container-1] 
[component_container-1] [E] lens_move_to_def_pos_do():251: Error executing af_move_to_pos()!
[component_container-1] [1844301021C1AF0E00] [3.5] [1.326] [system] [warning] PRINT:LeonCss: [E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1280x720 at 0x0 fps min 0.000000 max 30.000000
[component_container-1] [E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1280x720 at 0x0 fps min 0.000000 max 30.000000
[component_container-1] === osDrvOV9282Control: set mode for Camera_2_sen
[component_container-1] inc_camera_process set exposure and gain
[component_container-1] Reading..........Reading VERSION 7 --- ->
[component_container-1] [1844301021C1AF0E00] [3.5] [1.337] [system] [warning] PRINT:LeonCss: [E] vpipe_conv_config():1465: Exit Ok
[component_container-1] [E] guzzi_event_send():324: Send: Event ID=20003 no registered recipient
[component_container-1] [E] guzzi_event_send():324: Send: Event ID=20004 no registered recipient
[component_container-1] [E] callback():123: Camera CB START_DONE event.
[component_container-1] [1844301021C1AF0E00] [3.5] [1.348] [system] [warning] PRINT:LeonCss: inc_camera_process set exposure and gain
[component_container-1] Starting Guzzi command handling loop...
[component_container-1] [1844301021C1AF0E00] [3.5] [1.359] [system] [warning] PRINT:LeonCss: Reading..........Reading VERSION 7 --- ->
[component_container-1] [1844301021C1AF0E00] [3.5] [1.381] [system] [warning] PRINT:LeonMss: finished sippPrePrepareLinesFreeRT
[component_container-1] [1844301021C1AF0E00] [3.5] [1.393] [system] [warning] PRINT:LeonCss: Reading..........Reading VERSION 7 --- ->
[component_container-1] [1844301021C1AF0E00] [3.5] [1.393] [system] [warning] PRINT:LeonMss: finished sippPrePrepareLinesFreeRT
[component_container-1] [1844301021C1AF0E00] [3.5] [1.414] [StereoDepth(5)] [info] Rectification mesh loaded, will override camera intrinsics/extrinsics matrices
[component_container-1] [1844301021C1AF0E00] [3.5] [1.415] [StereoDepth(5)] [info] Depth baseline: '7.5000005' cm, focal length: '346.51282'
[component_container-1] [1844301021C1AF0E00] [3.5] [1.415] [StereoDepth(5)] [info] Depth horizontal FOV: '123.13544', vertical FOV: '72.795334'
[component_container-1] [1844301021C1AF0E00] [3.5] [1.425] [system] [warning] PRINT:LeonCss: Reading from Factory EEPROM contents
[component_container-1] Reading VERSION 7 --- ->
[component_container-1] [1844301021C1AF0E00] [3.5] [1.425] [system] [warning] PRINT:LeonMss: finished sippPrePrepareLinesFreeRT
[component_container-1] finished sippPrePrepareLinesFreeRT
[component_container-1] [1844301021C1AF0E00] [3.5] [1.447] [system] [warning] PRINT:LeonCss: 1100.000 mA -> 92
[component_container-1] dot: 1100.00 mA, flood: 0.00 mA, duty = 0.12
[component_container-1] ===== IR write bus 2: 0x04 = 0x5c
[component_container-1] ===== IR write bus 2: 0x01 = 0x26
[component_container-1] 0.000 mA -> 0
[component_container-1] dot: 1100.00 mA, flood: 0.00 mA, duty = 0.12
[component_container-1] ===== IR write bus 2: 0x03 = 0x00
[component_container-1] ===== IR write bus 2: 0x01 = 0x26
[component_container-1] Reading from Factory EEPROM contents
[component_container-1] Reading VERSION 7 --- ->
[component_container-1] [1844301021C1AF0E00] [3.5] [1.469] [system] [warning] PRINT:LeonMss: finished sippPrePrepareLinesFreeRT
[component_container-1] [INFO] [1697795423.606017325] [cameras.oak_front]: Camera ready!
[INFO] [launch_ros.actions.load_composable_nodes]: Loaded node '/cameras/oak_front' in container '/front_depth_container'
[component_container-1] [INFO] [1697795423.610704393] [front_depth_container]: Load Library: /src/robocc-ros/.build/install/veh_camera/lib/libdepth_to_voxel.so
[component_container-1] [INFO] [1697795423.612671492] [front_depth_container]: Found class: rclcpp_components::NodeFactoryTemplate<veh_camera::DepthToVoxel>
[component_container-1] [INFO] [1697795423.612683675] [front_depth_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<veh_camera::DepthToVoxel>
[component_container-1] voxel_xyz_min -2.7 -1.25-1.25
[component_container-1] voxel_xyz_max 2.7 22
[component_container-1] [INFO] [1697795423.613647810] [depth_to_voxel_front]: Computing projected Voxel areas
[component_container-1] [1844301021C1AF0E00] [3.5] [1.546] [system] [warning] PRINT:LeonCss: initial keepalive, countdown: 8
[component_container-1] [INFO] [1697795423.726190788] [depth_to_voxel_front]: DONE computing projected Voxel areas
[INFO] [launch_ros.actions.load_composable_nodes]: Loaded node '/depth_to_voxel_front' in container '/front_depth_container'
[component_container-1] [INFO] [1697795423.773613763] [depth_to_voxel_front]: Camera info received, starting depth image pipeline: pinhole_model.cx(): 625.286 pinhole_model.cy() 369.737 model.fx(): 346.513 model.fy(): 488.334
[component_container-1] [1844301021C1AF0E00] [3.5] [2.144] [system] [info] Memory Usage - DDR: 111.46 / 337.18 MiB, CMX: 2.10 / 2.50 MiB, LeonOS Heap: 36.12 / 80.03 MiB, LeonRT Heap: 4.14 / 41.06 MiB
[component_container-1] [1844301021C1AF0E00] [3.5] [2.144] [system] [info] Temperatures - Average: 31.10C, CSS: 32.25C, MSS 31.04C, UPA: 30.80C, DSS: 30.32C
[component_container-1] [1844301021C1AF0E00] [3.5] [2.144] [system] [info] Cpu Usage - LeonOS 27.93%, LeonRT: 12.92%
[component_container-1] [1844301021C1AF0E00] [3.5] [3.145] [system] [info] Memory Usage - DDR: 111.46 / 337.18 MiB, CMX: 2.10 / 2.50 MiB, LeonOS Heap: 36.12 / 80.03 MiB, LeonRT Heap: 4.14 / 41.06 MiB
[component_container-1] [1844301021C1AF0E00] [3.5] [3.145] [system] [info] Temperatures - Average: 31.10C, CSS: 32.25C, MSS 31.04C, UPA: 30.80C, DSS: 30.32C
[component_container-1] [1844301021C1AF0E00] [3.5] [3.145] [system] [info] Cpu Usage - LeonOS 18.75%, LeonRT: 4.51%
[component_container-1] [1844301021C1AF0E00] [3.5] [4.146] [system] [info] Memory Usage - DDR: 111.46 / 337.18 MiB, CMX: 2.10 / 2.50 MiB, LeonOS Heap: 36.12 / 80.03 MiB, LeonRT Heap: 4.14 / 41.06 MiB
[component_container-1] [1844301021C1AF0E00] [3.5] [4.146] [system] [info] Temperatures - Average: 31.41C, CSS: 32.49C, MSS 31.04C, UPA: 31.53C, DSS: 30.56C
[component_container-1] [1844301021C1AF0E00] [3.5] [4.146] [system] [info] Cpu Usage - LeonOS 17.86%, LeonRT: 3.81%
[component_container-1] [1844301021C1AF0E00] [3.5] [5.147] [system] [info] Memory Usage - DDR: 111.46 / 337.18 MiB, CMX: 2.10 / 2.50 MiB, LeonOS Heap: 36.12 / 80.03 MiB, LeonRT Heap: 4.14 / 41.06 MiB
[component_container-1] [1844301021C1AF0E00] [3.5] [5.147] [system] [info] Temperatures - Average: 31.59C, CSS: 32.73C, MSS 31.77C, UPA: 31.04C, DSS: 30.80C
[component_container-1] [1844301021C1AF0E00] [3.5] [5.147] [system] [info] Cpu Usage - LeonOS 17.85%, LeonRT: 4.10%
BriceRenaudeau commented 8 months ago

I was able to get a stable frequency by turning ON only the stereo topic.

Whenever I turn on one of the camera (left or right) i_publish_topic: true. The frequency becomes unstable.

It was stable even with the camera topic publishing on the 2.7.4 Tag.

Serafadam commented 8 months ago

Hi:

BriceRenaudeau commented 8 months ago

Here is the full debug logs with frequency issues: oak_full_debug_log.txt

Here is the pipeline: camera_pipeline.json

I tried using i_usb_speed: SUPER_PLUS but the frequency issue is still here.

Unfortunately, I cannot test using the tagged Docker images today.

Serafadam commented 7 months ago

Hi @BriceRenaudeau, have you managed to change the USB speed? It seems it is the culprit in this case, as USB2.0's bandwidth can cause issues with message transfer.

BriceRenaudeau commented 7 months ago

Hi, yes, I changed it to i_usb_speed: SUPER_PLUS and I got the same result.

It was working great before 2.8.1 using USB 2.0.

Serafadam commented 7 months ago

It seems that for some reason the device can't use faster USB speed, are you using USB3.0 port? And is the cable the one that came with the camera? From parameters it seems current resolution for stereo pair is 720P, whereas before it was set to 400P, could you change the params file and check if the results improve?

BriceRenaudeau commented 7 months ago

By changing the resolution back to 400P, the frequency is stable even with the left topic published.

BriceRenaudeau commented 7 months ago

I think there were several changes mixed together.

So I think you can close this issue. There was an initial bug, but you fixed it in #435.

Serafadam commented 7 months ago

Glad it got solved, sorry for the issues. Regarding the USB speed/cable, using a powered USB hub could improve the performance here.