lgsvl / simulator

A ROS/ROS2 Multi-robot Simulator for Autonomous Vehicles
Other
2.29k stars 781 forks source link

Lgsvl + Autoware.AI 1.14 and Range Vision Fusion #1654

Open risk-v opened 3 years ago

risk-v commented 3 years ago

Hi there,

I am trying to fuse the Lidar and Camera data coming from the Lgsvl Simulator using Autoware 1.14, but I can't get the object detection labels associated with the distance and 3d position (i.e. Rviz doesn't display the object label associated with a Lidar cluster). As shown in the following picture Yolo is up and running and is able to detect the car in 2D. I have a Calibration Publisher, a Ray_ground_filter, lidar clustering, range_vision_fusion and imm_ukf running as well. Has anybody here used it with success? Or is there a better way of doing this like using only ROS, Apollo, etc...? Thanks in advance.

Sensor Fusion

hadiTab commented 3 years ago

@risk-v I think this question is better suited for the Autoware community since it isn't simulator related. I haven't tried using Yolo with Autwoare Ai for a few years so my information is likely out-dated but back then IIRC Autoware wasn't really using the detections but they were published on some topic. You can probably find it by looking at all the topics published and just echoing any that seem relevant.

As for using ROS, Apollo, etc... I'm not sure I understand what you are trying to do here. If you just want labels and positions for obstacles then I would suggest using our ground trush 2D and 3D sensors that will publish the ground truth information.