DerrickXuNu / OpenCOOD

[ICRA 2022] An opensource framework for cooperative detection. Official implementation for OPV2V.
https://mobility-lab.seas.ucla.edu/opv2v/
Other
644 stars 99 forks source link

Questions about single view visualization before/After collaboration #133

Closed eyabesbes closed 1 month ago

eyabesbes commented 4 months ago

Hi,

I'm currently working on optimizing data sharing among autonomous vehicles (AVs), and I came across your work, which I will be using as a reference. So far, I have successfully replayed the scenarios and visualized the data in Carla. Now, I want to visualize the LiDAR data of each agent after feature extraction, both before and after fusion, in order to compare each agent's view before and after collaboration.

However, I noticed that when I try to visualize the data using models that utilize early fusion, I only get the data of the ego vehicle, and all the other data from the other AVs is projected onto the ego vehicle's data. Should I use the LateFusion Dataset (even though I'm using an early fusion model) to visualize the data of each agent instead of seeing only one agent's data?

Let's consider the scenario where I want to see the view of each agent before collaboration using only PointPillars as a backbone for feature extraction. In this case, what should I do exactly?

And as for the scenario where I want to see each agent's view after collaboration using an early fusion method (e.g., Point_Pillar_early_fusion), what should I do exactly in this case?