search

argoverse / av2-api

Argoverse 2: Next generation datasets for self-driving perception and forecasting.
https://argoverse.github.io/user-guide/
MIT License
306 stars 71 forks source link

Enhancing Argoverse 2 Motion Forecasting Dataset: Adding Objects from Sensor Annotations #234

Closed seokyeongbaek closed 4 months ago

seokyeongbaek commented 7 months ago

Hello. I am trying to make predictions using the Argoverse 2 Motion Forecasting Dataset.

I have confirmed that the ObjectType class in av2/datasets/motion_forecasting/data_schema.py consists of four Dynamic Movers.

Is it possible to add objects defined in av2/datasets/sensor/constants.py's annotationCategories class, such as 'WHEELED_DEVICE,' to the motion_forecasting ObjectType?

Does the data within the motion_forecasting dataset exclusively consist of objects defined in av2/datasets/motion_forecasting/data_schema.py?

Any feedback is appreciated.

wqi commented 4 months ago

Hi @seokyeongbaek, you are correct that the sensor dataset has a more detailed object ontology than the motion forecasting dataset.

Given that Argo has shut down and we no longer have access to raw data, we don't have any current plans to add additional object types to the MF dataset. However, given the large size of the MF dataset, the existing dataset almost certainly contains some instances of wheeled devices, likely under the pedestrian object type.