open-mmlab / mmcv

OpenMMLab Computer Vision Foundation
https://mmcv.readthedocs.io/en/latest/
Apache License 2.0
5.81k stars 1.62k forks source link

May mmcv support the stack version for the multi-scale deformable attention? #2057

Open exiawsh opened 2 years ago

exiawsh commented 2 years ago

Describe the feature The multi-scale deformable attention provided in mmcv is the batch version, could mmcv support the stack version? Motivation A clear and concise description of the motivation of the feature. Ex1. It is inconvenient when processing the two stage multi-camera detection task, similar application scenarios could be found in nuscenes dataset, that's mean the number of proposals provided in the first stage is not equal. Ex2. There is a recent similar implementation cases could be found in openpcdet, which provides stack_version of point-net, could multi-scale deformable attention have the similiar implementation?

Related resources the pointnet stack version in openpcdet the ROI align in mmcv

Additional context

HAOCHENYE commented 2 years ago

Thanks for your advice~, We may invite @jshilong to have a look.

jshilong commented 2 years ago

Good suggestion, but we may not have enough time to do this recently, any community PR is welcome