facebookresearch / detr

End-to-End Object Detection with Transformers
Apache License 2.0
13.08k stars 2.37k forks source link

How can I use DETR to detect rotated bbox #586

Open spcrobocar opened 1 year ago

spcrobocar commented 1 year ago

Can I use DETR to detect objects with rotated bbox?

praveenVnktsh commented 1 year ago

You'll have to modify the architecture a bit and add a few parameters that represent the angle of the bounding box. Im not sure why you would want to predict rotated boxes, but in order to make it play nicely with the modulo properties of angles, you'll likely have to encode it as a parametric function (sinusoidals) with some extra loss terms to make the angle follow constraints.