tinyvision / DAMO-YOLO

DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.
Apache License 2.0
3.75k stars 470 forks source link

Fix TRT8 export for end2end.py #113

Open ZlodeiBaal opened 1 year ago

ZlodeiBaal commented 1 year ago

box_coding should be 0 to correspond with network output [x1, y1, x2, y2]. Same box coding using for TRT7.

After this fix, TRT8 export successfully work.

Same problem is probably here - https://github.com/tinyvision/DAMO-YOLO/issues/102

ategen3rt commented 11 months ago

I also ran into this bug and independently came up with the same fix. It's a problem if you do the end2end export with TRT8. I've confirmed it works.