search

Visual-Behavior / detr-tensorflow

Tensorflow implementation of DETR : Object Detection with Transformers
MIT License
168 stars 53 forks source link

DEFORMABLE DETR Implementation #9

Open thibo73800 opened 3 years ago

thibo73800 commented 3 years ago

Implement this paper

https://openreview.net/pdf?id=gZ9hCDWe6ke

DETR has been recently proposed to eliminate the need for many hand-designed
components in object detection while demonstrating good performance. However,
it suffers from slow convergence and limited feature spatial resolution, due to the
limitation of Transformer attention modules in processing image feature maps. To
mitigate these issues, we proposed Deformable DETR, whose attention modules
only attend to a small set of key sampling points around a reference. Deformable
DETR can achieve better performance than DETR (especially on small objects)
with 10× less training epochs. Extensive experiments on the COCO benchmark
demonstrate the effectiveness of our approach. Code shall be released.
PhanTask commented 3 years ago

Excuse me, but when will this be implemented? Do you have a specific plan now?

thibo73800 commented 3 years ago

Yes, we have a working version. I will move everything including mask & deformable and multi-scale training starting by the end of this week.

PhanTask commented 3 years ago

@thibo73800 Wow that would be fabulous! Thanks for your great efforts!

PhanTask commented 3 years ago

Hi Thibo @thibo73800 , just wondering when will the deformable version be updated. If you still need more time to wrap up things, could you share with me a copy of the code so that I can have a chance to test it? I am currently working on re-implementing TrackFormer, which is based on deformable DETR. Thanks!

thibo73800 commented 3 years ago

Hi ! I have been quite busy during the last two last weeks with other projects. But the multi-scale training part is almost ready. Once done I will import Deformable. Getting a first working script should not take too long.

Great for your implementation of trackformer, we did it as well.

Since you'll probably benefit from getting a WIP version in this repo, as soon as I have a first working script on this repo I will push the code on another branch for you to test it. Probably/Hoping before next Tuesday.

Best, Thibault

PhanTask commented 3 years ago

@thibo73800 that sounds great!! Thanks for your great efforts! You did a great job!

thibo73800 commented 3 years ago

WIP here https://github.com/Visual-Behavior/detr-tensorflow/pull/25

PhanTask commented 3 years ago

@thibo73800 Awesome! Gonna check this out. Thanks!

amirbar commented 3 years ago

Thanks for working on this @thibo73800. Do you happen to have some MS COCO results with the Deformable DETR impl? are you able to reproduce similar results as in the paper?