ouyanghaodong / DEYO

Implementation of paper - DEYO: DETR with YOLO for End-to-End Object Detection
GNU Affero General Public License v3.0
72 stars 5 forks source link

CrowdHuman weights #12

Open ponjoru opened 7 months ago

ponjoru commented 7 months ago

Thank you for a great work!

  1. Could you please share the DEYO CrowdHuman weights and training config?
  2. Have you compared DEYO vs RTDETR performance on the CrowdHuman dataset? I have only noticed DEYO vs YOLO comparison in the paper.
ouyanghaodong commented 7 months ago

The training configuration for DEYO is kept consistent on the CrowdHuman as it is on COCO. Considering that RT-DETR lacks a pre-trained model on CrowdHuman, we have not included it in our comparison. Since the hyperparameters have not been adjusted, the models obtained might not be optimal, whether it is during the first stage of DEYO training or the second stage of DEYO training. Therefore, we currently have no plans to share the pre-trained weights. However, you can easily reproduce these results by simply adjusting the number of classes (nc=1).

kennyvoo commented 1 month ago

Hello, may I ask if the following result can be reproduced by using the following settings with single GPU?

Model   Strategy    Epochs  AP50
DEYO-N  Step-by-step    72  83.0
model = RTDETR("yolov8-rtdetr.yaml")
model.load("yolov8n.pt")
model.train(data = "crowdhuman.yaml", epochs = 72, lr0 = 0.0001, lrf = 0.0001, weight_decay = 0.0001, optimizer = 'AdamW', warmup_epochs = 0, mosaic = 1.0, close_mosaic = 24)
ouyanghaodong commented 1 month ago

The experiments were conducted on a single GPU. The evaluation metrics for CrowdHuman differ from those for COCO; we used the code provided by Iter-Deformable-DETR for our experiments.

kennyvoo commented 1 month ago

Thank you. I have managed to reproduce the result of 0.83 when threshold is 0.3.