liming-ai / AlignDet

Official code for ICCV 2023 Paper: AlignDet: Aligning Pre-training and Fine-tuning in Object Detection.
https://liming-ai.github.io/AlignDet/
Apache License 2.0
142 stars 13 forks source link

Hi,how can i get proposals with cluster info in detr #13

Closed Minorant closed 1 year ago

Minorant commented 1 year ago

Hi, thanks for your impressive work! I'm trying to run DETR on the VOC dataset, but I notice that only coco's post-clustering proposal is provided(train2017_ratio3size0008@0.5_cluster-id-as-class.json). So how can I generate my own post clustering proposal? Is there any code available or more detailed steps for this please, thanks!

liming-ai commented 1 year ago

Hi, thanks for your impressive work! I'm trying to run DETR on the VOC dataset, but I notice that only coco's post-clustering proposal is provided(train2017_ratio3size0008@0.5_cluster-id-as-class.json). So how can I generate my own post clustering proposal? Is there any code available or more detailed steps for this please, thanks!

Hi, thanks for your interest in AlignDet~

Since AlignDet is pre-trained on COCO, so we only provide the clustered proposals on COCO. When fine-tuning the pre-trained model on VOC, we have the ground truth annotations.

Unfortunately, we cannot release the code for the clustering proposal, but this procedure should be simple:

  1. Running the selective search algorithm (Please refer to SoCo) to obtain unsupervised proposals.
  2. Extracting the features of these proposals with RoI Align operation (Can be done with supervised/unsupervised backbone)
  3. Performing PCA algorithm to reduce the dimension of features (We use the dimension of 256, but others should also be fine)
  4. Using the K-means algorithm to cluster these proposals.

Thanks again for your question, I hope it can help you~