search

YuHengsss / YOLOV

This repo is an implementation of PyTorch version YOLOV Series
Apache License 2.0
326 stars 46 forks source link

Pretrain base detector does not fit yolov++ #107

Closed Elstuhn closed 22 hours ago

Elstuhn commented 2 weeks ago 
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.0.0.conv.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.0.0.bn.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.0.0.bn.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.0.0.bn.running_mean is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.0.0.bn.running_var is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.0.0.bn.num_batches_tracked is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.0.1.conv.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.0.1.bn.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.0.1.bn.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.0.1.bn.running_mean is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.0.1.bn.running_var is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.0.1.bn.num_batches_tracked is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.1.0.conv.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.1.0.bn.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.1.0.bn.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.1.0.bn.running_mean is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.1.0.bn.running_var is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.1.0.bn.num_batches_tracked is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.1.1.conv.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.1.1.bn.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.1.1.bn.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.1.1.bn.running_mean is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.1.1.bn.running_var is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.1.1.bn.num_batches_tracked is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.2.0.conv.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.2.0.bn.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.2.0.bn.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.2.0.bn.running_mean is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.2.0.bn.running_var is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.2.0.bn.num_batches_tracked is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.2.1.conv.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.2.1.bn.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.2.1.bn.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.2.1.bn.running_mean is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.2.1.bn.running_var is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_convs2.2.1.bn.num_batches_tracked is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg.msa.qkv_cls.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg.msa.qkv_reg.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg.linear1.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg.linear1.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg.linear2.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg.linear2.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg.linear1_obj.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg.linear1_obj.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg.linear2_obj.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg.linear2_obj.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg_iou.msa.qkv_cls.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg_iou.msa.qkv_reg.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg_iou.linear1.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg_iou.linear1.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg_iou.linear2.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg_iou.linear2.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg_iou.linear1_obj.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg_iou.linear1_obj.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg_iou.linear2_obj.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.agg_iou.linear2_obj.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_pred.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.cls_pred.bias is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.obj_pred.weight is not in the ckpt. Please double check and see if this is desired.
2024-10-29 12:22:35 | WARNING  | yolox.utils.checkpoint:18 - head.obj_pred.bias is not in the ckpt. Please double check and see if this is desired.

Hello, I am trying to reproduce this work on my custom dataset. I have trained focal_large_base_vid model as base detector and ran python tools/vid_train.py -f ./exps/yolov++/v++_FocalLarge_decoupleReg.py -c ./base_det_56.pth --fp16 using the base detector but I am getting the log from above that the checkpoint does not fit the model. I am also getting bad results:

per class AP:
| class     | AP    | class   | AP   | class   | AP   |
|:----------|:------|:--------|:-----|:--------|:-----|
| Crack     | 0.000 | Debris  | nan  | Break   | nan  |
| Corrosion | nan   |         |      |         |      |
per class AR:
| class     | AR    | class   | AR   | class   | AR   |
|:----------|:------|:--------|:-----|:--------|:-----|
| Crack     | 0.000 | Debris  | nan  | Break   | nan  |
| Corrosion | nan   |         |      |         |      |
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.000
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.000
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.000
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.000
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = -1.000
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = -1.000
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.000
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.000
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.000
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.000
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = -1.000
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = -1.000

Please advise on how to fix this, thank you!

Elstuhn commented 22 hours ago

Nvm, I used VID dataset format according to ILSVRC and it worked, I think the ovis to coco function has some problems and causes incorrect conversion