WangYueFt / detr3d

MIT License
745 stars 139 forks source link

Training diverge for different setting #41

Open bronyayang opened 2 years ago

bronyayang commented 2 years ago

Hi,

I was trying to test for different image encoder backbones.

The config file I am using was detr3d_res101_gridmask.py (https://github.com/WangYueFt/detr3d/blob/main/projects/configs/detr3d/detr3d_res101_gridmask.py).

I only change load_from='ckpts/fcos3d.pth' to load_from = None, then the model diverges. I change image backbone from ResNet 101 to 50 (pretrained using torchvision or detectron2 caffe) all diverges.

Do I have to use the exact given setting or did I do something wrong? How to change image encoder backbones or train it from scratch?