search

dyabel / detpro

Apache License 2.0
174 stars 28 forks source link

Runtime error #8

Closed Kyfafyd closed 2 years ago

Kyfafyd commented 2 years ago

Dear Author,

When I am trying run the code, the following command:

python prompt/run.py train data/lvis_clip_image_proposal_embedding/train data/lvis_clip_image_proposal_embedding/val checkpoints/exp fg_bg_5_5_6_end soft 0.5 0.5 0.6 8 end

I meet such error:

['prompt/run.py', 'train', 'data/lvis_clip_image_proposal_embedding/train', 'data/lvis_clip_image_proposal_embedding/val', 'checkpoints/exp', 'fg_bg_5_5_6_end', 'soft', '0.5', '0.5', '0.6', '8', 'end']
jit version
Initializing a generic context
Initial context: "X X X X X X X X"
Number of context words (tokens): 8
Multiple GPUs detected (n_gpus=2), use all of them!
MODEL BUILD COMPLETE
Traceback (most recent call last):
  File "prompt/run.py", line 165, in <module>
    train_neg = sample(train_neg, len(train_neg[0])//int(neg_split), [866])
  File "prompt/run.py", line 111, in sample
    featk = torch.cat(featk, dim = 0)
RuntimeError: There were no tensor arguments to this function (e.g., you passed an empty list of Tensors), but no fallback function is registered for schema aten::_cat.  This usually means that this function requires a non-empty list of Tensors.  Available functions are [CPU, CUDA, QuantizedCPU, BackendSelect, Named, AutogradOther, AutogradCPU, AutogradCUDA, AutogradXLA, AutogradPrivateUse1, AutogradPrivateUse2, AutogradPrivateUse3, Tracer, Autocast, Batched, VmapMode].

CPU: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/build/aten/src/ATen/CPUType.cpp:2127 [kernel]
CUDA: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/build/aten/src/ATen/CUDAType.cpp:2983 [kernel]
QuantizedCPU: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/build/aten/src/ATen/QuantizedCPUType.cpp:297 [kernel]
BackendSelect: fallthrough registered at /opt/conda/conda-bld/pytorch_1603729096996/work/aten/src/ATen/core/BackendSelectFallbackKernel.cpp:3 [backend fallback]
Named: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/aten/src/ATen/core/NamedRegistrations.cpp:7 [backend fallback]
AutogradOther: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/torch/csrc/autograd/generated/VariableType_2.cpp:8078 [autograd kernel]
AutogradCPU: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/torch/csrc/autograd/generated/VariableType_2.cpp:8078 [autograd kernel]
AutogradCUDA: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/torch/csrc/autograd/generated/VariableType_2.cpp:8078 [autograd kernel]
AutogradXLA: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/torch/csrc/autograd/generated/VariableType_2.cpp:8078 [autograd kernel]
AutogradPrivateUse1: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/torch/csrc/autograd/generated/VariableType_2.cpp:8078 [autograd kernel]
AutogradPrivateUse2: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/torch/csrc/autograd/generated/VariableType_2.cpp:8078 [autograd kernel]
AutogradPrivateUse3: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/torch/csrc/autograd/generated/VariableType_2.cpp:8078 [autograd kernel]
Tracer: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/torch/csrc/autograd/generated/TraceType_2.cpp:9654 [kernel]
Autocast: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/aten/src/ATen/autocast_mode.cpp:258 [kernel]
Batched: registered at /opt/conda/conda-bld/pytorch_1603729096996/work/aten/src/ATen/BatchingRegistrations.cpp:511 [backend fallback]
VmapMode: fallthrough registered at /opt/conda/conda-bld/pytorch_1603729096996/work/aten/src/ATen/VmapModeRegistrations.cpp:33 [backend fallback]

BTW, I have strictly followed the installation guide in readme and run prepare.sh. Looking forward to your reply!

Kyfafyd commented 2 years ago

I print out the shape as the following in load_data_new:

print(features[base].shape, features[novel].shape, features[neg].shape)

and it comes out as the following:

torch.Size([6519899, 512]) torch.Size([0, 512]) torch.Size([0, 512])
dyabel commented 2 years ago

I print out the shape as the following in load_data_new:

print(features[base].shape, features[novel].shape, features[neg].shape)

and it comes out as the following:

torch.Size([6519899, 512]) torch.Size([0, 512]) torch.Size([0, 512])

Hi, do you use the latest version?

Kyfafyd commented 2 years ago

I print out the shape as the following in load_data_new:

print(features[base].shape, features[novel].shape, features[neg].shape)

and it comes out as the following:

torch.Size([6519899, 512]) torch.Size([0, 512]) torch.Size([0, 512])

Hi, do you use the latest version?

Do I need to rerun prepare.sh?

Kyfafyd commented 2 years ago

When I am running the latest code, I meet the following model load warning. Is this normal?

[04/12 18:25:16] mmdet INFO: load checkpoint from current_mmdetection_Head.pth
2022-04-12 18:25:16,430 - mmdet - WARNING - The model and loaded state dict do not match exactly

missing keys in source state_dict: rpn_head.rpn_conv.weight, rpn_head.rpn_conv.bias, rpn_head.rpn_cls.weight, rpn_head.rpn_cls.bias, rpn_head.rpn_reg.weight, rpn_head.rpn_reg.bias, roi_head.bbox_head.fc_reg.weight, roi_head.bbox_head.fc_reg.bias, roi_head.mask_head.convs.0.conv.weight, roi_head.mask_head.convs.0.conv.bias, roi_head.mask_head.convs.1.conv.weight, roi_head.mask_head.convs.1.conv.bias, roi_head.mask_head.convs.2.conv.weight, roi_head.mask_head.convs.2.conv.bias, roi_head.mask_head.convs.3.conv.weight, roi_head.mask_head.convs.3.conv.bias, roi_head.mask_head.upsample.weight, roi_head.mask_head.upsample.bias, roi_head.mask_head.conv_logits.weight, roi_head.mask_head.conv_logits.bias, roi_head.clip_model.positional_embedding, roi_head.clip_model.text_projection, roi_head.clip_model.logit_scale, roi_head.clip_model.visual.class_embedding, roi_head.clip_model.visual.positional_embedding, roi_head.clip_model.visual.proj, roi_head.clip_model.visual.conv1.weight, roi_head.clip_model.visual.ln_pre.weight, roi_head.clip_model.visual.ln_pre.bias, roi_head.clip_model.visual.transformer.resblocks.0.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.0.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.0.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.0.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.0.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.0.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.0.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.0.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.0.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.0.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.0.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.0.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.1.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.1.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.1.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.1.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.1.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.1.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.1.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.1.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.1.mlp.c_proj.weight, 
roi_head.clip_model.visual.transformer.resblocks.1.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.1.ln_2.weight, roi_head.clip_model.visual.transformer.resbloc
ks.1.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.2.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.2.attn.in_proj_bias, roi_head.clip_model.
visual.transformer.resblocks.2.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.2.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.2.ln_
1.weight, roi_head.clip_model.visual.transformer.resblocks.2.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.2.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.2.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.2.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.2.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.2.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.2.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.3.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.3.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.3.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.3.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.3.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.3.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.3.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.3.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.3.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.3.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.3.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.3.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.4.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.4.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.4.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.4.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.4.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.4.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.4.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.4.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.4.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.4.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.4.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.4.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.5.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.5.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.5.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.5.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.5.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.5.l
n_1.bias, roi_head.clip_model.visual.transformer.resblocks.5.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.5.mlp.c_fc.bias, roi_head.clip_model.visual.transfo
rmer.resblocks.5.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.5.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.5.ln_2.weight, roi_head.c
lip_model.visual.transformer.resblocks.5.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.6.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.6.att
n.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.6.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.6.attn.out_proj.bias, roi_head.clip_mode
l.visual.transformer.resblocks.6.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.6.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.6.mlp.c_fc.weight, ro
i_head.clip_model.visual.transformer.resblocks.6.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.6.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resbl
ocks.6.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.6.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.6.ln_2.bias, roi_head.clip_model.visual.t
ransformer.resblocks.7.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.7.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.7.attn.out_proj
.weight, roi_head.clip_model.visual.transformer.resblocks.7.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.7.ln_1.weight, roi_head.clip_model.visual.transfo
rmer.resblocks.7.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.7.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.7.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.7.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.7.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resbloc[145/1857]
weight, roi_head.clip_model.visual.transformer.resblocks.7.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.8.attn.in_proj_weight, roi_head.clip_model.visual.transform
er.resblocks.8.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.8.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.8.attn.out_proj.bias, 
roi_head.clip_model.visual.transformer.resblocks.8.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.8.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.8.m
lp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.8.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.8.mlp.c_proj.weight, roi_head.clip_model.visual
.transformer.resblocks.8.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.8.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.8.ln_2.bias, roi_head.c
lip_model.visual.transformer.resblocks.9.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.9.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resbloc
ks.9.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.9.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.9.ln_1.weight, roi_head.clip_mo
del.visual.transformer.resblocks.9.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.9.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.9.mlp.c_fc.bias
, roi_head.clip_model.visual.transformer.resblocks.9.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.9.mlp.c_proj.bias, roi_head.clip_model.visual.transformer
.resblocks.9.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.9.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.10.attn.in_proj_weight, roi_head.clip_mod
el.visual.transformer.resblocks.10.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.10.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.1
0.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.10.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.10.ln_1.bias, roi_head.clip_model.visual.t
ransformer.resblocks.10.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.10.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.10.mlp.c_proj.weight,
 roi_head.clip_model.visual.transformer.resblocks.10.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.10.ln_2.weight, roi_head.clip_model.visual.transformer.resb
locks.10.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.11.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.11.attn.in_proj_bias, roi_head.clip_
model.visual.transformer.resblocks.11.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.11.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resbloc
ks.11.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.11.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.11.mlp.c_fc.weight, roi_head.clip_model.visual.
transformer.resblocks.11.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.11.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.11.mlp.c_proj.bias
, roi_head.clip_model.visual.transformer.resblocks.11.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.11.ln_2.bias, roi_head.clip_model.visual.ln_post.weight, roi_h
ead.clip_model.visual.ln_post.bias, roi_head.clip_model.transformer.resblocks.0.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.0.attn.in_proj_bias, roi_head.clip_
model.transformer.resblocks.0.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.0.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.0.ln_1.weight, roi_h
ead.clip_model.transformer.resblocks.0.ln_1.bias, roi_head.clip_model.transformer.resblocks.0.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.0.mlp.c_fc.bias, roi_head
.clip_model.transformer.resblocks.0.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.0.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.0.ln_2.weight, roi_h
ead.clip_model.transformer.resblocks.0.ln_2.bias, roi_head.clip_model.transformer.resblocks.1.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.1.attn.in_proj_bias, 
roi_head.clip_model.transformer.resblocks.1.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.1.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.1.ln_1
.weight, roi_head.clip_model.transformer.resblocks.1.ln_1.bias, roi_head.clip_model.transformer.resblocks.1.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.1.mlp.c_fc.
bias, roi_head.clip_model.transformer.resblocks.1.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.1.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.1.ln_2
.weight, roi_head.clip_model.transformer.resblocks.1.ln_2.bias, roi_head.clip_model.transformer.resblocks.2.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.2.attn.
in_proj_bias, roi_head.clip_model.transformer.resblocks.2.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.2.attn.out_proj.bias, roi_head.clip_model.transformer.re
sblocks.2.ln_1.weight, roi_head.clip_model.transformer.resblocks.2.ln_1.bias, roi_head.clip_model.transformer.resblocks.2.mlp.c_fc.weight, roi_head.clip_model.transformer.resbloc
ks.2.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.2.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.2.mlp.c_proj.bias, roi_head.clip_model.transformer.re
sblocks.2.ln_2.weight, roi_head.clip_model.transformer.resblocks.2.ln_2.bias, roi_head.clip_model.transformer.resblocks.3.attn.in_proj_weight, roi_head.clip_model.transformer.res
blocks.3.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.3.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.3.attn.out_proj.bias, roi_head.clip_model.
transformer.resblocks.3.ln_1.weight, roi_head.clip_model.transformer.resblocks.3.ln_1.bias, roi_head.clip_model.transformer.resblocks.3.mlp.c_fc.weight, roi_head.clip_model.trans
former.resblocks.3.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.3.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.3.mlp.c_proj.bias, roi_head.clip_model.
transformer.resblocks.3.ln_2.weight, roi_head.clip_model.transformer.resblocks.3.ln_2.bias, roi_head.clip_model.transformer.resblocks.4.attn.in_proj_weight, roi_head.clip_model.t
ransformer.resblocks.4.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.4.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.4.attn.out_proj.bias, roi_he
ad.clip_model.transformer.resblocks.4.ln_1.weight, roi_head.clip_model.transformer.resblocks.4.ln_1.bias, roi_head.clip_model.transformer.resblocks.4.mlp.c_fc.weight, roi_head.cl
ip_model.transformer.resblocks.4.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.4.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.4.mlp.c_proj.bias, roi_he
ad.clip_model.transformer.resblocks.4.ln_2.weight, roi_head.clip_model.transformer.resblocks.4.ln_2.bias, roi_head.clip_model.transformer.resblocks.5.attn.in_proj_weight, roi_hea
d.clip_model.transformer.resblocks.5.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.5.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.5.attn.out_pro
j.bias, roi_head.clip_model.transformer.resblocks.5.ln_1.weight, roi_head.clip_model.transformer.resblocks.5.ln_1.bias, roi_head.clip_model.transformer.resblocks.5.mlp.c_fc.weigh
t, roi_head.clip_model.transformer.resblocks.5.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.5.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.5.mlp.c_pro
j.bias, roi_head.clip_model.transformer.resblocks.5.ln_2.weight, roi_head.clip_model.transformer.resblocks.5.ln_2.bias, roi_head.clip_model.transformer.resblocks.6.attn.in_proj_w
eight, roi_head.clip_model.transformer.resblocks.6.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.6.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.
6.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.6.ln_1.weight, roi_head.clip_model.transformer.resblocks.6.ln_1.bias, roi_head.clip_model.transformer.resblocks.6.
mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.6.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.6.mlp.c_proj.weight, roi_head.clip_model.transformer.resbloc
ks.6.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.6.ln_2.weight, roi_head.clip_model.transformer.resblocks.6.ln_2.bias, roi_head.clip_model.transformer.resblocks.7.
attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.7.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.7.attn.out_proj.weight, roi_head.clip_model.transfor
mer.resblocks.7.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.7.ln_1.weight, roi_head.clip_model.transformer.resblocks.7.ln_1.bias, roi_head.clip_model.transformer.resblocks.7.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.7.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.7.mlp.c_proj.weight, roi_head.clip_model.trans
former.resblocks.7.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.7.ln_2.weight, roi_head.clip_model.transformer.resblocks.7.ln_2.bias, roi_head.clip_model.transforme
r.resblocks.8.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.8.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.8.attn.out_proj.weight, roi_head.clip_
model.transformer.resblocks.8.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.8.ln_1.weight, roi_head.clip_model.transformer.resblocks.8.ln_1.bias, roi_head.clip_mo
del.transformer.resblocks.8.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.8.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.8.mlp.c_proj.weight, roi_head.cl
ip_model.transformer.resblocks.8.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.8.ln_2.weight, roi_head.clip_model.transformer.resblocks.8.ln_2.bias, roi_head.clip_mo
del.transformer.resblocks.9.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.9.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.9.attn.out_proj.weight, 
roi_head.clip_model.transformer.resblocks.9.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.9.ln_1.weight, roi_head.clip_model.transformer.resblocks.9.ln_1.bias, ro
i_head.clip_model.transformer.resblocks.9.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.9.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.9.mlp.c_proj.weigh
t, roi_head.clip_model.transformer.resblocks.9.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.9.ln_2.weight, roi_head.clip_model.transformer.resblocks.9.ln_2.bias, ro
i_head.clip_model.transformer.resblocks.10.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.10.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.10.attn.
out_proj.weight, roi_head.clip_model.transformer.resblocks.10.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.10.ln_1.weight, roi_head.clip_model.transformer.resblo
cks.10.ln_1.bias, roi_head.clip_model.transformer.resblocks.10.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.10.mlp.c_fc.bias, roi_head.clip_model.transformer.resblo
cks.10.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.10.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.10.ln_2.weight, roi_head.clip_model.transformer.
resblocks.10.ln_2.bias, roi_head.clip_model.transformer.resblocks.11.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.11.attn.in_proj_bias, roi_head.clip_model.tran
sformer.resblocks.11.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.11.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.11.ln_1.weight, roi_head.cli
p_model.transformer.resblocks.11.ln_1.bias, roi_head.clip_model.transformer.resblocks.11.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.11.mlp.c_fc.bias, roi_head.cli
p_model.transformer.resblocks.11.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.11.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.11.ln_2.weight, roi_he
ad.clip_model.transformer.resblocks.11.ln_2.bias, roi_head.clip_model.token_embedding.weight, roi_head.clip_model.ln_final.weight, roi_head.clip_model.ln_final.bias, roi_head.bg_
embedding.weight, roi_head.bg_embedding.bias, roi_head.projection.weight, roi_head.projection.bias

[04/12 18:25:16] mmdet WARNING: The model and loaded state dict do not match exactly
dyabel commented 2 years ago

When I am running the latest code, I meet the following model load warning. Is this normal?

[04/12 18:25:16] mmdet INFO: load checkpoint from current_mmdetection_Head.pth
2022-04-12 18:25:16,430 - mmdet - WARNING - The model and loaded state dict do not match exactly

missing keys in source state_dict: rpn_head.rpn_conv.weight, rpn_head.rpn_conv.bias, rpn_head.rpn_cls.weight, rpn_head.rpn_cls.bias, rpn_head.rpn_reg.weight, rpn_head.rpn_reg.bias, roi_head.bbox_head.fc_reg.weight, roi_head.bbox_head.fc_reg.bias, roi_head.mask_head.convs.0.conv.weight, roi_head.mask_head.convs.0.conv.bias, roi_head.mask_head.convs.1.conv.weight, roi_head.mask_head.convs.1.conv.bias, roi_head.mask_head.convs.2.conv.weight, roi_head.mask_head.convs.2.conv.bias, roi_head.mask_head.convs.3.conv.weight, roi_head.mask_head.convs.3.conv.bias, roi_head.mask_head.upsample.weight, roi_head.mask_head.upsample.bias, roi_head.mask_head.conv_logits.weight, roi_head.mask_head.conv_logits.bias, roi_head.clip_model.positional_embedding, roi_head.clip_model.text_projection, roi_head.clip_model.logit_scale, roi_head.clip_model.visual.class_embedding, roi_head.clip_model.visual.positional_embedding, roi_head.clip_model.visual.proj, roi_head.clip_model.visual.conv1.weight, roi_head.clip_model.visual.ln_pre.weight, roi_head.clip_model.visual.ln_pre.bias, roi_head.clip_model.visual.transformer.resblocks.0.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.0.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.0.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.0.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.0.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.0.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.0.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.0.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.0.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.0.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.0.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.0.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.1.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.1.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.1.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.1.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.1.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.1.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.1.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.1.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.1.mlp.c_proj.weight, 
roi_head.clip_model.visual.transformer.resblocks.1.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.1.ln_2.weight, roi_head.clip_model.visual.transformer.resbloc
ks.1.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.2.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.2.attn.in_proj_bias, roi_head.clip_model.
visual.transformer.resblocks.2.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.2.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.2.ln_
1.weight, roi_head.clip_model.visual.transformer.resblocks.2.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.2.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.2.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.2.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.2.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.2.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.2.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.3.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.3.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.3.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.3.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.3.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.3.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.3.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.3.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.3.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.3.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.3.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.3.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.4.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.4.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.4.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.4.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.4.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.4.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.4.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.4.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.4.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.4.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.4.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.4.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.5.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.5.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.5.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.5.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.5.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.5.l
n_1.bias, roi_head.clip_model.visual.transformer.resblocks.5.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.5.mlp.c_fc.bias, roi_head.clip_model.visual.transfo
rmer.resblocks.5.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.5.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.5.ln_2.weight, roi_head.c
lip_model.visual.transformer.resblocks.5.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.6.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.6.att
n.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.6.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.6.attn.out_proj.bias, roi_head.clip_mode
l.visual.transformer.resblocks.6.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.6.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.6.mlp.c_fc.weight, ro
i_head.clip_model.visual.transformer.resblocks.6.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.6.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resbl
ocks.6.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.6.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.6.ln_2.bias, roi_head.clip_model.visual.t
ransformer.resblocks.7.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.7.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.7.attn.out_proj
.weight, roi_head.clip_model.visual.transformer.resblocks.7.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.7.ln_1.weight, roi_head.clip_model.visual.transfo
rmer.resblocks.7.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.7.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.7.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.7.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.7.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resbloc[145/1857]
weight, roi_head.clip_model.visual.transformer.resblocks.7.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.8.attn.in_proj_weight, roi_head.clip_model.visual.transform
er.resblocks.8.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.8.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.8.attn.out_proj.bias, 
roi_head.clip_model.visual.transformer.resblocks.8.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.8.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.8.m
lp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.8.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.8.mlp.c_proj.weight, roi_head.clip_model.visual
.transformer.resblocks.8.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.8.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.8.ln_2.bias, roi_head.c
lip_model.visual.transformer.resblocks.9.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.9.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resbloc
ks.9.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.9.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.9.ln_1.weight, roi_head.clip_mo
del.visual.transformer.resblocks.9.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.9.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.9.mlp.c_fc.bias
, roi_head.clip_model.visual.transformer.resblocks.9.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.9.mlp.c_proj.bias, roi_head.clip_model.visual.transformer
.resblocks.9.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.9.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.10.attn.in_proj_weight, roi_head.clip_mod
el.visual.transformer.resblocks.10.attn.in_proj_bias, roi_head.clip_model.visual.transformer.resblocks.10.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.1
0.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resblocks.10.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.10.ln_1.bias, roi_head.clip_model.visual.t
ransformer.resblocks.10.mlp.c_fc.weight, roi_head.clip_model.visual.transformer.resblocks.10.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.10.mlp.c_proj.weight,
 roi_head.clip_model.visual.transformer.resblocks.10.mlp.c_proj.bias, roi_head.clip_model.visual.transformer.resblocks.10.ln_2.weight, roi_head.clip_model.visual.transformer.resb
locks.10.ln_2.bias, roi_head.clip_model.visual.transformer.resblocks.11.attn.in_proj_weight, roi_head.clip_model.visual.transformer.resblocks.11.attn.in_proj_bias, roi_head.clip_
model.visual.transformer.resblocks.11.attn.out_proj.weight, roi_head.clip_model.visual.transformer.resblocks.11.attn.out_proj.bias, roi_head.clip_model.visual.transformer.resbloc
ks.11.ln_1.weight, roi_head.clip_model.visual.transformer.resblocks.11.ln_1.bias, roi_head.clip_model.visual.transformer.resblocks.11.mlp.c_fc.weight, roi_head.clip_model.visual.
transformer.resblocks.11.mlp.c_fc.bias, roi_head.clip_model.visual.transformer.resblocks.11.mlp.c_proj.weight, roi_head.clip_model.visual.transformer.resblocks.11.mlp.c_proj.bias
, roi_head.clip_model.visual.transformer.resblocks.11.ln_2.weight, roi_head.clip_model.visual.transformer.resblocks.11.ln_2.bias, roi_head.clip_model.visual.ln_post.weight, roi_h
ead.clip_model.visual.ln_post.bias, roi_head.clip_model.transformer.resblocks.0.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.0.attn.in_proj_bias, roi_head.clip_
model.transformer.resblocks.0.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.0.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.0.ln_1.weight, roi_h
ead.clip_model.transformer.resblocks.0.ln_1.bias, roi_head.clip_model.transformer.resblocks.0.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.0.mlp.c_fc.bias, roi_head
.clip_model.transformer.resblocks.0.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.0.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.0.ln_2.weight, roi_h
ead.clip_model.transformer.resblocks.0.ln_2.bias, roi_head.clip_model.transformer.resblocks.1.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.1.attn.in_proj_bias, 
roi_head.clip_model.transformer.resblocks.1.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.1.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.1.ln_1
.weight, roi_head.clip_model.transformer.resblocks.1.ln_1.bias, roi_head.clip_model.transformer.resblocks.1.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.1.mlp.c_fc.
bias, roi_head.clip_model.transformer.resblocks.1.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.1.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.1.ln_2
.weight, roi_head.clip_model.transformer.resblocks.1.ln_2.bias, roi_head.clip_model.transformer.resblocks.2.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.2.attn.
in_proj_bias, roi_head.clip_model.transformer.resblocks.2.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.2.attn.out_proj.bias, roi_head.clip_model.transformer.re
sblocks.2.ln_1.weight, roi_head.clip_model.transformer.resblocks.2.ln_1.bias, roi_head.clip_model.transformer.resblocks.2.mlp.c_fc.weight, roi_head.clip_model.transformer.resbloc
ks.2.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.2.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.2.mlp.c_proj.bias, roi_head.clip_model.transformer.re
sblocks.2.ln_2.weight, roi_head.clip_model.transformer.resblocks.2.ln_2.bias, roi_head.clip_model.transformer.resblocks.3.attn.in_proj_weight, roi_head.clip_model.transformer.res
blocks.3.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.3.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.3.attn.out_proj.bias, roi_head.clip_model.
transformer.resblocks.3.ln_1.weight, roi_head.clip_model.transformer.resblocks.3.ln_1.bias, roi_head.clip_model.transformer.resblocks.3.mlp.c_fc.weight, roi_head.clip_model.trans
former.resblocks.3.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.3.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.3.mlp.c_proj.bias, roi_head.clip_model.
transformer.resblocks.3.ln_2.weight, roi_head.clip_model.transformer.resblocks.3.ln_2.bias, roi_head.clip_model.transformer.resblocks.4.attn.in_proj_weight, roi_head.clip_model.t
ransformer.resblocks.4.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.4.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.4.attn.out_proj.bias, roi_he
ad.clip_model.transformer.resblocks.4.ln_1.weight, roi_head.clip_model.transformer.resblocks.4.ln_1.bias, roi_head.clip_model.transformer.resblocks.4.mlp.c_fc.weight, roi_head.cl
ip_model.transformer.resblocks.4.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.4.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.4.mlp.c_proj.bias, roi_he
ad.clip_model.transformer.resblocks.4.ln_2.weight, roi_head.clip_model.transformer.resblocks.4.ln_2.bias, roi_head.clip_model.transformer.resblocks.5.attn.in_proj_weight, roi_hea
d.clip_model.transformer.resblocks.5.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.5.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.5.attn.out_pro
j.bias, roi_head.clip_model.transformer.resblocks.5.ln_1.weight, roi_head.clip_model.transformer.resblocks.5.ln_1.bias, roi_head.clip_model.transformer.resblocks.5.mlp.c_fc.weigh
t, roi_head.clip_model.transformer.resblocks.5.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.5.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.5.mlp.c_pro
j.bias, roi_head.clip_model.transformer.resblocks.5.ln_2.weight, roi_head.clip_model.transformer.resblocks.5.ln_2.bias, roi_head.clip_model.transformer.resblocks.6.attn.in_proj_w
eight, roi_head.clip_model.transformer.resblocks.6.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.6.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.
6.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.6.ln_1.weight, roi_head.clip_model.transformer.resblocks.6.ln_1.bias, roi_head.clip_model.transformer.resblocks.6.
mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.6.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.6.mlp.c_proj.weight, roi_head.clip_model.transformer.resbloc
ks.6.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.6.ln_2.weight, roi_head.clip_model.transformer.resblocks.6.ln_2.bias, roi_head.clip_model.transformer.resblocks.7.
attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.7.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.7.attn.out_proj.weight, roi_head.clip_model.transfor
mer.resblocks.7.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.7.ln_1.weight, roi_head.clip_model.transformer.resblocks.7.ln_1.bias, roi_head.clip_model.transformer.resblocks.7.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.7.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.7.mlp.c_proj.weight, roi_head.clip_model.trans
former.resblocks.7.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.7.ln_2.weight, roi_head.clip_model.transformer.resblocks.7.ln_2.bias, roi_head.clip_model.transforme
r.resblocks.8.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.8.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.8.attn.out_proj.weight, roi_head.clip_
model.transformer.resblocks.8.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.8.ln_1.weight, roi_head.clip_model.transformer.resblocks.8.ln_1.bias, roi_head.clip_mo
del.transformer.resblocks.8.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.8.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.8.mlp.c_proj.weight, roi_head.cl
ip_model.transformer.resblocks.8.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.8.ln_2.weight, roi_head.clip_model.transformer.resblocks.8.ln_2.bias, roi_head.clip_mo
del.transformer.resblocks.9.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.9.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.9.attn.out_proj.weight, 
roi_head.clip_model.transformer.resblocks.9.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.9.ln_1.weight, roi_head.clip_model.transformer.resblocks.9.ln_1.bias, ro
i_head.clip_model.transformer.resblocks.9.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.9.mlp.c_fc.bias, roi_head.clip_model.transformer.resblocks.9.mlp.c_proj.weigh
t, roi_head.clip_model.transformer.resblocks.9.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.9.ln_2.weight, roi_head.clip_model.transformer.resblocks.9.ln_2.bias, ro
i_head.clip_model.transformer.resblocks.10.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.10.attn.in_proj_bias, roi_head.clip_model.transformer.resblocks.10.attn.
out_proj.weight, roi_head.clip_model.transformer.resblocks.10.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.10.ln_1.weight, roi_head.clip_model.transformer.resblo
cks.10.ln_1.bias, roi_head.clip_model.transformer.resblocks.10.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.10.mlp.c_fc.bias, roi_head.clip_model.transformer.resblo
cks.10.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.10.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.10.ln_2.weight, roi_head.clip_model.transformer.
resblocks.10.ln_2.bias, roi_head.clip_model.transformer.resblocks.11.attn.in_proj_weight, roi_head.clip_model.transformer.resblocks.11.attn.in_proj_bias, roi_head.clip_model.tran
sformer.resblocks.11.attn.out_proj.weight, roi_head.clip_model.transformer.resblocks.11.attn.out_proj.bias, roi_head.clip_model.transformer.resblocks.11.ln_1.weight, roi_head.cli
p_model.transformer.resblocks.11.ln_1.bias, roi_head.clip_model.transformer.resblocks.11.mlp.c_fc.weight, roi_head.clip_model.transformer.resblocks.11.mlp.c_fc.bias, roi_head.cli
p_model.transformer.resblocks.11.mlp.c_proj.weight, roi_head.clip_model.transformer.resblocks.11.mlp.c_proj.bias, roi_head.clip_model.transformer.resblocks.11.ln_2.weight, roi_he
ad.clip_model.transformer.resblocks.11.ln_2.bias, roi_head.clip_model.token_embedding.weight, roi_head.clip_model.ln_final.weight, roi_head.clip_model.ln_final.bias, roi_head.bg_
embedding.weight, roi_head.bg_embedding.bias, roi_head.projection.weight, roi_head.projection.bias

[04/12 18:25:16] mmdet WARNING: The model and loaded state dict do not match exactly

Yes, it is normal.

Kyfafyd commented 2 years ago

Dear author,

I am using the latest code, and when I running prepare.sh, meeting an error:

AttributeError: module 'mmdet.models.roi_heads' has no attribute 'StandardRoIHeadColReuseStandardRoIHeadTEXTPrompt'
dyabel commented 2 years ago

Dear author,

I am using the latest code, and when I running prepare.sh, meeting an error:

AttributeError: module 'mmdet.models.roi_heads' has no attribute 'StandardRoIHeadColReuseStandardRoIHeadTEXTPrompt'

Thank you for pointing out, I have fixed that.

Kyfafyd commented 2 years ago

Again, I meet another error:

max_coordinate = boxes.max()
RuntimeError: operation does not have an identity.

Could you help me sort out?

dyabel commented 2 years ago

Again, I meet another error:

max_coordinate = boxes.max()
RuntimeError: operation does not have an identity.

Could you help me sort out?

Could you please provide more error info?