search

rohban-lab / Knowledge_Distillation_AD

82 stars 46 forks source link

Question about source network #13

Open akhra92 opened 1 year ago

akhra92 commented 1 year ago

Is it possible to use pretrained WideResNet50_2 model, which is available in pytorch, instead of Vgg16 that you guys used here? If yes, what are the nuances that should be paid attention to? Thanks in advance.

akhra92 commented 1 year ago

Additional question, could you please give instructions how to use this model with our custom dataset.

SMSD75 commented 1 year ago

Hi,

Resnet based models usually have batch normalisation, which might cause some problems. I haven’t tested any ResNet based model; yet, you can use transformers. I have tested our method with transformers and it gets SOTA results.

akhra92 commented 1 year ago

Is it possible for you to share the code for transformers based approach?

SMSD75 commented 1 year ago

I can provide the code; yet it might take a few weeks.

akhra92 commented 1 year ago

Thank you in advance! I will appreciate it