-
The model additional parameter number cannot match Table 1. in the paper.
| | wide-resnet-50 | resnet18 | DeiT | CaiT |
| ----------------- | -------------- | --------------- |…
-
/PatchVisionTransformer/deit/models.py", line 232, in similarity
high_order = (patches.mean(dim=(2, 3), deepdim=True) - patches / (img_size ** 2)) * (img_size ** 2) / (img_size ** 2 - 1)
TypeErr…
-
Hi, How can I know configurations used for pre-training models?
e.g. u_patchout, s_patchout_t, s_patchout_f etc...
Thank you!
-
Hi, I tried to replicate your speed experiment, I tested the deit_tiny, batch size=1, RTX3090 environment, after a few days of autotune, compared to tensorrt FP16, speed is still slower.
Here are t…
-
Can this code satisfied different size of image use your pretrained model? I found you use pretrained model from deit, and resize each image to 224 * 224? So can I define imgH and imgW another number …
-
### Branch
main branch (mmpretrain version)
### Describe the bug
while trying to run LeViT got this error.
NotImplementedError: MMPretrain doesn't support training in distillation mode.
### Env…
-
Hello,
I am using this command, but it does not save any masked images.
python3 main.py --model deit_small_patch16_shrink_base --fuse_token --base_keep_rate 0.7 --visualize_mask --n_visualization…
-
Hi Naseer, Thank you very much for your excited and insightful work! I have read the released codes but I am not sure how to train the model of mimicking dynamic behavior on static images. Could you p…
-
There are too many acronyms flying around Solid, without clear expansions in the Solid Community README or anywhere else easily discoverable (or I probably wouldn't be logging this issue).
I've bee…
-
It is a great project. I am very interested in Transformer in Transformer model.
I had use your model to train on Vehicle-1M dataset. Vehicle-1M is a fine graied visual classification dataset. When …