-
Hi author! thanks for your nice work.
I have a question about cls token in PVT.
In ViT and DeiT, cls token is appended at input embedding process. But PVT append cls token at input of last stage…
-
I just see the code for STViT-Swin, but not find the code for STViT-DeiT.
-
## 🐛 Bug
Assume you want to load a model using torch.hub. For instance:
`torch.hub.list('githubaddress', 'model', pretrained=True)`
Now assume in your own project you have a package named 'mod…
-
Hi, it's a wonderful work.
I am trying to replicate the results of the paper that have been fine-tuned to datasets. As you know, it often needs to take a long time to adjust hyper-parameters to get …
-
Hello, again bother, I would like to confirm that. line 10 in fold.sh file: **train_weight_path = "backbones/PASCAL/FPTrans/one_shot_DeiT/fold0.pth**"; As far as I know, fold0.pth should be a file, w…
-
Unrecognized model in D:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\models\Joy_caption_two\text_model. Should have a `model_type` key in its config.json, or contain one of the fo…
-
Hi, for anyone who interested in the implementation of LayoutLMv3. Transfomers have updated the code for mask image modeling and the code is based on DEIT. You can inherit the code to implement the Ma…
-
我使用的是deit_small模型，精度fine-tune至79.1%，
但是预测提供的cat.jpg的标签为
![94e270515ebd33ea0715891c07f575b](https://gi…
-
I loaded the pretrained weights “deit_tiny_patch16_224-a1311bcf.pth”, but there is an error "size mismatch for head.weight: copying a param with shape torch.Size([1000, 192]) from checkpoint, the shap…
Becai updated
7 months ago
-
Hi. thanks for your great job.
I trained deit-base with your QAT method using quant_train.py.
while training, it showed good eval TOP1 accuracy over 82 in early epoches.
but when I load the sav…