-
Каждый уважающий себя рисерчер должен в какой-то момент придумать свою собственную сетку. Вот и у меня есть такое желание. я много насмотрелся и думаю что могу сделать лучше объеденив разные идеи под …
-
### Summary
I noticed that your SSL models use weight decay for all their parameters, see for example:
https://github.com/microsoft/torchgeo/blob/0f8b0ac3eabf1e4156e7259d34b1b63e6df5d445/torchge…
-
There are a batch of models that fail the accuracy test in inference when freezing is enabled.
- TB: mnasnet1_0 , moco, shufflenet_v2_x1_0
- TIMM: adv_inception_v3, botnet26t_256, gluon_inception_v3…
-
### 🚀 The feature, motivation and pitch
I need to observe the strength of attention for each element in the sequence with all the elements in the same sequence. This is called the attention map in …
-
When training RDM, I have no idea if the model converges, so could you please provide some log for reference?
-
Dear authors,
Thanks for open-sourcing your great work!!!
However, I have a question about the SSL encoder:
I have noticed MoCo-v3 models are trained on ImageNet. Would they be influenced by the…
-
Sik-Ho Tang. [Review — MoCo v2: Improved Baselines with Momentum Contrastive Learning](https://sh-tsang.medium.com/review-moco-v2-improved-baselines-with-momentum-contrastive-learning-8b03598a0324).
-
Sik-Ho Tang. [Brief Review — Distilling Visual Priors from Self-Supervised Learning](https://sh-tsang.medium.com/brief-review-distilling-visual-priors-from-self-supervised-learning-e8377118e797).
-
Hi, I have a small-scale dataset of 10k+ images, and they are mainly about human crowd. I trained RDM with these images only, and generated images using pretrained mocov3 and MAGE model on imagenet, b…
-
作者您好!在文章中,TABLE I列出了多种自监督模型的对比实验;我用EyePACS的训练集对Moco-v3进行预训练,使用backbone也为VIT-S,最后在APTOS2019数据集上finetune得到最终的Kappa值为87%左右,而在您的论文中可以达到90%左右的结果,想问一下除了数据量不一样以外,还有哪些需要注意的地方吗?您对Moco-v3进行训练时,是完全遵循原始论文中的设置还是对哪…