-
Implement a section of a BarlowTwins/VICReg pretrained encoder by a conditional GAN.
```
x : pulse ------fibration------------> E(x) : code
G(y') : pulse
-
## 🚀 Feature
Add `weight_decay_filter` and `lars_adaptation_filter` to LARS
### Motivation
weight decay typically shouldn't be applied to BatchNorm. See [fast.ai](https://www.fast.ai/2018/08/…
-
很棒的工作
1. 参考下mteb benchmark上现在表现较好的模型, 比如经典的gtr提出的unsupervised-pretrain, supervised-pretrain, finetune的三阶段,finetune可以参考instructor
2. 不要蒸馏open ai的embedding,从头训练即可, openai的结果我们内部benchmark在中文上并不是特别好
…
-
## 🚀 Feature
Add a PyTorch implementation of layer-wise adaptive rate scaling (LARS) from the paper "[Large Batch Training of Convolutional Networks](https://arxiv.org/abs/1708.03888)" by You, Gitm…
-
![MoCov1](https://github.com/youngtboy/Awesome-Self-Supervised-Vision-Pretrain/assets/66102178/0db281de-9c7c-4292-8e52-2fe125fb4afa)
![MoCov2](https://github.com/youngtboy/Awesome-Self-Supervised-Vis…
-
Hi, thanks for the great work. From the paper, the only objective function is the distance between predicted and encoded representations of target patches. Why does the model not converge to a trivial…
-
Any plan to include example of this loss function? Thanks
-
Dear Dr Gong,
I tried to fine-tune the audio encoder on ESC50 dataset using the pretrained CAV-MAE model. But the performance is far from expectation. I listed all the details and tricks that I hav…
-
-
Thank you for supporting these codes for our single GPU users.
I'm trying to train VGG 16 using my own dataset (28,685 * (224*224*4band) satellite data) for semantic segmentation with Moco V2.
T…