-
## ❓ Questions and Help
I have downloaded pretrained models
[VQVAE](https://drive.google.com/file/d/11QKoXEG1NeFqUyLg4kOjkJTgQsiYHpdu/view)
[Your pretrained checkpoint](https://drive.google.com/fil…
-
作者您好,我在使用半监督方式在自己的数据集上训练的时候,按照您给的config文件设置了200个epoch,在训练到大约10个epoch的时候模型的表现会达到最好,但是继续训练模型的表现会出现大幅下降,请问这是哪个参数没有设置好吗?我自己的数据集有15个类别,类别分布不太均衡,下面是我的训练参数,使用了两块gpu,感谢您的工作和回复!
`{'criterion': {'kwargs': {'…
-
### System Info
- `transformers` version: 4.28.0.dev0
- Platform: Linux-3.10.0-1160.81.1.el7.x86_64-x86_64-with-glibc2.17
- Python version: 3.11.2
- Huggingface_hub version: 0.13.3
- Safetensor…
-
Hi~ I noticed for the INKD loss in contrastive_training_1.py, the 'imagenet' dataset is used as a fixed auxiliary dataset (Line 602). I am wondering if this means only for the experiment on imagenet, …
-
Zichen Wang. [Contrasting contrastive loss functions](https://towardsdatascience.com/contrasting-contrastive-loss-functions-3c13ca5f055e).
-
### System Info
- `transformers` version: 4.27.4
- Platform: Linux-5.4.0-107-generic-x86_64-with-glibc2.31
- Python version: 3.9.16
- Huggingface_hub version: 0.13.3
- PyTorch version (GPU?): 2…
-
Thanks your work, in your code, I notice a inkd_loss which not mentioned(or maybe I have not found it.). I am curious about the function of inkd_loss, and the use of Imagenet1K dataset.
In addition…
-
Hi, could you add our CVPR2023 paper on 3D Semantic Segmentation and Point Cloud? Thanks!
Title: Self-Supervised Image-to-Point Distillation via Semantically Tolerant Contrastive Loss
Link: https:…
-
Thanks Kevin for this amazing library.
The data I am using for contrastive learning is skewed (28 classes with 1 class occupying about 35% of data).
I have written a custom sampler that creates a …
-
Hello there,
In the HuggingFace implementation the dot product of the text and image embeddings are scaled by `logit_scale`:
https://github.com/huggingface/transformers/blob/main/src/transformers/…