-
Tech Insights. [Graph contrastive learning](https://medium.com/@TechInsight/graph-contrastive-learning-b82dbef44f23).
Zhu Y, Xu Y, Liu Q, et al. [An empirical study of graph contrastive learning](htt…
-
Zichen Wang. [Contrasting contrastive loss functions](https://towardsdatascience.com/contrasting-contrastive-loss-functions-3c13ca5f055e).
-
# Add default parameters for all projection heads
It's helpful to know what the default parameters were in the papers to get started. We should add the default projection head parameters which were…
-
Sik-Ho Tsang. [Review: Representation Learning with Contrastive Predictive Coding (CPC/CPCv1)](https://sh-tsang.medium.com/review-representation-learning-with-contrastive-predictive-coding-cpc-cpcv1-8…
-
### System Info
- `transformers` version: 4.28.0.dev0
- Platform: Linux-5.4.0-144-generic-x86_64-with-debian-bullseye-sid
- Python version: 3.7.16
- Huggingface_hub version: 0.13.2
- PyTorch ve…
-
EDITED:
DirectoryStore is slow, presumably due to saving to disk. However, MemoryStore is also really slow using some parameters. (namely when you use it for a dataset which does not have any paralle…
-
Seeing as lightly has a ton of great models for self-supervised representation learning for "classification tasks," are there any plans in the future to implement methods for self-supervised object de…
-
Sik-Ho Tsang. [Brief Review — Learning Deep Representations by Mutual Information Estimation and Maximization](https://sh-tsang.medium.com/brief-review-learning-deep-representations-by-mutual-informat…
-
I'm trying to experiment with PyTorch some model; the dataset they were using for the experiment is [`sst`][1]
But I'm also learning PyTorch, so I thought it would be better to play with `Dataset` …
-