Project page for paper Self-supervised Representation Learning with Relative Predictive Coding.
The codebase consists of the following parts:
Contrastive Self-Supervised Learning on visual tasks.
See vision
folder for more details.
Mutual Information Estimation on two Gaussians with varied correlation.
See gaussian/Gaussian.ipynb
for more details.
@article{tsai2021self,
title={Self-supervised representation learning with relative predictive coding},
author={Tsai, Yao-Hung Hubert and Ma, Martin Q and Yang, Muqiao and Zhao, Han and Morency, Louis-Philippe and Salakhutdinov, Ruslan},
journal={arXiv preprint arXiv:2103.11275},
year={2021}
}