Relative Predictive Coding

Project page for paper Self-supervised Representation Learning with Relative Predictive Coding.

The codebase consists of the following parts:

Vision Task

Contrastive Self-Supervised Learning on visual tasks.
See vision folder for more details.

Gaussian Task

Mutual Information Estimation on two Gaussians with varied correlation.
See gaussian/Gaussian.ipynb for more details.

Cite

RPC paper:

@article{tsai2021self,
  title={Self-supervised representation learning with relative predictive coding},
  author={Tsai, Yao-Hung Hubert and Ma, Martin Q and Yang, Muqiao and Zhao, Han and Morency, Louis-Philippe and Salakhutdinov, Ruslan},
  journal={arXiv preprint arXiv:2103.11275},
  year={2021}
}