SPR pretrainer - Githubissues

thebes2 / RL

1 stars 0 forks source link

SPR pretrainer #5

Closed thebes2 closed 2 years ago

thebes2 commented 2 years ago

In the original paper, self-predictive representations is used as a self-supervised source of supervision for the latent. This allows it to be used for pretraining the vision head rather than using the contrastive losses currently.

thebes2 commented 2 years ago

Added by 5490d44eef431e55e3d497b26f2e421836b57235.