Codes about self-supervision

google-research / vision_transformer

Apache License 2.0

9.71k stars 1.24k forks source link

Codes about self-supervision #77

Open Seanseattle opened 3 years ago

Seanseattle commented 3 years ago

Hello. This is a wonderful paper. Currently, I want to use the ViT for the other application. So I want to pretrain ViT on my dataset. Could you share the pretrain codes about self-supervision mentioned in the supplementary? Thank you.

lucasb-eyer commented 3 years ago

Hi, we do not plan to release the code for this, as it were just some preliminary experiments.