Closed cddlyf closed 2 years ago
Hi @wvangansbeke , for masked image modeling, I have two suggested papers:
PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers BEVT: BERT Pretraining of Video Transformers, CVPR 2022
Hi @cddlyf,
Thanks! I will add them.
Hi @wvangansbeke , for masked image modeling, I have two suggested papers:
PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers BEVT: BERT Pretraining of Video Transformers, CVPR 2022