MST is the first work in MIM with Advanced Masking (attention-guided mask strategy) in NIPS 2021, it is not only the MIM + contrastive learning.

Lupin1998 / Awesome-MIM

[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)

https://openmixup.readthedocs.io/en/latest/awesome_selfsup/MIM.html

Apache License 2.0

299 stars 14 forks source link

MST is the first work in MIM with Advanced Masking (attention-guided mask strategy) in NIPS 2021, it is not only the MIM + contrastive learning. #5

Closed CASlzwde closed 1 year ago

Lupin1998 commented 1 year ago

Thanks for your suggestion @CASlzwde. We have fixed this issue in the latest commit. We are working on the MIM survey and will classify MST into two categories, i.e., advanced masking and combining MIM and CL.