search

microsoft / A-CLIP

Official Implementation of Attentive Mask CLIP (ICCV2023, https://arxiv.org/abs/2212.08653)
MIT License
15 stars 2 forks source link

Minor bug fixes for SimCLR loss and ViT-S hyperparameter #4

Open KishoreP1 opened 1 month ago

KishoreP1 commented 1 month ago
  1. Fixed SimCLR loss calculation in losses.py. I believe the current code does not compare the two different augmentations.
  2. ViT-S EMA mask ratio was previously set to mask_ratio from the user. I think this should be default to 0 like other ViT sizes.
KishoreP1 commented 1 month ago

@microsoft-github-policy-service agree