fix masking formula bug and only calculate loss on masked tokens

dome272 / MaskGIT-pytorch

Pytorch implementation of MaskGIT: Masked Generative Image Transformer (https://arxiv.org/pdf/2202.04200.pdf)

MIT License

405 stars 35 forks source link

Open EmaadKhwaja opened 1 year ago

EmaadKhwaja commented 1 year ago

cosine schedule calculates the number of tokens which are UNMASKED