contrastive-learning-implementations
pytorch implementations of popular models for contrastive learning
Dependencies
- Python >= 3.6
- PyTorch >= 1.6
- (확정 X)
Agenda
- Instance-discrimination-based: SimCLR, MoCo, NPID, CLIP, Supervised CL, ...
- Clustering-based: SwAV, DeepClustering, ...
- Stop-gradient: BYOL, ...
- Time-Series: 잘 모르겠음
- Multimodal: CLIP, DeCLIP, ALIGN, FICLIP, ...
- Loss Functions: InfoNCELoss(=NT-Xent)
TODO
- 개발 프로세스 정립
- 활용 데이터셋
- Distributed Training
- Backbone Generalization
- Contrastive Learning에 얽매이지 않아도 될 것 같기도?
References