Zasder3 / train-CLIP

A PyTorch Lightning solution to training OpenAI's CLIP from scratch.
MIT License
653 stars 78 forks source link

Explanation #17

Open Akashcodes732 opened 3 years ago

Akashcodes732 commented 3 years ago

Can you please add the little more detailed explanation of the code and the self-distillation technique used to make it more efficient. Various parts of the code are somewhat hard to understand and thus I would request you add some explanation regarding the code as well.