search

iejMac / encoder-distill

Align embedding spaces of PyTorch encoders with common input types.
MIT License
4 stars 0 forks source link

Try to ensemble 2 clip by targeting their sum #12

Open rom1504 opened 2 years ago

rom1504 commented 2 years ago

If we can extract the knowledge of one clip, can we extract the knowledge of 2, of N ?

Experiments

  1. Compute zero shot using normalized (normalized (a)+normalized (b))
  2. Distill towards that