search

albanie / collaborative-experts

Video embeddings for retrieval with natural language queries
https://www.robots.ox.ac.uk/~vgg/research/collaborative-experts/
Apache License 2.0
332 stars 55 forks source link

The retrieval performance of the teacher models #33

Closed JewelChen2019 closed 2 years ago

JewelChen2019 commented 2 years ago

I wonder if the teacher models perform better than the student model when doing retrieval?

ioanacroi commented 2 years ago

Hi,

Our final teacher is an ensemble of 3 models: gpt2-xl, gpt2-xl-F (finetuned) and w2v. You can check the performance of individual models in Fig. 2 from our paper. The performance of the ensemble is depicted in Fig. 6a from our paper. Overall the performance of this teacher is below the performance of TeachText.

Cheers!