albanie / collaborative-experts

Video embeddings for retrieval with natural language queries
https://www.robots.ox.ac.uk/~vgg/research/collaborative-experts/
Apache License 2.0
332 stars 55 forks source link

Fine tuning on different data #26

Closed Tortoise17 closed 3 years ago

Tortoise17 commented 3 years ago

Is it possible to take one trained engine and fine tune on other dataset?

ioanacroi commented 3 years ago

Hi,

It should be possible! If you use the exact same experts for both datasets then it should be straight-forward. Otherwise, you can still initialize some sub-parts of the model.

Cheers, Ioana

Tortoise17 commented 3 years ago

Thank you . If you can mention which files need to be changed and if the same trained experts can work on the change of the video files for fine tuning ? and any script to generate these experts (for fine tuning experts training) would be great help to reproduce the results for training of gated model.

ioanacroi commented 3 years ago

Regarding the feature extraction for new datasets please follow the conversation here.

Tortoise17 commented 3 years ago

@ioanacroi Yes I have seen but is there any working workflow instead manually each expert separately. maybe there is some tool which unites them

Tortoise17 commented 3 years ago

@ioanacroi Export of experts under one umbrella. I mean that.

Tortoise17 commented 3 years ago

@ioanacroi > Regarding the feature extraction for new datasets please follow the conversation here. Yes I have seen but is there any working workflow instead manually each expert separately. maybe there is some tool which unites them. Export of experts under one umbrella. I mean that.,