albanie / collaborative-experts

Video embeddings for retrieval with natural language queries
https://www.robots.ox.ac.uk/~vgg/research/collaborative-experts/
Apache License 2.0
332 stars 55 forks source link

Computing custom input #8

Open Deferf opened 4 years ago

Deferf commented 4 years ago

Hello. I'm doing a test run with a MSVD dataset, I wonder if it is possible to input custom queries (not predefined on a dataset). As I can see the dataset captions embeddings are precomputed (located in data/MSVD/structured-symlinks/raw-captions.pkl). In the paper you mention you use word2vec and the GPT model. Could you give more details of the implementation?

albanie commented 4 years ago

Hi @Deferf, that's a good suggestion. Will add an example script shortly.