search

open-mmlab / OpenMMLabCourse

OpenMMLab course index and stuff
https://open-mmlab.github.io/OpenMMLabCourse/
Other
987 stars 119 forks source link

How to extract image embeddings and caption embeddings ? Thank you #49

Open jkentmanning opened 6 months ago

jkentmanning commented 6 months ago

I am a student in Toronto learning about multimodal models and multimodal retrieval. Can embeddings be extracted from your models ? I would like to compare retrieval results from your model to CLIP. Also, my Mandarin understanding is not good. If you have time, if you could please provide some tutorial videos in english, I would be very grateful. Thank you for feedback. Thank you for publishing your work, which seems excellent! Regards, Kent

wangruohui commented 6 months ago

Hi,

You may refer to https://github.com/open-mmlab/mmpretrain?tab=readme-ov-file#model-zoo. There are some multimodal models.