facebookresearch / vilbert-multi-task

Multi Task Vision and Language
MIT License
797 stars 180 forks source link

Extracting vilbert representations #58

Open galsk87 opened 4 years ago

galsk87 commented 4 years ago

Is there any easy way to save representations from intermediate layers?

ecekt commented 4 years ago

Hello, I am also exploring how to extract representations, would it be possible if you could provide pointers on how to do that?

Best regards

enaserianhanzaei commented 3 years ago

@ecekt @galsk87

I wrote a step-by-step tutorial on how to set up the environment, train and test this model. I also added a section on extracting the visiolinguistic embeddings from the image-text data. https://naserian-elahe.medium.com/vilbert-a-model-for-learning-joint-representations-of-image-content-and-natural-language-47f56a313a79 I very much appreciate any comments or suggestions