search

layer6ai-labs / xpool

https://layer6ai-labs.github.io/xpool/
116 stars 9 forks source link

Questions about xpool code implementation #22

Open fzb408 opened 11 months ago

fzb408 commented 11 months ago

Hello, thank you for such an excellent paper and work. I am very interested in your idea, may I ask if the xpool implementation code takes the video_pooled_features in the following code (is the model defined in ClipTransformer) and then calculates the similarity?

Looking forward to your answer! Thank you!

text_embeds, video_embeds_pooled = self.model(data)
output = sim_matrix_training(text_embeds, video_embeds_pooled, self.pooling_type)
X7J92 commented 10 months ago

Hello! I understand you're inquiring about a situation where training on the MSVD dataset results in the process being automatically killed by the system at a specific iteration. @fzb408