wjun0830 / QD-DETR

Official pytorch repository for "QD-DETR : Query-Dependent Video Representation for Moment Retrieval and Highlight Detection" (CVPR 2023 Paper)
https://arxiv.org/abs/2303.13874
Other
207 stars 16 forks source link

Pretraining Modules with Contrastive Learning? #39

Closed Summer-seu closed 7 months ago

Summer-seu commented 8 months ago

Did you first pretrain the modules (Cross-Attn Trans & Trans Enc) using contrastive learning, and then train the entire model?

wjun0830 commented 8 months ago

For the experiments in the paper, there were no pre-training stages.