some confusion about code

Wangt-CN / MTFN-RR-PyTorch-Code

The offical code for paper "Matching Images and Text with Multi-modal Tensor Fusion and Re-ranking", ACM Multimedia 2019 Oral

66 stars 18 forks source link

some confusion about code #4

Open sunyue11 opened 3 years ago

sunyue11 commented 3 years ago

sorry，I want to ask if you use the re-ranking in your code, because the loss function seem the same as the ranking loss.and it seems like that you do not construct text-text fusion

Wangt-CN commented 3 years ago

Hi, sorry for the late reply. The re-ranking is exactly used and it's a kind of "an after treatment". As discussed in paper, the rerank is not a loss during training, but more like an algorithm running in just few seconds. In this code base the text-text fusion is not included because of my bandwidth. However it's very similar to the image-text fusion network but just change the input to text-text. Please refer to issue #1 for the detail about text-text fusion and reranking.