search

hli1221 / imagefusion-rfn-nest

RFN-Nest(Information Fusion, 2021, Highly Cited Paper) - PyTorch =1.5，Python=3.7
111 stars 18 forks source link

about RFN-Net #1

Open huhuchao opened 3 years ago

huhuchao commented 3 years ago

Hello, Teacher Li: Fortunately to read your <>this article. I think your work is very innovative! Here are a few questions I would like to take up your precious time to consult you. (1) You applied the RFN network proposed in your article to Tracking. I don't know if I understand your work correctly. You have modified the loss function of RFN, and added the loss of infrared light features to Ldetail to make the generated image easier for target detection. Then use the network trained in this way to fuse the images, and then use this image for Tracking? (2) The pre-training weights provided in your code are for grayscale images. Do you have pre-training weights for RGB images. Thank you very much for reading my email during your busy schedule. I wish you good health and success in your work!

wanghangege commented 1 year ago

I am not the author, for your second question, I have the same problem, and I modify the code in this repository, I find the rgb version can not be used, the only way I think, you can split rgb image to r, g, and b, than combine them after test. Have you ever complete it by another way?

hli1221 commented 1 year ago

Hi, thanks for your attention. I am very sorry to reply you so late. For the first question, the RFN was embedded into tracker (like Siamese RPN++) to fuse deep features, rather than fed the fused image to tracker. For the second question, you can refer the above answer or you can train the RGB version network.