search

Justin1904 / TensorFusionNetworks

Pytorch Implementation of Tensor Fusion Networks for multimodal sentiment analysis.
167 stars 44 forks source link

How can I get the contribution of each modality? #12

Open antecede opened 3 years ago

antecede commented 3 years ago

Dear Justin,

I saw the article in https://towardsdatascience.com/multimodal-deep-learning-ce7d1d994f4, but I did not see the code about the contribution of each modality. Besides, I saw some descriptions about the loss function on the website https://purvanshi.github.io/documents/Multimodalppt.pdf, when I saw the code I could not find where it is.

Thank you very much and I am looking forward to your reply.

Best wishes

Justin1904 commented 3 years ago

This repo implements this specific paper. I don't see how it relates to the two links you shared, except that the broader topic is all on multimodality. If you are looking for where the different modalities are fused together, it is here. For the loss function, the paper I referred to as well as this repo does not propose/implement any novel loss function and uses a conventional L1 loss for regression here.