Closed efabb95 closed 4 years ago
Is this still relevant? If so, what is blocking it? Is there anything you can do to help move it forward?
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
excuse me did you solve it ?
Hi @mathshangw, I took embeddings of this two models and then fuse them in a new one network, but performance was not very satisfying. This is my thesis, if you want to check my solution you can find the code here: https://github.com/efabb95/Emotion-recognition-with-neural-network-attention-based-model
thanks a lot for replying and the link .. excuse me I'm trying to concatenate two models by extracting the embedding for the sentence but got
ValueError: Layer weight shape (30522, 768) not compatible with provided weight shape torch.Size([1, 15, 768])
I didn't use pytorch, however you have to check your input because you are passing a matrix instead of a tensor.
thanks a lot, another question, please . I read that bert work on subwords so if I need to get the caption for the image , should i use sentence embedding or word embedding ? appreciate your time
Do you carry out hate speech recognition/emotion recognition or something else? BERT returns in the first position [0] the sentence embeddings, in the other positions [1..N] the words embeddings. For me it's better to use sentence embeddings so that you don't have to deal with the different number of words in each sentence. In my thesis I used only sentence embeddings.
I'm trying to concatenate two model in one. I have a BERT model and EfficientNet model.
But I got this error:
How can I merge this two models?