search

zinengtang / TVLT

PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)
MIT License
120 stars 13 forks source link

The question for cmumosei. #6

Open AIXiaoBaiDemon opened 1 year ago

AIXiaoBaiDemon commented 1 year ago

Your work is great, thank you so much for sharing. I downloaded the CMU-MOSEI database according to the link you shared, but I found two problems.

  1. there is no labels_emotion folder in the file I downloaded, so I don't know where the emotion label is?
  2. There is a 'BA' folder under the 'labels' folder, I don't know what the content stored in it is? The folder doesn't exist in the file directory you're sharing.
Changezi001 commented 1 year ago

I have the same problem, I am also waiting for the author to share the labels_emotion folder

BDHU commented 1 year ago

+1 I suspect the BA folder might be for emotion analysis but isn't sure.

Changezi001 commented 1 year ago

I do not think that the BA folder is the labels_emotion folder. If it is then what do -1, -2, -3, 0, 1, 2, 3 correspond to? Because the CMU-MOSEI dataset has labels for six basic emotions, why do we have seven here? @zinengtang could you clear this confusion, please? and could you share the labels_emotion folder? We have been waiting for one month to get this folder.

AIXiaoBaiDemon commented 1 year ago

@BDHU @Changezi001 I want to use this method to apply it to real scenes, but almost always it is judged as happy, have you tried this?