search

WasifurRahman / BERT_multimodal_transformer

194 stars 30 forks source link

Two numbers of BA and F1 #16

Closed stdoo closed 3 years ago

stdoo commented 3 years ago

Hi, I am reading your paper recently and I am a bit confused about the two numbers of BA and F1. I have tried to find the calculation on the left side of "/", but the metric code is not provided. So, what's the difference between these two calculations? Is it possible to switch them in your code?

RE-N-Y commented 3 years ago

In MOSI/MOSEI datasets, there are instances where a "neutral label" (i.e. 0) is provided. In previous papers, authors have evaluated performances by including/excluding these instances. That's why we provided both metrics in the paper. The method test_score_model provides an option (use_zero) to select between these metrics.

stdoo commented 3 years ago

@RE-N-Y Thanks a lot.