search

thuiar / MMSA

MMSA is a unified framework for Multimodal Sentiment Analysis.
MIT License
634 stars 104 forks source link

Regarding the Results in result-stat.md #81

Closed Haoyu-ha closed 7 months ago

Haoyu-ha commented 7 months ago

Are these results using a single random seed or an average of the results corresponding to five random seeds? Are the results from all models with the same random seed?

Columbine21 commented 7 months ago

Yes, we report the average model performance with five random seeds (for fair comparison we use the same for different model.)

Haoyu-ha commented 7 months ago

Thanks for your reply. Could you tell me what these five seeds are? Is it from 1111 to 1115 or some other value?

Columbine21 commented 7 months ago

[1111, 1112, 1113, 1114, 1115] are used here. But in fact, deviations may still exist due to different version python labs or different types of gpus.

Haoyu-ha commented 7 months ago

OK. Thank you for your help!