search

pliang279 / MultiBench

[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning
MIT License
462 stars 68 forks source link

Questions about the im.pk data & MFM #37

Closed wccch closed 3 months ago

wccch commented 3 months ago

How exactly are the im.pk files used in healthcare examples obtained and pre-processed? For example, what is the specific content of the label in the im.pk file, what is the specific data of the two modes in the im.pk file, and what data is recorded? Finally, I would like to ask what is the specific MFM method mentioned and used in the project, and what is the full name of MFM? I would really appreciate your reply! As I have been preparing my project recently, the multibench subject has helped me a lot!

lvyiwei1 commented 3 months ago

Hi wccch, for details about how we processed MIMIC-III to obtain im.pk, please refer to Appendix C.2.2 in our paper The data in the two modes are the 5 static features and 12 timeseries features from feature set A of Purushotham et al (see reference [129] in our paper). MFM stands for Multimodal Factorized Model (see reference [155] in our paper). Hope this helps!

wccch commented 3 months ago

Thanks for your prompt reply！