multimodal inputs of clinical information in multiple instance learning

[NaokiThread]

Feature

Multimodal inputs like clinical information in Multiple-instance learning

Pitch

When doing multiple-instance learning, as far as I read GitHub and the document, it seems we cannot use clinical information as input. I would appreciate it if you could let me know how I can conduct such kinds of calculations.

[jziggles]

"Multimodal models In addition to training using image data, clinical data can also be provided as model input by passing annotation column headers to the variable input_header. This input is concatenated at the post-convolutional layer, prior to any configured hidden layers. If desired, models can also be trained with clinical input data alone, without images, by using the hyperparameter argument drop_images=True."

https://slideflow.dev/training/

Per the github, this is included - I have not used it yet. Hope this helps.