Closed hathawayxxh closed 2 years ago
Hi @hathawayxxh, thank you for your interest!
Histology CNN was frozen due to mitigate overfitting and training over-parameterized models with low sample-size data. In subsequent work, we have also explored training set-based network approaches for survival prediction of WSIs with multimodal fusion with genomics. In this work, the aggregation layers are trained together with Genomic SNN, but the CNN for extracting features is still frozen.
I believe you are looking at Version 1 of the arXiv. Please see the most recent arXiv version (Version 3).
The appendix and supplementary details are found in the most recent arXiv version as well. I will see to it that the TMI version is also up-to-date.
Your understanding is correct. Histological grading is determined via subjective interpretation of diagnostic slides via human pathologists. Though not a problem that would require multimodal data, molecular features such as IDH1 mutation and 1p/19q status are known to also correlate with histologic grades and subtypes, which is why performance improved. Though not explored in this paper, there is a lot of intrigue in the biomedical community towards understanding histology-omic correspondences and shared mutual information between these two modalities. For grade classification, one way we can think about this is that molecular features are similar in function to a "latent space" in contributing towards the phenotypic manifestation of morphological features, which then contributes towards grade prediction.
Thanks for your reply. My confusion is resolved.
Hi Richard,
Thank you for sharing the codes and data. I am very interested in your work. I have some concerns regarding the paper and the codes.
Looking forward to your reply. Thanks a lot for your time and attention.
Best, Xiaohan