DearCaat / RRT-MIL

[CVPR 2024] Feature Re-Embedding: Towards Foundation Model-Level Performance in Computational Pathology
84 stars 7 forks source link

Survival Prediction performance #15

Open qingze-bai opened 4 hours ago

qingze-bai commented 4 hours ago

It's an exciting job, but I'm nowhere near the performance of the paper's implementation when I reproduce the Survival Prediction task, roughly 3 points less for each task? I followed the commands provided by github exactly and performed the grid search, is there any other parameter that needs to be changed?

DearCaat commented 3 hours ago

First, I apologize for any inconvenience caused by the survival reproduction-related issues. I'll try my best to answer your questions:

Reproduction results and parameters (5-fold cross-validation): Survival BLCA LUAD LUSC BLCA (UNI) LUAD (UNI) LUSC (UNI)
RRT-MIL 61+2.11 64.01+4.39 60.99+6.93 61.54+4.32 66.38+2.58 62.63+4.18
epeg_k=21,crmsa_k=1, region_num=20 epeg_k=17,crmsa_k=3, region_num=16 epeg_k=21,crmsa_k=1, region_num=20 epeg_k=9,crmsa_k=5, region_num=20 epeg_k=9,crmsa_k=5, region_num=16 epeg_k=9,crmsa_k=3, region_num=20
qingze-bai commented 3 hours ago

Thank you very much for the details, I have confidence in this and will continue to try. In fact I have reproduced the paper's comparable performance on all other tasks.

DearCaat commented 3 hours ago

Thank you very much for the details, I have confidence in this and will continue to try. In fact I have reproduced the paper's comparable performance on all other tasks.

Best wish for u research.