Dootmaan / DTFD-MIL.PyTorch

Unofficial implementation of CVPR2022 paper DTFD-MIL. Use the official CAMELYON16 dataset instead of the .pickle file used in the official DTFT-MIL repo.
MIT License
26 stars 0 forks source link

Questions about the test accuracy of only 0.8 #4

Open hemo0826 opened 1 year ago

hemo0826 commented 1 year ago

Hello, you have done an excellent job. We have encountered some problems in surfacing your work. There are frequent interruptions of downsample error and many error patches when extracting slices, so there may be errors when extracting slice features accordingly. So we would like to know if you can share the npy file of camelyon16 after feature extraction? We are looking forward to your reply!

Dootmaan commented 1 year ago

Hi @hemo0826 and thank you for your question. You test set performance seems to be very different from the results in issue #2. But anyway, I will upload the preprocessed .npy files later.

Dootmaan commented 1 year ago

The preprocess dataset is about 16GB and currently I have run out of Google Drive space. I will find an alternative platform to upload these files, and when the uploading is done you will receive a notification.

titizheng commented 1 year ago

Hello, first of all, thank you for your insights. However, I'm currently facing a situation where I'm achieving a maximum accuracy of only 0.81 on the 129 test samples in the 16-challenge. I've used the data preprocessing methods provided by CLAM, and I'm using a pre-trained ResNet50 on ImageNet to extract features. Would it be possible for you to share the trained model parameters after your training? I'd like to further test to see if the issue lies with the data. Looking forward to your response, and thank you very much.