search

RyanWangZf / MedCLIP

EMNLP'22 | MedCLIP: Contrastive Learning from Unpaired Medical Images and Texts
394 stars 41 forks source link

Does Medclip only performs better on X-ray modality? #34

Open srushti98 opened 7 months ago

srushti98 commented 7 months ago

In the paper, the pre-training and evaluation datasets all were of X-ray modality. Do you have any information about how it will perform on other radiology modalities like Mammographs, MRI? Can you share any evaluations of that sort?

GuilhermeJC13 commented 6 months ago

Same question here, I will be testing this hypothesis. If you get any results, would be happy to hear about it!

srushti98 commented 6 months ago

Hey, I made an effort to extend this to mammograms by fine-tuning on ROCO dataset. Feel free to check out https://github.com/srushti98/Med-SLIP-a-combination-of-MedCLIP-and-SLIP/tree/main I hope it helps. Thanks.

GuilhermeJC13 commented 6 months ago

That's great, will definitely help. Thanks!