sunlabuiuc / PyHealth

A Deep Learning Python Toolkit for Healthcare Applications.
https://pyhealth.readthedocs.io
MIT License
956 stars 207 forks source link

Add MedCLIP Model for Zero-shot Inference #193

Open wuzijian1997 opened 1 year ago

wuzijian1997 commented 1 year ago

Add a new model medclip_zeroshot.py

Note that the original MedCLIP repository seems to have bugs. I mainly modify the "MedCLIPFeatureExtractor" class. The source code lacks some image transformation functions, so passing the image transformation will get errors. I kindly remind you to fix this issue for the original repository.

wuzijian1997 commented 1 year ago

I add an example of the MedCLIP zero-shot classification. Please check it.