WeixiongLin / PMC-CLIP

The official codes for "PMC-CLIP: Contrastive Language-Image Pre-training using Biomedical Documents"
https://weixionglin.github.io/PMC-CLIP/
MIT License
190 stars 11 forks source link

how to decode the prediction #18

Open xw2018 opened 4 months ago

xw2018 commented 4 months ago

Thanks for your excellent work!I wonder how to decode the prediction into natural language,can not find some decode code in this project but loss calculate

xw2018 commented 4 months ago

感谢大佬的工作!没找到把输出numpy数组转回text的decode代码,求助

Zhenxiaoan commented 2 months ago

Did you solve it?I also have the same problem.

WeixiongLin commented 2 months ago

I may need further information to help you with the issue. PMC-CLIP is designed to provide well learned visual / textual embedding. There's no decoder in PMC-CLIP actually.