News | Papers | |
---|---|---|
Toward Expanding the Scope of Radiology Report Summarization to Multiple Anatomies and Modalities | Dataset | |
Overview of the RadSum23 Shared Task on Multi-modal and Multi-anatomical Radiology Report Summarization | Challenge | |
Improving the Factual Correctness of Radiology Report Generation with Semantic Rewards | Replicate |
ViLMedic has a dedicated website at: https://vilmedic.app/
@inproceedings{delbrouck-etal-2022-vilmedic,
title = "{V}i{LM}edic: a framework for research at the intersection of vision and language in medical {AI}",
author = "Delbrouck, Jean-benoit and
Saab, Khaled and
Varma, Maya and
Eyuboglu, Sabri and
Chambon, Pierre and
Dunnmon, Jared and
Zambrano, Juan and
Chaudhari, Akshay and
Langlotz, Curtis",
booktitle = "Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations",
month = may,
year = "2022",
address = "Dublin, Ireland",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2022.acl-demo.3",
pages = "23--34",
}
Rendez-vous at: https://vilmedic.app/installation/
ViLMedic replicates solutions from the multimodal medical literature.
Blocks |
---|
Natural Language Processing |
HuggingFace transformer encoder and decoder |
HuggingFace transformer beam-search and model ensembling :fire: |
NLG metrics (BLEU, ROUGE, METEOR, MAUVE) and Radiology Reports Generation metrics (F1-CheXbert) |
RadGraph |
Vision |
All PyTorch VisualEncoder architectures |
Vision Transformer |
TorchXRayVision |
Losses |
All PyTorch losses |
ConVirt loss |
GLoRIA loss |
InfoNCE loss |
SuperLoss |
Reinforcement Learning |
Self-critical Sequence Training (HuggingFace compliant) :fire: |
PPO optimization (HuggingFace compliant) |
If you use ViLMedic in your work or use any models published in ViLMedic, please cite:
ViLMedic is MIT-licensed. The license applies to the pre-trained models as well.