MouYongli / MedAR

Medical Abbreviation Resolution
MIT License
2 stars 0 forks source link

LLM explain #1

Open JohannHalley opened 3 months ago

JohannHalley commented 3 months ago

demo

MedAL

image

https://arc.net/l/quote/dizfzncf

''' we have taken a basic biologic RPA to elucidate the pathophysiology of BPD bpd the CLD based on cellmolecular mechanisms of physiologic lung OD stretch coordinates PTHrP pthrp signaling between the ATII cell and the mesoderm to coordinately upregulate key genes for the homeostatic FB phenotype including peroxisome proliferator G1 TRG ppargamma adipocyte differentiation related protein adrp and OB and the retrograde stimulation of type ii cell surfactant synthesis by leptin each of these paracrine interactions requires cellspecific receptors on adjacent cells derived from the mesoderm or endoderm respectively to serially upregulate the signaling pathways between and within each celltype it is this PET compartmentation that is key to understanding how specific agonists and antagonists can predictably affect this mechanism of AM homeostasis using a wide variety of pathophysiologic insults associated with bpd barotrauma oxotrauma and infection we have found that there are type ii cell andor FB cellmolecular effects generated by these insults which can lead to the bpd phenotype we have exploited these cellspecific mechanisms to effectively prevent and treat lung injuries using ppargamma agonists to sustain this signaling pathway it is critically important to judiciously select physiologically and developmentally relevant interventions when treating the preterm neonate ''', what does PTHrP mean? please just tell me the answer don't explain it. parathyroid hormonerelated protein

chatgpt 4o

image

Parathyroid hormonerelated protein

可以用Levenshtein距离

llama3

https://huggingface.co/spaces/ysharma/Chat_with_Meta_llama3_8b

image
JohannHalley commented 3 months ago

Instruction Tuning for Large Language Models: A Survey https://arxiv.org/pdf/2308.10792

FINETUNED LANGUAGE MODELS ARE ZERO-SHOT LEARNERS https://arxiv.org/pdf/2109.01652

JohannHalley commented 2 months ago

clinical-abbreviations database

Lisa Grossman Liu et al., “A Deep Database of Medical Abbreviations and Acronyms for Natural Language Processing,” Scientific Data 8, no. 1 (June 2, 2021): 149, https://doi.org/10.1038/s41597-021-00929-4.

This repository contains the live version of the Medical Abbreviation and Acronym Meta-Inventory, a large-scale American English database of medical abbreviations and their possible senses. https://github.com/lisavirginia/clinical-abbreviations

model

Manda Hosseini, Mandana Hosseini, and Reza Javidan, “Leveraging Large Language Models for Clinical Abbreviation Disambiguation,” Journal of Medical Systems, n.d.

BlueBERT + Transformer + BioGPT model

F = BERT (x) (1) H2 = L2 (T (F )) (2) P = W3 ∗ H2 + b3 (3) Where P represents the output of the method, which corresponds to the final prediction for disambiguating the abbreviation’s sense. It is obtained by applying the final linear layer, represented by weights W3 and biases b3, to the output H2 of the transformer layer. The output H2 is the result of passing the output F of the BERT model through a transformer layer T. The transformer layer T captures long-range dependencies in the input data and enhances the model’s ability to understand the context and relationships between words.

BioGPT is used for data augmentation, which addresses the problem of data imbalance by generating more training instances, especially for those with limited number of instances with abbreviated meaning.

image image