andywang-25 / Llama2-HPO-Normalization

Fine-tuning LLaMA 2 for rare disease concept normalization
3 stars 2 forks source link

Updated model with Llama3 #1

Open viktorzou opened 3 months ago

viktorzou commented 3 months ago

Hi Andy, first of all thank you for your work. Are you working on an updated model for Llama3? Would love to run it for a dataset I am using

andywang-25 commented 3 months ago

Hi Viktor,

Yes, we plan on working on an updated version of the model with Llama3. However, it may be a while until I release the updated code for the new model, and I will let you know when I do so.

Best, Andy

On Fri, May 24, 2024 at 5:24 AM Viktor A. Zouboulis < @.***> wrote:

Hi Andy, first of all thank you for your work. Are you working on an updated model for Llama3? Would love to run it for a dataset I am using

— Reply to this email directly, view it on GitHub https://github.com/andywang-25/Llama2-HPO-Normalization/issues/1, or unsubscribe https://github.com/notifications/unsubscribe-auth/A25JICER4FQSC64FJCGFZ6TZD4BNRAVCNFSM6AAAAABIHGYPCOVHI2DSMVQWIX3LMV43ASLTON2WKOZSGMYTIOJQGQ4TSMA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

viktorzou commented 4 weeks ago

thank you very much. i finally managed to get the model running, but there is some strange behaviour, maybe you have an idea, what going on:

Processed IEI: IEI:000001, HPO_ID: 0001522.
Prompt: The Human Phenotype Ontology term pulmonary fibrosis is identified by the HPO ID HP:
Processed IEI: IEI:000001, HPO_ID: 0001522.
Prompt: The Human Phenotype Ontology term hepatic fibrosis is identified by the HPO ID HP:
Processed IEI: IEI:000001, HPO_ID: 0001522.
Prompt: The Human Phenotype Ontology term nail dystrophy is identified by the HPO ID HP:
Processed IEI: IEI:000001, HPO_ID: 0000072.
Prompt: The Human Phenotype Ontology term leukoplakia is identified by the HPO ID HP:
Processed IEI: IEI:000001, HPO_ID: 0001272.
Prompt: The Human Phenotype Ontology term reticulate skin pigmentation is identified by the HPO ID HP:
Processed IEI: IEI:000001, HPO_ID: 000000000000000
Prompt: The Human Phenotype Ontology term microcephaly is identified by the HPO ID HP:
Processed IEI: IEI:000001, HPO_ID: 0000972.
Prompt: The Human Phenotype Ontology term neurodevelopmental delay is identified by the HPO ID HP:
Processed IEI: IEI:000001, HPO_ID: 0000072.
Prompt: The Human Phenotype Ontology term bone marrow failure is identified by the HPO ID HP:
Processed IEI: IEI:000002, HPO_ID: 0001522.
Prompt: The Human Phenotype Ontology term pulmonary fibrosis is identified by the HPO ID HP:
Processed IEI: IEI:000002, HPO_ID: 0001522.
Prompt: The Human Phenotype Ontology term hepatic fibrosis is identified by the HPO ID HP:
Processed IEI: IEI:000002, HPO_ID: 0001522.