An Open Source Medical Context Large Language Model (LLM) for Q&A and Prompt in Spanish Using Fine-Tuning Techniques with QLora and Epfl with Low Compute Resources. Inspired on Meditron as a suite of open-source medical Large Language Models (LLMs).
Find one or several test sets to evaluate the generative output of LLM trained in medical contexts.
Note: It would be desirable for them to be directly in Spanish or to have been built for that purpose to avoid automatic translation.
If you find benchmark that have been automatically translated from English sources, do not discard them and take them into account.
Resources to consult:
BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains.
Pretrained biomedical language models for clinical NLP in Spanish.
Spanish Pre-Trained Language Models for HealthCare Industry.
A Survey of Spanish Clinical Language Models.
Expected results:
Set for testing models trained in a medical context for Spanish.
A readme on markdown format with details of research process.
Alvaro8gb
commented
6 months ago
Find one or several test sets to evaluate the generative output of LLM trained in medical contexts.
Note: It would be desirable for them to be directly in Spanish or to have been built for that purpose to avoid automatic translation.
If you find benchmark that have been automatically translated from English sources, do not discard them and take them into account.
Resources to consult: BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains.
Expected results: