An Open Source Medical Context Large Language Model (LLM) for Q&A and Prompt in Spanish Using Fine-Tuning Techniques with QLora and Epfl with Low Compute Resources. Inspired on Meditron as a suite of open-source medical Large Language Models (LLMs).
In article "Meditron-70b: Scaling medical pretraining for large language models" establishes in several points that in the construction of the corpora used, only articles in the English language were extracted.
It can be assumed that during the review of these articles it can be taken into account whether the article or the medical guides are in Spanish.
Expected result:
A readme in markdown style with the details of the process.
The Meditron scripts for the construction of the corpus adapted for the Spanish language and that can be executed by building at least 50 examples of each type
In article "Meditron-70b: Scaling medical pretraining for large language models" establishes in several points that in the construction of the corpora used, only articles in the English language were extracted.
It can be assumed that during the review of these articles it can be taken into account whether the article or the medical guides are in Spanish.
Expected result:
A readme in markdown style with the details of the process.
The Meditron scripts for the construction of the corpus adapted for the Spanish language and that can be executed by building at least 50 examples of each type