Build and evaluation corpus from Spain medical test repository

dionis / SpanishMedicaLLM

An Open Source Medical Context Large Language Model (LLM) for Q&A and Prompt in Spanish Using Fine-Tuning Techniques with QLora and Epfl with Low Compute Resources. Inspired on Meditron as a suite of open-source medical Large Language Models (LLMs).

https://huggingface.co/epfl-llm

Apache License 2.0

0 stars 0 forks source link

Build and evaluation corpus from Spain medical test repository #18

Closed dionis closed 6 months ago

dionis commented 6 months ago

From the website: https://fse.mscbs.gob.es/fseweb/view/public/datosanteriores/cuadernosExamen/busquedaConvocatoria.xhtml

extract information associated to question and request and create a framework for evaluation following the Meditron guidelines in model evaluation.

Check if exist similar repositories in LATAM cuntries as Chili, Argentina, Mexico, Uruguay.
Check copywrite licences and create document with dataset features.
Create a csv, readme and python script files as output.

Alvaro8gb commented 6 months ago

We have to meet with the team to define wich task we are going to evaluate