Develop a finetunning test to model for training process using QLora and Epfl training techniques

dionis / SpanishMedicaLLM

An Open Source Medical Context Large Language Model (LLM) for Q&A and Prompt in Spanish Using Fine-Tuning Techniques with QLora and Epfl with Low Compute Resources. Inspired on Meditron as a suite of open-source medical Large Language Models (LLMs).

https://huggingface.co/epfl-llm

Apache License 2.0

0 stars 0 forks source link

Develop a finetunning test to model for training process using QLora and Epfl training techniques #3

Open dionis opened 6 months ago

dionis commented 6 months ago

With use of QLora and Epfl training auto-tunning in an spanish LLM Model for training on spanish medical corpus.