[spike] Fine-tuning options for LLMs

redhat-et / foundation-models-for-documentation

Improve ROSA customer experience (and customer retention) by leveraging foundation models to do “gpt-chat” style search of Red Hat customer documentation assets.

Other

26 stars 12 forks source link

[spike] Fine-tuning options for LLMs #18

Open codificat opened 1 year ago

codificat commented 1 year ago

As part of #8, in order to adapt the language models we use to the domain we work on (ROSA), explore and document the various options available:

prompt engineering with context
model fine-tuning

For each option we want to understand:

its pre-requisites (e.g. type, quality and quantity of data required, level of model access, cost of the adaptation process)
pros and cons
what OSS options are recommended for each (see #9)