Improve ROSA customer experience (and customer retention) by leveraging foundation models to do “gpt-chat” style search of Red Hat customer documentation assets.
Other
26
stars
12
forks
source link
Create a squad like toy dataset with ROSA documentation #4
We would need a dataset to fine tune Large language models for searching ROSA documentation and evaluating the performance of different models. As a start, take existing FAQs and convert them into QA format.
As a part of this issue, discuss and answer the following questions:
[x] What Quick enough volume of QA data that we can manage? 100-1000 rows?
[x] What kind of questions do we want the model to answer?
[x] Do we want quick questions or longer ones or both?
We would need a dataset to fine tune Large language models for searching ROSA documentation and evaluating the performance of different models. As a start, take existing FAQs and convert them into QA format. As a part of this issue, discuss and answer the following questions: