Give the LLM the input from the last messages - Githubissues

buerokratt / Buerokratt-Chatbot

1 stars 19 forks source link

Give the LLM the input from the last messages #866

Open ValterAro opened 2 months ago

ValterAro commented 2 months ago

AS A Product owner I WANT the llm to know the previous chat messages IN ORDER to answer the follow up questions better.

In order to give the large language model (LLM) better context of what is being asked it is necessary to prove previous question and answer. AC:

[ ] The llm needs to get the basic question that was asked as well as the previous question and answer

Further improvements needed (added 20.09.2024):

[ ] the previous question-answer will be included only if they were processed by the LLM. Previous questions-answers are not included if they were treated as Rasa intents.

ValterAro commented 2 months ago

Latest changes to external-bot.yml https://github.com/buerokratt/Buerokratt-Chatbot/pull/862