I realized today that the current LLM that I'm using (jondurbin/airoboros 70B) is treating my 'closing statement' a little different than others, and it's routinely inserting "so and so say they will remember this conversation" at the end.
I wanted to tweak the prompt for summarization, but it's still hardcoded in the python files vs. being Yet Another Prompt Style out in the prompt_styles directory.
I realized today that the current LLM that I'm using (jondurbin/airoboros 70B) is treating my 'closing statement' a little different than others, and it's routinely inserting "so and so say they will remember this conversation" at the end.
I wanted to tweak the prompt for summarization, but it's still hardcoded in the python files vs. being Yet Another Prompt Style out in the prompt_styles directory.