search

thisserand / llama2_local

MIT License
82 stars 35 forks source link

Responses become too large #6

Open epellegrini opened 1 year ago

epellegrini commented 1 year ago

I've been trying the code as a customer service chatbot and works pretty well with few interactions. My issue is that after a few interactions, the model starts to add the following interactions of the conversation into the response.

Something like this:

Customer: Question1 Agent: Answer1 Customer: Question2 Agent: Answer2, Question3, Answer3, Question4, Answer4..

It seems like a stop sequence could help to indicate to the agent that it only has to reply to the customer, instead of write the whole remaining part of the conversation as answer. The problem is that I'm not sure of how to do it? Any suggestion?

Thanks in advance for the help!

thisserand commented 1 year ago

Thanks for creating the issue! Can you state more information about the model you have used and maybe add the messages that lead to this error?