Open yaroslavyaroslav opened 1 year ago
As for now plugin deletes farthest chat history messages if it in a whole exceeds the given model tokens window.
The better way to treat those messages is to not delete, but to ignore them in a request.
In addition to that it would be good to show a sent chunk bounds to a user somehow.
As for now plugin deletes farthest chat history messages if it in a whole exceeds the given model tokens window.
The better way to treat those messages is to not delete, but to ignore them in a request.
In addition to that it would be good to show a sent chunk bounds to a user somehow.