Describe the bug
When the system encounters errors such as ThrottlingException or ValidationException, the chat can get stuck indefinitely, preventing the user from continuing the conversation. This occurs because the system does not handle these errors gracefully and does not provide a way for the user to resume the chat once the underlying issue is resolved.
To Reproduce
Send multiple requests to the system, triggering a ThrottlingException. Alternatively expire your default profile to cause an auth error.
Attempt to send a request with multiple "user" roles in a single row, triggering a ValidationException.
Observe that the chat becomes stuck and the user is unable to continue the conversation.
Expected behavior
When the system encounters errors, it should handle them gracefully and provide a way for the user to resume the chat once the underlying issue is resolved. This could involve concatenating the user's previous messages that resulted in errors and allowing the user to continue the conversation.
Additional context
Providing a way for the user to continue the chat after system errors would improve the user experience and prevent frustration when the chat gets stuck. Concatenating the previous messages that resulted in errors could help the user understand the context and pick up where they left off.
Describe the bug When the system encounters errors such as ThrottlingException or ValidationException, the chat can get stuck indefinitely, preventing the user from continuing the conversation. This occurs because the system does not handle these errors gracefully and does not provide a way for the user to resume the chat once the underlying issue is resolved.
To Reproduce
Expected behavior When the system encounters errors, it should handle them gracefully and provide a way for the user to resume the chat once the underlying issue is resolved. This could involve concatenating the user's previous messages that resulted in errors and allowing the user to continue the conversation.
Additional context Providing a way for the user to continue the chat after system errors would improve the user experience and prevent frustration when the chat gets stuck. Concatenating the previous messages that resulted in errors could help the user understand the context and pick up where they left off.