search

elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.61k stars 8.22k forks source link

[Security GenAI] Bedrock Sonnet 3.5 `<antThinking>` tags sometimes included in AI Assistant output #189676

Open peluja1012 opened 3 months ago

peluja1012 commented 3 months ago

Describe the bug: When using AI Assistant with Bedrock Sonnet 3.5, AI Assistant responses may include <antThinking> tags, such as <search_quality_reflection>, in its response.

This is issue became prominent after our migration to LangGraph.

Kibana/Elasticsearch Stack version: 8.15.0

Steps to reproduce:

  1. Navigate to the AI Assistant after setting up a Bedrock Sonnet 3.5 connector.
  2. Ask the the AI Assistant a question about current open alerts such as "Give me a summary of the riskiest alerts in my system".
  3. Notice how sometimes the response will include tags such as <search_quality_reflection>.

Screenshots (if relevant):

image (45)

elasticmachine commented 3 months ago

Pinging @elastic/security-solution (Team: SecuritySolution)