[Security Solution] [Bug] After deleting a document, the answers from AI assistant are wrong

[muskangulati-qasource]

Describe the bug After deleting a document, the answers from AI assistant are wrong

Kibana/Elasticsearch Stack version

VERSION: 8.16.0
BUILD: 78825
COMMIT: a805375758e4bc931cf13dfdcac89b8d877a15d2

Steps

1. Kibana version 8.16.0 or above should exist without endpoints
2. Navigate to Stack management under Management section
3. Navigate to Kibana >> AI Assistants
4. Click on Manage settings for Elastic AI Assistant for Security
5. Navigate to the Knowledge base tab
6. A few docs should exist
7. Delete a document
8. Ask question from the AI assistant related to the deleted doc
9. Observe the answers are not always accurate

Expected Result The answer should be correct after deletion of the document from Knowledge base

Screenshot

[elasticmachine]

Pinging @elastic/security-solution (Team: SecuritySolution)

[muskangulati-qasource]

@amolnater-qasource please review!!

[amolnater-qasource]

Reviewed & assigned to @MadameSheema

[MadameSheema]

@muskangulati-qasource can you please be more explicit about why the answers are not accurate and what you were expecting? Thanks! :)

[muskangulati-qasource]

Hi @MadameSheema,

Sorry for the confusions. Below are the exact steps followed:

• The documents saved are for popcorn, pizza and peaches.
• I fed AI with one more document that my fav food is pizza.
• Then asked question: What is my fav food?
• AI: Pizza
• I deleted the document for pizza
• Then again asked the question about fav food
• AI answers: Pizza and Peaches. But, popcorn is also added along with it which is never given in response.

Thanks!