[BUG] Bot Knowledge References

aws-samples / bedrock-claude-chat

AWS-native chatbot using Bedrock + Claude (+Mistral)

MIT No Attribution

687 stars 230 forks source link

[BUG] Bot Knowledge References #364

Open Alexg61 opened 2 weeks ago

Alexg61 commented 2 weeks ago

Describe the bug

There are 2 issues in references when using knowledge in bot, 1- when asking question the markdown is missy and getting many dummy in text (screen shot attached) (note: I set 20 chunk to retrieve)

2- when (Enable detailed PDF analysis), there are no references in answers no matter the Retrieved Context Citation enabled or not

Screenshots

Screenshot 2024-06-13 at 11 08 43

If applicable, add screenshots to help explain your problem.

Additional context

Add any other context about the problem here.

statefb commented 2 weeks ago

1- when asking question the markdown is missy and getting many dummy in text (screen shot attached) (note: I set 20 chunk to retrieve)

This is known issue especially when uses Haiku. Could you use Sonnet or Opus?

2- when (Enable detailed PDF analysis), there are no references in answers no matter the Retrieved Context Citation enabled or not

Thank you for reporting the issue. Could you check whether the reference fetched or not? To check:

Open browser debug tool
Open network tab
Checkrelated-documents request and response

thank you.

Alexg61 commented 2 weeks ago

The related-documents is empty i checked with the (Enable detailed PDF analysis - enabled ) the related documents is empty

statefb commented 1 week ago

2- when (Enable detailed PDF analysis), there are no references in answers no matter the Retrieved Context Citation enabled or not

Sorry I couldn't reproduce it. could you give us more the detai?