search

Azure-Samples / chat-with-your-data-solution-accelerator

A Solution Accelerator for the RAG pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences. This includes most common requirements and best practices.
https://azure.microsoft.com/products/search
MIT License
663 stars 330 forks source link

Reference X not showing up when X>=2, in web app #1072

Open cherifbenham opened 1 week ago

cherifbenham commented 1 week ago

Describe the bug

The answer object sometimes does not display all the used sources (clickable) to generate the answers.

Expected behavior

The answer should contain all the references of the retrieved sources - see screenshot below

How does this bug make you feel?

Debugging information

Steps to reproduce

Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Screenshots

image

Logs

If applicable, add logs to help the engineer debug the problem.

Tasks

To be filled in by the engineer picking up the issue

adamdougal commented 3 days ago

Heya @cherifbenham, I'm not sure I understand the issue. From the screenshot, it looks like it's retrieved all of the data from one reference correctly. Could you explain a bit more? Thanks

cherifbenham commented 1 day ago

Thanks @adamdougal Adam for your reactivity

The issue is that the generated answer mentions specifically 2 source documents dt-1075 and dt-3567 but only 1 source URL is displayed dt-1075 Does it make more sense?

adamdougal commented 1 day ago

Gotcha! That's an odd one. Can you see the reference documents being returned in the logs of the backend application? Are they both there? It could be that the OpenAI System prompt needs tweaking.