search

microsoft / promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
https://microsoft.github.io/promptflow/
MIT License
9.5k stars 869 forks source link

[BUG] Difference in retrieved results between PromptFlow's index Lookup and AI Search Web #3463

Closed hyeonje-cho closed 3 months ago

hyeonje-cho commented 4 months ago

Describe the bug There seems to be a discrepancy in the document results retrieved for the same query between Promptflow's index_lookup and AI search in Portal. The results from AI search appear to be more accurate. How can we ensure consistent results from both platforms?

How To Reproduce the bug Steps to reproduce the behavior, how frequent can you experience the bug:

  1. Setup Lookup index with AI search index in the promptflow
  2. Retrieve user query
  3. Compare the results between promptflow and AI search web

Expected behavior Same results from Promptflow's vector lookup and AI search web

Screenshots If applicable, add screenshots to help explain your problem. AI Search Web result image

Promptflow result image image

Running Information(please complete the following information):

D-W- commented 4 months ago

Hi @dans-msft @Adarsh-Ramanathan , could you help to take a look of this issue? Thanks! @hyeonje-cho , for issues when using AI Studio, you can follow this doc to file feedback: https://microsoft.github.io/promptflow/cloud/azureai/faq.html?highlight=faq#how-to-create-feedback-for-azure-portal-experience

github-actions[bot] commented 3 months ago

Hi, we're sending this friendly reminder because we haven't heard back from you in 30 days. We need more information about this issue to help address it. Please be sure to give us your input. If we don't hear back from you within 7 days of this comment, the issue will be automatically closed. Thank you!