search

Azure-Samples / azure-search-openai-demo

A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.
https://azure.microsoft.com/products/search
MIT License
6.06k stars 4.15k forks source link

Search Index Not Updating After Successful Deployment #1927

Open lsdaakasdlklfsaldjfooei opened 2 months ago

lsdaakasdlklfsaldjfooei commented 2 months ago

Please provide us with the following information:

This issue is for a: (mark with an x)

- [ ] bug report -> please search issues before submitting
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

I'm experiencing an issue with my sample chatbot implemented using the Azure Search OpenAI demo. The problem arises after I commit new data files in Azure DevOps. The CI/CD pipeline triggers, and the deployment completes successfully, but the search index isn't updated, and the new data isn't reflected in the application.

Even after a successful deployment, when I ask the chatbot about the newly committed data, it returns no information related to it.

Minimal steps to reproduce

Commit new data files to the repository in Azure DevOps. Observe the CI/CD pipeline triggering and completing successfully. Check the application for updated knowledge or search results based on the newly added data.

Expected Behavior:

The search index should be updated automatically after a successful deployment, and the new data should be reflected in the application's knowledge base.

Actual Behavior:

The search index is not updated, and the application does not reflect the new data, leading to no information being available when querying the chatbot about the newly added content

Any log messages given by the failure

Expected/desired behavior

OS and Version?

Windows 7, 8 or 10. Linux (which distribution). macOS (Yosemite? El Capitan? Sierra?)

azd version?

run azd version and copy paste here.

Versions

Mention any other details that might be useful

Thanks! We'll be in touch soon.

pamelafox commented 2 months ago

I believe you're running into this issue: https://github.com/Azure-Samples/azure-search-openai-demo/issues/1603 which is caused by an azd issue: https://github.com/Azure/azure-dev/issues/3920

However, if you do employ the workaround suggested there, then you'll run into the issue that it'll try to reindex everything, unless you check in the md5 files. That's what this WIP PR attempts to resolve: https://github.com/Azure-Samples/azure-search-openai-demo/pull/942

lsdaakasdlklfsaldjfooei commented 2 months ago

I believe you're running into this issue: #1603 which is caused by an azd issue: Azure/azure-dev#3920

However, if you do employ the workaround suggested there, then you'll run into the issue that it'll try to reindex everything, unless you check in the md5 files. That's what this WIP PR attempts to resolve: #942

Thanks for replying, but I am facing issue that the prepdocs is not getting called during the Azure devops pipeline trigger as a result of it. The documents in data folder are not getting indexed and are not in the deployed webapp.

Community, please let me know what information you may need from my side.

Thank you for your support.