search

Azure-Samples / chat-with-your-data-solution-accelerator

A Solution Accelerator for the RAG pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences. This includes most common requirements and best practices.
https://azure.microsoft.com/products/search
MIT License
624 stars 294 forks source link

OpenAI On Your Data skill ignores custom metadata field #391

Closed JakobStadlhuber closed 1 month ago

JakobStadlhuber commented 2 months ago 
- [x] bug report -> please search issues before submitting
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

  1. setup bring your own data with the Azure Playground to create the indexes, indexer, skill... based on a blob storage
  2. add a custom field with the same name as the blob storage files meta data field in both new created indexes
  3. modify the created skill by adding the needed custom field
  4. the preprocessing-jobs api (used in the skill) does ignore the custom field and does not create it in the resulting chunk.json

Expected/desired behavior

both indexes that are created with the OpenAI Playground should contain the custom metadata field from the file in the blob storage.

ross-p-smith commented 2 months ago

Is this the same as #251?

JakobStadlhuber commented 2 months ago

Is this the same as #251?

no its not releated

reechamishra commented 1 month ago

@reechamishra to investigate if this is related to this repo ?

reechamishra commented 1 month ago

@JakobStadlhuber Before we pick this item to work on this , can you confirm this issue is related to the code with this particular accelerator "Chat with your data" ?

ross-p-smith commented 1 month ago

@JakobStadlhuber - I am closing this as the description talks about "On Your Data" and the OpenAI playground which is not this repository. Please re-open if I have closed incorrectly