MicrosoftDocs / azure-docs

Open source documentation of Microsoft Azure
https://docs.microsoft.com/azure
Creative Commons Attribution 4.0 International
10.08k stars 21.12k forks source link

Azure OpenAI On Your Data - Invalid field mapping in Open AI Studio Sandbox #123072

Open stashinskii opened 4 weeks ago

stashinskii commented 4 weeks ago

I am setting up Azure OpenAI On Your Data and trying to connect my data via Azure AI Search index. I have a couple of issues with index configuration:

  1. I cannot skip field mapping, otherwise I am getting following error in Sandbox chat: Validation error at #/data_sources/0/AzureCognitiveSearch/parameters/fieldsMapping/contentFields/0: Input should be a valid string_
  2. When I setup "Content" field mapping and add more than one field I am having following error in Sandbox chat: An error occurred when calling Azure Cognitive Search: AzureSearch: Wrong content columns provided. Please ensure your content columns are retrievable.Cannot find the following columns in result set: field1,field2

I looked into request traces in a browser and looks like Completions API (2024-02-15-preview) expects array to be received, but Open AI Studio Sandbox pass it as plain string with comma delimiter. Tried to reproduce with valid value (array of two fields) in Postman and it worked. Looks like defect.

Similar issue posted here: https://techcommunity.microsoft.com/t5/ai-azure-ai-services/issue-with-multiple-index-data-field-mapping-in-azure-ai-studio/m-p/4157288/highlight/false#M831

Is it limitations of only single content field mapping and it should be listed in documentation or it is Azure Open AI defect?


Document Details

Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

TPavanBalaji commented 4 weeks ago

@stashinskii Thanks for your feedback! We will investigate and update as appropriate.

stashinskii commented 3 weeks ago

Thanks @TPavanBalaji!

A little bit extra context: I can also confirm that I can use multiple content fields mapping in Azure.AI.OpenAI SDK for .NET (NuGet, 1.0.0-beta.17), in addition to successful test with Postman. Looks like issue only persist in Azure AI Studio Chat playground.

AjayBathini-MSFT commented 3 weeks ago

@stashinskii Thanks for your feedback! I've assigned this issue to the author who will investigate and update as appropriate.

Joly0 commented 23 hours ago

Hey guys, i wanted to ask if there is any new insight that you can share? I am currently having the same issue as OP. When i skip field mapping i get Validation error at #/data_sources/0/AzureCognitiveSearch/parameters/fieldsMapping/contentFields/0: Input should be a valid string_ and when i dont skip it, i get An error occurred when calling Azure Cognitive Search: AzureSearch: Wrong content columns provided. Please ensure your content columns are retrievable.Cannot find the following columns in result set: field1,field2

mrbullwinkle commented 17 hours ago

Thanks for reporting this. I have flagged this issue for the engineering team to take a look.