search

Azure / azure-sdk-for-net

This repository is for active development of the Azure SDK for .NET. For consumers of the SDK we recommend visiting our public developer docs at https://learn.microsoft.com/dotnet/azure/ or our versioned developer docs at https://azure.github.io/azure-sdk-for-net.
MIT License
5.57k stars 4.83k forks source link

[BUG] Azure OpenAI grounding/ocr enhancements need corresponding ChatExtensionConfiguration #40785

Open ashikns opened 11 months ago

ashikns commented 11 months ago

Library name and version

Azure.AI.OpenAI 1.0.0-beta.11

Describe the bug

The sdk now includes options to enable grounding and ocr enhancements for gpt-4-vision-preview. But to actually use the enhancements there also needs to be a corresponding implementation of AzureChatExtensionConfiguration (maps to dataSources in REST api) that allows to provide a Computer Vision endpoint and key for the OpenAI service to use. Eg: AzureCognitiveSearchChatExtensionConfiguration provides the resource connection for "on your data" feature.

It would be nice to have a sample for this.

Expected behavior

I can pass in Computer Vision endpoint and key as an AzureChatExtensionConfiguration.

Actual behavior

I cannot pass in Computer Vision endpoint and key for grounding and ocr enhancement features to use.

Reproduction Steps

Try to use grounding/ocr enhancement with gpt-4-vision-preview.

Environment

No response

github-actions[bot] commented 11 months ago

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @jpalvarezl @trrwilson.

github-actions[bot] commented 11 months ago

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @jpalvarezl @trrwilson.