Azure-Samples / chat-with-your-data-solution-accelerator

A Solution Accelerator for the RAG pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences. This includes most common requirements and best practices.
https://azure.microsoft.com/products/search
MIT License
656 stars 327 forks source link

Add a new Orchestrator "promptflow" that calls the prompt flow #979

Closed tectonia closed 2 weeks ago

tectonia commented 1 month ago

Required by #406

Description

Create a prompt flow orchestrator.

Tasks

tectonia commented 3 weeks ago

The MLClient online_endpoints.invoke method detects the Default Azure Credential whether that is the key or RBAC token. However, this has not been tested for RBAC and further changes might have to be made on provisioning side. This means if you choose to select prompt_flow as ORCHESTRATION_STRATEGY, you might run into issues if you decide to set AZURE_AUTHTYPE as rbac. From docs: "If you plan to use the SDK to invoke the endpoint, you're not required to get the keys or token for data plane operations explicitly, as the SDK handles it for you."_