RAG AI plugin - support for Azure OpenAI

[joezamolo]

Feature Suggestion

Support for Microsoft Azure OpenAI Service as an optional service provider that can be swapped out instead of OpenAI itself.

Possible Implementation

Not sure about implementation details, sorry 😅 this is just an idea I wanted to share here.

Context

This would allow customers for whom Azure is the primary cloud provider to take advantage of this plugin, especially where there are concerns around AI and usage of an organization's proprietary data.

[nia-potato]

also have the same request here!

[Xantier]

Hi, thanks. This makes a ton of sense and would be a good addition. I don't have an Azure account with OpenAI enabled at the moment so we would need some implementation help on this. Luckily it shouldn't be too big of a task to add this in.

The implementation of this on a base level would be very similar as AWS Bedrock currently is. There would be a need to create a new (Azure OpenAI) embeddings package, add the configuration options for it, and use the Langchain dependency to initialize these embeddings.

The approach would likely be mostly copy-pasting the current AWS implementation and modifying it to call Azure OpenAI instead.

Resources for this:

• LangChain docs provides a full working example of everything needed. This should likely work as a first draft already
• The AWS embeddings package can be used as a more or less direct copy-paste source to start from