plans to incorporate RAG API?

[bijucyborg]

Hi Marcel,

Thanks so much for sharing this repo. I was wondering if you are planning to add RAG API support to allow chatting with files?

I guess the templates will need to be changed in order to spawn one more app service which serves the RAG API.

https://www.librechat.ai/docs/user_guides/rag_api https://github.com/danny-avila/rag_api

Also perhaps using Azure Cosmos PG Vector https://learn.microsoft.com/en-us/azure/cosmos-db/postgresql/howto-use-pgvector

Any tips on making the changes would be appreciated as well and I'll try it on my own.

Regards, Biju

[EMjetrot]

Hi Marcel and Biju

I'm also quite interested in this (without knowing how to code it) and saw that it is also being discussed in the repo thunderbug1/LibreChatAzureDeployment, where a user said they managed to set it up manually on Azure and was asked to share the ARM templates for the setup. I'll give you the link, in case it might prove useful for this repo as well.

https://github.com/thunderbug1/LibreChatAzureDeployment/issues/20

Kind regards

Jens

[Pwd9000-ML]

Awesome, thank @EMjetrot I will update this module soon with new features

[bijucyborg]

@EMjetrot I have now extended the terraform module created by Marcel and made it public under the same MIT license.

https://github.com/datasiensai/terraform-azure-prisegpt https://registry.terraform.io/modules/datasiensai/prisegpt/azure/latest

@Pwd9000-ML If you like the architecture I have used, I can make a pull request as well to update your repo.