Azure Deployment as Containers

[cbutler-captech]

I am cross posting this here:

Back in December, I deployed LibreChat using the LibreChatAzureDeployment terraform scripts, but I don't see any updates to it with the RagApi and VectorDB. I managed to get it running in a ContainerApp environment with 3 containers (Chat, MeiliSearch and Rag api) connected to a Cosmos MongoDB and an Azure PostgreSQL Database with vector support enabled. Took me quite a while. Hoping to Terraform it but I am not the best at Terraform and I am tight on time. Just wanted to note here that is its possible and I think its a better solution than running a linux VM or even spinning up multiple app services as the old one did.

[geodanchev]

I’m really impressed by your work. Thank you for sharing your experience!

I’m currently working on the same thing and would love to learn from your expertise since I've too little knowledge in azure at all. If it’s not too much trouble, could you share the ARM templates for me, so I'll try to use them as reference? It would be incredibly helpful for my own deployment. I'll also try to setup a Bicep deployment that I could share afterwards.

Thank you in advance, and I appreciate your time!

Best regards, Gosh

[EMjetrot]

Hi @cbutler-captech

Would also love to see those ARM templates if possible or get more information about how you set it up. I'm trying to do exactly the same, but struggle to connect the pieces on Azure, i.e. connecting the LibreChat container to the rag_api-container and I'm not sure how you did the storage of the config-file and connected the Librechat container to that.

Thank you in advance for any help and have a great day.

Kind regards, Jens

[a-marr]

I am cross posting this here:

Back in December, I deployed LibreChat using the LibreChatAzureDeployment terraform scripts, but I don't see any updates to it with the RagApi and VectorDB. I managed to get it running in a ContainerApp environment with 3 containers (Chat, MeiliSearch and Rag api) connected to a Cosmos MongoDB and an Azure PostgreSQL Database with vector support enabled. Took me quite a while. Hoping to Terraform it but I am not the best at Terraform and I am tight on time. Just wanted to note here that is its possible and I think its a better solution than running a linux VM or even spinning up multiple app services as the old one did.

This is great! I'm a little confused--did you deploy it via the terraform scripts first, then realize the updating issues and decided to manually create the resources to deploy afterwards? I'm essentially trying to figure out the same thing now.

[bijucyborg]

@geodanchev @a-marr I have now extended Marcel Lupo's terraform for LibreChat to include features like RAG API.

https://github.com/datasiensai/terraform-azure-prisegpt

My approach is little different because I want the frontend (LibreChat) to remain a webapp and not a container app.

Its also published to the terraform registry and can be imported as a module.

https://registry.terraform.io/modules/datasiensai/prisegpt/azure/latest