Deploy FastAPI backend to AWS using Pulumi

mt7180 / quaigle

RAG-based LLM application: project to explore different llm-frameworks like llamaindex, marvin and langchain, other used frameworks: streamlit, fastapi

1 stars 1 forks source link

Deploy FastAPI backend to AWS using Pulumi #47

Closed Zaubeerer closed 1 year ago

Zaubeerer commented 1 year ago

          @mt7180, wow, congratulations!

I would say that you have successfully tested fly, but it may not be the right tool for this job.

So my suggestion is that I give you an intro to pulumi and we set up the backend in AWS with an EC2 instance.

Like such, we can get some beefy machines to run the backend. We can even set it up with prefect such that the EC2 instance gets automatically started and stopped to save money ;-)

Would you like to explore that right now or first tackle the second app and come back to this later

Originally posted by @Zaubeerer in https://github.com/mt7180/quaigle/issues/45#issuecomment-1771508823

Zaubeerer commented 1 year ago

Hey @mt7180, let's directly discuss here :)

Pulumi is a framework to manage infrastructure with code (Infrastructure as Code = IaC).

So, instead of manually clicking through the AWS user interface or creating infrastructure via the AWS CLI, you defined infrastructure with Python code 😎

Therefore, we again

first develop locally to iterate quickly
then set up a GitHub action to preview and deploy changes automatically

mt7180 commented 1 year ago

I started to watch the video(s) about pulumi from the code clinic, but what I didn't get so far is:

[x] how does pulumi know what to install on the ec2 instance do deploy the (dockerized ?) app ?I didn't get so far with the videos, yet, but how does it know which setup to choose?
[x] e.g. I created an EC2 instance (t2 micro since it is free) with ubuntu on it. You don't have to specify anything with pulumi, haven't you?
[x] and how would you integrate it to GitHub actions to automatically deploy the latest version?

Probably I should finish watching the videos first ...

Zaubeerer commented 1 year ago

Those are great questions! Feel free to ask further ones, let me know when you have watched the videos and still have open questions.

For example, mark the questions with a checkbox, so I know which ones are still open ;-)

mt7180 commented 1 year ago

@Zaubeerer : I still didn't finish the second video, since I have too much questions to go forward and I rewatched several parts of the videos again and again ...

I created an Pulumi account and I have an aws account.
I installed pulumi cli.
I found your pulumi aws ec2 code here: https://github.com/pybites/aws-ec2-fastapi-demo/ (link wasn't working anymore)

I will try to write some questions down, you could probably help me with:

[ ] you did NOT create an IAM role manually, you set this up with code, correct ?
[ ] you additionally have to set up the key pair .pem file, did you do this manually or by code?
[x] in general: I am not aware of where to create the pulumi files. Should I create a new directory/ repo like you did or create them in my current folder

I think if you could help me with these questions, I could go some steps further on my own ...

Zaubeerer commented 1 year ago

Let's quickly meet today, as your questions are already pretty sophisticated 👌

mt7180 commented 1 year ago

[x] I created a AWS IAM user to receive aws credentials but I need to give it programmatic access . Would you do this with long-term keys or as suggested with additional tools ?!
(don't know if I am doing the right thing but I trying to do what pulumi suggests: https://www.pulumi.com/registry/packages/aws/installation-configuration/)