Cloud Composer is quite expensive for personal use (around 200 per month at the minimum); therefore, it is better to deploy Airflow on a cheap Google Cloud compute instance, ideally under 15-20 dollars per month. Pricing for different machines can be found here.
e2-small (2vCPU, 2GB memory) costs around 13 dollars monthly. It should be enough for a local Airflow + a web server to host the dashboard. Around 30GB of storage space should be enough. So, in total, we are looking for 15 dollars per month. Not that bad.
Things to do in this issue:
[x] Update docker-compose and other configs to be able to deploy
[x] Install the necessary software on the server
[x] Deploy Airflow on the server
[ ] Write a guide on how to setup server and airflow
Cloud Composer is quite expensive for personal use (around 200 per month at the minimum); therefore, it is better to deploy Airflow on a cheap Google Cloud compute instance, ideally under 15-20 dollars per month. Pricing for different machines can be found here.
e2-small(2vCPU, 2GB memory) costs around 13 dollars monthly. It should be enough for a local Airflow + a web server to host the dashboard. Around 30GB of storage space should be enough. So, in total, we are looking for 15 dollars per month. Not that bad.Things to do in this issue: