Fix api and workers network settings - Githubissues

The-Academic-Observatory / observatory-platform

Observatory Platform Package

https://docs.observatory.academy

Apache License 2.0

18 stars 5 forks source link

Fix api and workers network settings #617

Closed jdddog closed 1 year ago

jdddog commented 1 year ago

Fixes the issues with Airflow webserver not being able to access logs and API server not being accessible.

Made following changes:

Reverted workers and apiserver to use host mode. API and worker containers are now accessed using the host name of the VM.
In Terraform:
- Open ports 5002 (API) and 8793 (Airflow worker) within VPC network for both VMs.
- Only run apiserver on airflow-main-vm.
- Use hostname of airflow-main-vm for redis_hostname instead of IP address.
observatory_api connection should now be: http://:@airflow-main-vm:5002