search

KonuTech / data-engineering-zoomcamp-capstone-01

Dockerized, 5 min. mini-batch data pipeline. Spark Structured Streaming - reading from Kafka to PostgreSQL as sink DB. Airflow, Kafka, PySpark, PostgreSQL, Streamlit
7 stars 1 forks source link

where is postgres database? #1

Open tsitsihama opened 4 months ago

tsitsihama commented 4 months ago

Hello it seems as if postgres is missing what was your intention did you want to install locally or you wanted to use docker?

KonuTech commented 3 months ago

Hi. I didn't notice the question earlier.

Yes, pgAdmin4, which I use to look up the data, is installed locally. I should have added that information to the prerequisites. Also, I need to edit the top picture. Thank you for asking.

Simultaneously, the PostgreSQL you can find as an image within the container is the database used by Airflow as its backend DB