search

airscholar / e2e-data-engineering

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.
https://www.youtube.com/watch?v=GqAcTrqKcrY
204 stars 91 forks source link

Exception has occurred: AirflowConfigException #5

Open Kanangnut opened 9 months ago

Kanangnut commented 9 months ago

Exception has occurred: AirflowConfigException Cannot use relative path: sqlite:///C:\Users\User_Win10x64/airflow/airflow.db to connect to sqlite. Please use absolute path such as sqlite:////tmp/airflow.db. File "D:\Work\data-engineer\dags\kafka-stream.py", line 2, in from airflow import DAG airflow.exceptions.AirflowConfigException: Cannot use relative path: sqlite:///C:\Users\User_Win10x64/airflow/airflow.db to connect to sqlite. Please use absolute path such as sqlite:////tmp/airflow.db.

prikshit-2000 commented 6 months ago

I was able to solve this error. just got to the path where the error is coming up from in your case it will be C:\Users\User_Win10x64/airflow/ and change the airflow.cfg sql_alchemy_conn parameter as sql_alchemy_conn=sqlite:////tmp/airflow.db. Hope it helps 🤗