search

airscholar / SparkingFlow

This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python, Scala and Java as an example.
https://www.datamasterylab.com/home/course/apache-airflow-on-steriods-for-data-engineers/9
15 stars 15 forks source link

pyspark-submit resolved. #2

Open weldermartins opened 5 months ago

weldermartins commented 5 months ago

Latest version of Airflow. image

Connection Airflow image

Dag image