airscholar / SparkingFlow

This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python, Scala and Java as an example.
https://www.datamasterylab.com/home/course/apache-airflow-on-steriods-for-data-engineers/9
15 stars 15 forks source link

spark_submit #5

Open Mohsendream opened 3 months ago

Mohsendream commented 3 months ago

every time i try to submit my spark app i am runing on windows i changed the docker file arm64 to amd64 for the jdk i get this error issue

weldermartins commented 1 month ago

every time i try to submit my spark app i am runing on windows i changed the docker file arm64 to amd64 for the jdk i get this error issue spark://spark-master-1 exchange for spark://spark-master