USCDataScience / sparkler

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
http://irds.usc.edu/sparkler/
Apache License 2.0
410 stars 143 forks source link

May I know How it works if we submit job in spark cluster #189

Open ravituduru opened 3 years ago

ravituduru commented 3 years ago

May I know How it works if we submit job in spark cluster and how partitions and executor will work in cluster . How partitions and executor will work in cluster if we want to pass the command line via spark submit