luminousmen / luminousmen.com

2 stars 0 forks source link

https://luminousmen.com/post/spark-anatomy-of-spark-application #15

Closed utterances-bot closed 3 weeks ago

utterances-bot commented 4 years ago

Spark. Anatomy of Spark application - Blog | luminousmen

In this post components of Spark application are in detail examined, how these components work together and how Spark applications work on YARN cluster

https://luminousmen.com/post/spark-anatomy-of-spark-application

dev23kmr commented 4 years ago

Thanks for sharing this wonderful stuff. I loved it.... :-)

luminousmen commented 4 years ago

@dev23kmr, thanks man ;)

AmrutaAcc123 commented 4 years ago

Great Article, all steps of spark application are explained in details. Thanks

luffyd commented 4 years ago

Best explanation!

The Application Master registers with the Resource Manager. Registration allows the client program to request information from the Resource Manager, that information allows the client program to communicate directly with its own Application Master. Also When you mention client, did u mean driver?

vinayb21 commented 3 years ago

Awesome!

jitheshlive commented 3 years ago

Thanks for sharing. wonderfully explained...