Tencent / Firestorm

Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shuffle data on remote servers

Other

252 stars 72 forks source link

[Bugfix] [0.5.0] Fix spark2 executor stop NPE problem #188

Closed jerqi closed 2 years ago

jerqi commented 2 years ago

backport 0.5.0

What changes were proposed in this pull request?

We need to judge heartbeatExecutorService whether is null when we will stop it.

Why are the changes needed?

177 pr introduce this problem, when we run Spark applications on our cluster, the executor will throw NPE when method `stop` is called.

Does this PR introduce any user-facing change?

How was this patch tested?

Manual test