Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/
the reason is when after fire a watch on shuffle pods, watcher will receive an ADDED event and raise an exception because it exist in shuffle pod cache. check if the pod ip is the same to avoid this issue
Signed-off-by: forrestchen forrestchen@tencent.com
What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
How was this patch tested?
manual test.
Run the PageRank example and below error occur
the reason is when after fire a watch on shuffle pods, watcher will receive an ADDED event and raise an exception because it exist in shuffle pod cache. check if the pod ip is the same to avoid this issue