search

ooyala / spark-jobserver

REST job server for Spark. Note that this is *not* the mainline open source version. For that, go to https://github.com/spark-jobserver/spark-jobserver. This fork now serves as a semi-private repo for Ooyala.
Other
344 stars 135 forks source link

Improve spark worker hang detection logic #76

Closed myxjtu closed 9 years ago

myxjtu commented 9 years ago
  1. Previous detection logic only detects for a single master spark cluster. With this improvement, it can detect multiple masters.
  2. fix the http connector time out issue.
  3. fix some logging issues.
  4. fix some minor code formatting issues