Closed tantra35 closed 6 years ago
In last changes setExecutorCount was changed as:
setExecutorCount
def setExecutorCount(count: Int): Unit = { jobManipulator.updateJob(startIfNotYetRunning = count > 0) { job => val executorGroup = SparkNomadJob.find(job, ExecutorTaskGroup).get if (count > 0 && executorGroup.getCount < count) { executorGroup.setCount(count) } } }
but this is wrong because, no any chance to set nomad task group count to 0(this used to stop spark job), and right changes should be as follow
def setExecutorCount(count: Int): Unit = { jobManipulator.updateJob(startIfNotYetRunning = count > 0) { job => val executorGroup = SparkNomadJob.find(job, ExecutorTaskGroup).get if (count > 0 && executorGroup.getCount < count) { executorGroup.setCount(count) } else if (count == 0) { executorGroup.setCount(0) } } }
In last changes
setExecutorCount
was changed as:but this is wrong because, no any chance to set nomad task group count to 0(this used to stop spark job), and right changes should be as follow