[DCOS-41589][Integration Tests] --supervise causing frameworkId conflicts in mesos cluster mode

mesosphere / spark-build

Used to build the mesosphere/spark docker image and the DC/OS Spark package

52 stars 34 forks source link

[DCOS-41589][Integration Tests] --supervise causing frameworkId conflicts in mesos cluster mode #506

Closed farhan5900 closed 5 years ago

farhan5900 commented 5 years ago

What changes were proposed in this pull request?

Resolves DCOS-41589

Added an integration test to check the supervise mode of the spark application as well as it's conflicts of framework Id's, when job is restarting.

How were these changes tested?

It was tested running manually on the local machine.

akirillov commented 5 years ago

@farhan5900, it turned out that the behaviour of foldered Spark tests led to environment modifications which prevented supervised tests (and a few others if executed multiple times on the same cluster) fail. TL;DR - those tests uninstalled CLI and not always cleaned up ZK. This PR addresses these issues: https://github.com/mesosphere/spark-build/pull/514, please rebase on master after it is merged.