Add secret token to driver - executor communication

logicalclocks / maggy

Distribution transparent Machine Learning experiments on Apache Spark

https://maggy.ai

Apache License 2.0

89 stars 14 forks source link

Closed moritzmeister closed 5 years ago

moritzmeister commented 5 years ago

Changes:

Refactors the EarlyStopException into a separate module
Add sample usage to Searchspace docstring
Add config module to check for execution mode: spark only or hopsworks
Publish Maggy experiment data to elastic search if run on hopsworks
Add secret token to experiment driver for communication with executors (receiving message from client with wrong token will close the client socket)