Multithreaded scheduler

neeleshdodda44 commented 6 years ago

Comments in code are hopefully pretty self-explanatory, but to summarize + extra details:

Using Ray to run runners asynchronously
DMLRunnerActor is just a wrapper for DMLRunner (didn't want to mess with the tests for DMLRunner, which would clearly fail if I annotated DMLRunner as the actor)
Can run with as many runners as you want (default is 4), but ran into some weird errors when I was using too many with little speed boost. Feel free to change the default.
The test for speedup is fairly naive (Georgy mentioned that the scheduler is throwaway, so I didn't want to test by hardcoding stuff).
New to pull requests so I don't know if I'm the one merging...? If not, I'm fairly sure you can just add the new test file, add the new actor class, and replace the scheduler code with mine (unless there were significant changes to runner.py or smt

kiddyboots216 commented 6 years ago

@neeleshdodda44 you have a merge conflict. please fix before the PR can be merged.

neeleshdodda44 commented 6 years ago

Fixed merge conflict. Can I merge now? @kiddyboots216 @georgymh

kiddyboots216 commented 6 years ago

done and DONE. gj @neeleshdodda44 first PR. 🎈

georgymh / decentralized-ml