You're looking for a simple and lightweight solution to test many different machine learning algorithms and hyperparamters against each other? Performance Evaluation is important to you and you care about reproduceablitiy at scale?
Then this tool might help you.