There might be some room for parallelization at the Optimizer's side
[ ] Identify a good optimizee which can be used for benchmarking all coptimizers and which can be scaled. Look at the frontiers branch for optimizees. A neural network would be ideal, maybe the ant colony or the mountain car.
[ ] Implement a benchmarking setup to compare compute and memory usage among all Optimizers
There might be some room for parallelization at the Optimizer's side