Wrap up benchmarking effort

[jtuttle]

The remaining tasks are:

• [ ] Clean up the codebase, and put things in their place so that it's a neat snapshot to continue from.
• [ ] Add documentation covering attempts, learnings, how the current setup works, how to run an experiment etc.
• [ ] Capture the results of the experiments that have been run in a format that stakeholders can consume.