Parallelise batching of writes for similarity algorithms

[mneedham]

Testing on the recommendations dataset, there are so many partitions that the sequential approach is still faster.

[jexp]

Hmm do we want to add this as an option to be able to experiment more with it?

[mneedham]

We can merge this in but I need to fix the conflicts first