Track parallel batches better internally to enable publish

[mdales]

This is a tweak to enable publish of results of a map stage to work, and have the internals better reflect what happened, rather than what I was doing before which was serialising parallel stages for the old internal data structure.