Preserve the underlying hasher when producing empty maps

[bakkot]

This produced incredibly difficult-to-locate bugs.

Opening PR with just tests at first so that they can be seen to be fixed.