Introduce a row cache per shard.

[purplefox]

This should prevent a lot of gets having to go to storage. Also removed old aggregation cache