Generalized storage

[frthjf]

This simplifies and generalizes the storage implementation by separating generally useful local directory operation from use-case specific index operations. In particular, it supports storage implementations that may perform asynchronous operations.