Support generating local dir for sparse indexes

[illicitonion]

The first commit here is just moving code and making it public, and the second has the (minor) changes needed for sparse indexes.

[kornelski]

Thanks