search

oleiade / Elevator

Elevator is an open source, on-disk key-value store. Provides high-performance bulk read-write operations over very large datasets while exposing a simple and efficient API.
http://elevator.readthedocs.org
MIT License
71 stars 12 forks source link

Auto-sharding feature #146

Open oleiade opened 11 years ago

oleiade commented 11 years ago

Best use case of Elevator would be to shard different databases over different physical disk to reduce the disk seeks footprint.

Bioql does shard its datasets over multiple disk. It gave me the idea linked to []() that Elevator should be able to auto-shard a given db over multiple disks automaticaly.

Could be configurable via config file. elevator.conf example:

    [shard-1]
    disk=/var/disk1

    [shard-2]
    disk=/var/disk2

    ...