search

etcd-io / dbtester

Distributed database benchmark tester
https://github.com/etcd-io/dbtester/tree/master/test-results
Apache License 2.0
282 stars 48 forks source link

Zookeeper: configure 'dataLogDir' in separate disk #310

Open gyuho opened 7 years ago

gyuho commented 7 years ago

http://zookeeper.apache.org/doc/trunk/zookeeperAdmin.html#sc_advancedConfiguration

Having a dedicated log device has a large impact on throughput and stable latencies. It is highly recommened to dedicate a log device and set dataLogDir to point to a directory on that device, and then make sure to point dataDir to a directory not residing on that device.

http://www.mail-archive.com/user@zookeeper.apache.org/msg07646.html

etcd would get separate wal, data dir as well.

TBD: Consul?

gyuho commented 7 years ago

This makes collecting disk metrics much more complicated, since data from separate disks need to be aggregated for comparison. This might make sense if we only test Zookeeper.

xiang90 commented 7 years ago

It would be great if someone familiar with ZK can help on this.