search

absolute8511 / ZanRedisDB

Yet another distributed fault-tolerant key-value database Compatible with Redis written in Golang.
MIT License
74 stars 77 forks source link

avoid some tail latency for write #42

Closed absolute8511 closed 6 years ago

absolute8511 commented 6 years ago

It may cause some slow write (>500ms) if the rocksdb option is not optimized. Need better options for write heavy load

absolute8511 commented 6 years ago

Something may be adjusted to improve write latency:

  1. shared block cache
  2. shared thread pool, adjust default backgroud thread for high and low jobs.
  3. use shared rate limiter and adjust dynamically to avoid the compaction cost too much io.
  4. enable_pipelined_write
  5. disableWAL
absolute8511 commented 6 years ago

Disable THP should help to solve this latency. http://fangpeishi.com/transparent-hungepages_zh.html