scylladb / scylla-bench

43 stars 36 forks source link

Add latency-type parameter #60

Closed dkropachev closed 3 years ago

dkropachev commented 3 years ago

There are two types of latencies: raw and co-fixed Both have their own place therefore we need to have a switch to pick what latencies user is going to see while test is running

Based on https://github.com/scylladb/scylla-bench/pull/52 fixes https://github.com/scylladb/scylla-bench/issues/56

dkropachev commented 3 years ago

Tested, works as expected:

$ ./scylla-bench -workload=uniform -mode=read -replication-factor=1 -partition-count=10 -clustering-row-count=10000000 -clustering-row-size=5120 -rows-per-request=10 -concurrency=7 -max-rate=32000 -duration=5760m -nodes 172.17.0.4
Configuration
Mode:                    read
Workload:                uniform
Timeout:                 5s
Consistency level:       quorum
Partition count:         10
Clustering rows:         10000000
Clustering row size:     Fixed(5120)
Rows per request:        10
Provide upper bound:     false
IN queries:              false
No lower bound:          false
Page size:               1000
Concurrency:             7
Connections:             4
Maximum rate:            32000 op/s
Client compression:      true

 time   ops/s  rows/s errors max    99.9th 99th   95th   90th   median mean   
   1s    6578       0      0 5ms    3.1ms  2ms    1.8ms  1.7ms  852µs  1.1ms  
   2s    6957       0      0 5.4ms  2.9ms  2.1ms  1.9ms  1.7ms  885µs  1ms    
   3s    6482       0      0 5ms    4.2ms  2.2ms  1.9ms  1.8ms  918µs  1.1ms  
   4s    7061       0      0 7.8ms  4.7ms  2.2ms  1.9ms  1.8ms  852µs  987µs  
   5s    6777       0      0 5.4ms  2.9ms  2.1ms  1.9ms  1.8ms  885µs  1ms    
   6s    6827       0      0 4.9ms  3.9ms  2.2ms  1.9ms  1.8ms  885µs  1ms    
   7s    6843       0      0 4.3ms  2.9ms  2.1ms  1.9ms  1.8ms  918µs  1ms    ^C
interrupted

Results
Time (avg):      7.143714209s
Total ops:       48446
Total rows:      0
Operations/s:    6781.626294410846
Rows/s:          0
raw latency :
  max:           7.831551ms 
  99.9th:        3.637247ms 
  99th:          2.097151ms 
  95th:          1.867775ms 
  90th:          1.769471ms 
  median:        884.735µs 
  mean:          1.026142ms
c-o fixed latency :
  max:           5.632950271s 
  99.9th:        5.628755967s 
  99th:          5.574230015s 
  95th:          5.339348991s 
  90th:          5.070913535s 
  median:        2.841640959s 
  mean:          2.829845899s

$ ./scylla-bench -workload=uniform -mode=read -replication-factor=1 -partition-count=10 -clustering-row-count=10000000 -clustering-row-size=5120 -rows-per-request=10 -concurrency=7 -max-rate=32000 -duration=5760m -nodes 172.17.0.4 -latency-type co
Configuration
Mode:                    read
Workload:                uniform
Timeout:                 5s
Consistency level:       quorum
Partition count:         10
Clustering rows:         10000000
Clustering row size:     Fixed(5120)
Rows per request:        10
Provide upper bound:     false
IN queries:              false
No lower bound:          false
Page size:               1000
Concurrency:             7
Connections:             4
Maximum rate:            32000 op/s
Client compression:      true

 time   ops/s  rows/s errors max    99.9th 99th   95th   90th   median mean   
   1s    6717       0      0 792ms  791ms  782ms  750ms  713ms  386ms  393ms  
   2s    6625       0      0 1.6s   1.6s   1.6s   1.5s   1.5s   1.2s   1.2s   
   3s    6780       0      0 2.4s   2.4s   2.4s   2.3s   2.3s   2s     2s     
   4s    6907       0      0 3.2s   3.2s   3.2s   3.1s   3.1s   2.8s   2.8s   
   5s    6745       0      0 4s     3.9s   3.9s   3.9s   3.9s   3.5s   3.5s   ^C
interrupted

Results
Time (avg):      5.304289144s
Total ops:       35901
Total rows:      0
Operations/s:    6768.296425766724
Rows/s:          0
raw latency :
  max:           5.111807ms 
  99.9th:        3.178495ms 
  99th:          2.129919ms 
  95th:          1.900543ms 
  90th:          1.769471ms 
  median:        917.503µs 
  mean:          1.02785ms
c-o fixed latency :
  max:           4.185915391s 
  99.9th:        4.179623935s 
  99th:          4.148166655s 
  95th:          3.986685951s 
  90th:          3.781165055s 
  median:        2.120220671s 
  mean:          2.106002037s
dkropachev commented 3 years ago

fixed-coordinated-omission

@psarna , thanks, fixed to "fixed-coordinated-omission"