Snapchat / KeyDB

A Multithreaded Fork of Redis
https://keydb.dev
BSD 3-Clause "New" or "Revised" License
11.02k stars 564 forks source link

[CRASH] 6.3.4 unable to rewrite AOF File #763

Open bernhard-efler opened 6 months ago

bernhard-efler commented 6 months ago

Crash report

Paste the complete crash log between the quotes below. Please include a few lines from the log preceding the crash report to provide some context.

=== KEYDB BUG REPORT START: Cut & paste starting from here ===
109506:39:C 20 Dec 2023 06:12:56.831 # === ASSERTION FAILED ===
109506:39:C 20 Dec 2023 06:12:56.831 # ==> rdb.cpp:1372 'ckeysExpired == db->expireSize()' is not true

------ STACK TRACE ------

Backtrace:
keydb-aof-rewrite 0.0.0.0:6379(rdbSaveRio(_rio*, redisDbPersistentDataSnapshot const**, int*, int, rdbSaveInfo*)+0x54d) [0x55e50f27706d]
keydb-aof-rewrite 0.0.0.0:6379(rewriteAppendOnlyFile(char*)+0x161) [0x55e50f24f541]
keydb-aof-rewrite 0.0.0.0:6379(rewriteAppendOnlyFileBackground()+0x145) [0x55e50f24fd15]
keydb-aof-rewrite 0.0.0.0:6379(serverCron(aeEventLoop*, long long, void*)+0xe3d) [0x55e50f2d0fcd]
keydb-aof-rewrite 0.0.0.0:6379(aeProcessEvents+0x224) [0x55e50f2d75a4]
keydb-aof-rewrite 0.0.0.0:6379(aeMain+0x3a) [0x55e50f2dbcda]
keydb-aof-rewrite 0.0.0.0:6379(workerThreadMain(void*)+0x7e) [0x55e50f2c3ade]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f428f363609]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x43) [0x7f428f288133]

------ INFO OUTPUT ------
# Server
redis_version:6.3.4
redis_git_sha1:7e7e5e57
redis_git_dirty:1
redis_build_id:bb8fc59400781b64
redis_mode:standalone
os:Linux 6.0.18-200.fc36.x86_64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:9.4.0
process_id:109506
process_supervised:no
run_id:2c087b00de95c53d0fe501acbaf39c74d1a2ef81
tcp_port:6379
server_time_usec:1703052776826790
uptime_in_seconds:60414
uptime_in_days:0
hz:10
configured_hz:10
lru_clock:8553960
executable:/data/keydb-server
config_file:/etc/keydb/keydb.conf
availability_zone:
features:cluster_mget

# Clients
connected_clients:72
cluster_connections:0
maxclients:10000
client_recent_max_input_buffer:72
client_recent_max_output_buffer:20504
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0
current_client_thread:0
thread_0_clients:73

# Memory
used_memory:19007440
used_memory_human:18.13M
used_memory_rss:40144896
used_memory_rss_human:38.29M
used_memory_peak:33352656
used_memory_peak_human:31.81M
used_memory_peak_perc:56.99%
used_memory_overhead:6589368
used_memory_startup:1712376
used_memory_dataset:12418072
used_memory_dataset_perc:71.80%
allocator_allocated:20070848
allocator_active:22294528
allocator_resident:27926528
total_system_memory:84339466240
total_system_memory_human:78.55G
used_memory_lua:47104
used_memory_lua_human:46.00K
used_memory_scripts:2456
used_memory_scripts_human:2.40K
number_of_cached_scripts:7
maxmemory:268435456
maxmemory_human:256.00M
maxmemory_policy:noeviction
allocator_frag_ratio:1.11
allocator_frag_bytes:2223680
allocator_rss_ratio:1.25
allocator_rss_bytes:5632000
rss_overhead_ratio:1.44
rss_overhead_bytes:12218368
mem_fragmentation_ratio:2.10
mem_fragmentation_bytes:21016504
mem_not_counted_for_evict:762
mem_replication_backlog:1048576
mem_clients_slaves:20512
mem_clients_normal:1477128
mem_aof_buffer:768
mem_allocator:jemalloc-5.2.1
active_defrag_running:0
lazyfree_pending_objects:0
lazyfreed_objects:0
storage_provider:none
available_system_memory:unavailable

# Persistence
loading:0
current_cow_size:0
current_cow_size_age:0
current_fork_perc:0.00
current_save_keys_processed:0
current_save_keys_total:0
rdb_changes_since_last_save:18913662
rdb_bgsave_in_progress:0
rdb_last_save_time:1702992412
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:2
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:2129920
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:11
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:err
aof_last_write_status:ok
aof_last_cow_size:8638464
module_fork_in_progress:0
module_fork_last_cow_size:0
aof_current_size:442091957
aof_base_size:7580881
aof_pending_rewrite:0
aof_buffer_length:0
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:0

# Stats
total_connections_received:76390
total_commands_processed:110615958
instantaneous_ops_per_sec:565
total_net_input_bytes:21086473307
total_net_output_bytes:7034580041
instantaneous_input_kbps:149.43
instantaneous_output_kbps:16.20
rejected_connections:0
sync_full:1
sync_partial_ok:0
sync_partial_err:1
expired_keys:1849
expired_stale_perc:0.00
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:18370
evicted_keys:0
keyspace_hits:19936031
keyspace_misses:8149529
pubsub_channels:2
pubsub_patterns:1
latest_fork_usec:2452
total_forks:608
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
tracking_total_prefixes:0
unexpected_error_replies:21
total_error_replies:22
dump_payload_sanitizations:0
total_reads_processed:15059751
total_writes_processed:14866099
instantaneous_lock_contention:1
avg_lock_contention:0.078125
storage_provider_read_hits:0
storage_provider_read_misses:0

# Replication
role:active-replica
master_global_link_status:up
connected_masters:1
master_host:emp-backend-redis-node-1.emp-backend-redis-headless.evo-vkw-backend-qa.svc.cluster.local
master_port:6379
master_link_status:up
master_last_io_seconds_ago:0
master_sync_in_progress:0
slave_read_repl_offset:8346558085
slave_repl_offset:8346558085
slave_priority:100
slave_read_only:0
replica_announced:1
connected_slaves:1
slave0:ip=10.196.73.93,port=6379,state=online,offset=5745714964,lag=0
master_failover_state:no-failover
master_replid:f030836ebca8346ce74451d47f12826591737e54
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:5745730077
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:5744681502
repl_backlog_histlen:1048576

# CPU
used_cpu_sys:0.002845
used_cpu_user:0.001898
used_cpu_sys_children:0.000000
used_cpu_user_children:0.000000
server_threads:1
long_lock_waits:19
used_cpu_sys_main_thread:0.002845
used_cpu_user_main_thread:0.001898

# Modules

# Commandstats
cmdstat_rpush:calls=16078,usec=167581,usec_per_call=10.42,rejected_calls=0,failed_calls=0
cmdstat_zremrangebyscore:calls=3157,usec=54378,usec_per_call=17.22,rejected_calls=0,failed_calls=0
cmdstat_mget:calls=2087,usec=5650413,usec_per_call=2707.43,rejected_calls=0,failed_calls=0
cmdstat_info:calls=123336,usec=5853413,usec_per_call=47.46,rejected_calls=0,failed_calls=0
cmdstat_zrangebyscore:calls=6809698,usec=34917143,usec_per_call=5.13,rejected_calls=0,failed_calls=0
cmdstat_zadd:calls=10227,usec=439336,usec_per_call=42.96,rejected_calls=0,failed_calls=0
cmdstat_set:calls=16839,usec=624382,usec_per_call=37.08,rejected_calls=0,failed_calls=0
cmdstat_KEYDB.MVCCRESTORE:calls=37548,usec=622176,usec_per_call=16.57,rejected_calls=0,failed_calls=0
cmdstat_zcard:calls=41778,usec=24309,usec_per_call=0.58,rejected_calls=0,failed_calls=0
cmdstat_keys:calls=4020,usec=75812,usec_per_call=18.86,rejected_calls=0,failed_calls=0
cmdstat_latency:calls=4028,usec=10885,usec_per_call=2.70,rejected_calls=0,failed_calls=0
cmdstat_setex:calls=18768478,usec=177708067,usec_per_call=9.47,rejected_calls=0,failed_calls=0
cmdstat_psync:calls=1,usec=1596,usec_per_call=1596.00,rejected_calls=0,failed_calls=0
cmdstat_subscribe:calls=17,usec=236,usec_per_call=13.88,rejected_calls=0,failed_calls=0
cmdstat_select:calls=455,usec=425,usec_per_call=0.93,rejected_calls=0,failed_calls=0
cmdstat_replconf:calls=58712,usec=301933,usec_per_call=5.14,rejected_calls=0,failed_calls=0
cmdstat_rreplay:calls=51543779,usec=409731143,usec_per_call=7.95,rejected_calls=0,failed_calls=0
cmdstat_del:calls=18039,usec=239223,usec_per_call=13.26,rejected_calls=0,failed_calls=0
cmdstat_zrem:calls=8039,usec=258455,usec_per_call=32.15,rejected_calls=0,failed_calls=0
cmdstat_eval:calls=10257222,usec=447598856,usec_per_call=43.64,rejected_calls=0,failed_calls=0
cmdstat_psubscribe:calls=17,usec=55,usec_per_call=3.24,rejected_calls=0,failed_calls=0
cmdstat_config:calls=4028,usec=543814,usec_per_call=135.01,rejected_calls=0,failed_calls=0
cmdstat_setnx:calls=201,usec=2157,usec_per_call=10.73,rejected_calls=0,failed_calls=0
cmdstat_auth:calls=76391,usec=1144899,usec_per_call=14.99,rejected_calls=0,failed_calls=0
cmdstat_client:calls=4028,usec=9830,usec_per_call=2.44,rejected_calls=0,failed_calls=0
cmdstat_exec:calls=19606,usec=926796176,usec_per_call=47271.05,rejected_calls=0,failed_calls=0
cmdstat_llen:calls=20100,usec=28530,usec_per_call=1.42,rejected_calls=0,failed_calls=0
cmdstat_get:calls=19149196,usec=164122528,usec_per_call=8.57,rejected_calls=0,failed_calls=0
cmdstat_exists:calls=13,usec=29,usec_per_call=2.23,rejected_calls=0,failed_calls=0
cmdstat_replping:calls=0,usec=0,usec_per_call=0.00,rejected_calls=1,failed_calls=0
cmdstat_slowlog:calls=8056,usec=55288,usec_per_call=6.86,rejected_calls=0,failed_calls=0
cmdstat_multi:calls=19606,usec=42117,usec_per_call=2.15,rejected_calls=0,failed_calls=0
cmdstat_lpop:calls=3412888,usec=8367127,usec_per_call=2.45,rejected_calls=0,failed_calls=0
cmdstat_ping:calls=77563,usec=58772,usec_per_call=0.76,rejected_calls=0,failed_calls=0

# Errorstats
errorstat_ERR:count=21
errorstat_NOAUTH:count=1

# Cluster
cluster_enabled:0

# Keyspace
db0:keys=12,expires=7,avg_ttl=-9223372036854775808,cached_keys=12
db1:keys=19,expires=23,avg_ttl=15935,cached_keys=19
db2:keys=37529,expires=37529,avg_ttl=2308619995,cached_keys=37529

# KeyDB
mvcc_depth:0

------ CLIENT LIST OUTPUT ------
id=3908 addr=10.196.112.115:56292 laddr=10.196.142.179:6379 fd=47 name= age=57411 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3909 addr=10.196.118.172:59540 laddr=10.196.142.179:6379 fd=48 name= age=57411 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3937 addr=10.196.118.172:34326 laddr=10.196.142.179:6379 fd=40 name= age=57404 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=114 addr=10.196.73.93:44613 laddr=10.196.142.179:6379 fd=60 name= age=60366 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=replconf user=default redir=-1
id=3936 addr=10.196.118.172:34316 laddr=10.196.142.179:6379 fd=22 name= age=57404 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=4201 addr=10.196.112.115:52352 laddr=10.196.142.179:6379 fd=96 name= age=57228 idle=51 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3906 addr=10.196.112.115:56284 laddr=10.196.142.179:6379 fd=39 name= age=57411 idle=3 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=47892 addr=10.196.112.115:43408 laddr=10.196.142.179:6379 fd=30 name= age=22646 idle=866 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3914 addr=10.196.118.172:59556 laddr=10.196.142.179:6379 fd=51 name= age=57410 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=72918 addr=10.196.118.172:38812 laddr=10.196.142.179:6379 fd=79 name= age=2797 idle=2797 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3915 addr=10.196.118.172:59568 laddr=10.196.142.179:6379 fd=52 name= age=57410 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=4036 addr=10.196.112.115:40434 laddr=10.196.142.179:6379 fd=18 name= age=57349 idle=171 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3947 addr=10.196.112.115:44658 laddr=10.196.142.179:6379 fd=58 name= age=57401 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3948 addr=10.196.118.172:34390 laddr=10.196.142.179:6379 fd=59 name= age=57401 idle=5 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3954 addr=10.196.118.172:51276 laddr=10.196.142.179:6379 fd=66 name= age=57399 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3955 addr=10.196.118.172:51284 laddr=10.196.142.179:6379 fd=67 name= age=57399 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3866 addr=10.196.112.115:50706 laddr=10.196.142.179:6379 fd=36 name= age=57421 idle=12 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3905 addr=10.196.118.172:59538 laddr=10.196.142.179:6379 fd=31 name= age=57411 idle=3 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=73680 addr=10.196.112.115:42690 laddr=10.196.142.179:6379 fd=46 name= age=2186 idle=26 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3903 addr=10.196.118.172:59528 laddr=10.196.142.179:6379 fd=26 name= age=57412 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3904 addr=10.196.118.172:59530 laddr=10.196.142.179:6379 fd=27 name= age=57412 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73292 addr=10.196.118.172:60638 laddr=10.196.142.179:6379 fd=74 name= age=2500 idle=2497 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3865 addr=10.196.112.115:50702 laddr=10.196.142.179:6379 fd=23 name= age=57421 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3901 addr=10.196.112.115:56272 laddr=10.196.142.179:6379 fd=19 name= age=57412 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=75983 addr=10.196.112.115:55402 laddr=10.196.142.179:6379 fd=87 name= age=327 idle=327 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=75984 addr=10.196.118.172:56920 laddr=10.196.142.179:6379 fd=89 name= age=327 idle=327 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=75985 addr=10.196.118.172:56934 laddr=10.196.142.179:6379 fd=90 name= age=327 idle=26 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=75986 addr=10.196.118.172:56948 laddr=10.196.142.179:6379 fd=91 name= age=327 idle=327 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=75987 addr=10.196.112.115:55416 laddr=10.196.142.179:6379 fd=92 name= age=327 idle=327 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=3952 addr=10.196.112.115:44668 laddr=10.196.142.179:6379 fd=62 name= age=57399 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3953 addr=10.196.112.115:44672 laddr=10.196.142.179:6379 fd=65 name= age=57399 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73418 addr=10.196.112.115:47324 laddr=10.196.142.179:6379 fd=73 name= age=2400 idle=2389 flags=P db=0 sub=2 psub=1 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=psubscribe user=default redir=-1
id=3902 addr=10.196.112.115:56282 laddr=10.196.142.179:6379 fd=25 name= age=57412 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73118 addr=10.196.112.115:35594 laddr=10.196.142.179:6379 fd=76 name= age=2639 idle=2639 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73119 addr=10.196.112.115:35598 laddr=10.196.142.179:6379 fd=80 name= age=2639 idle=2639 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73120 addr=10.196.118.172:44840 laddr=10.196.142.179:6379 fd=82 name= age=2639 idle=35 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=54646 addr=10.196.118.172:50400 laddr=10.196.142.179:6379 fd=75 name= age=17306 idle=1106 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=73691 addr=10.196.112.115:59892 laddr=10.196.142.179:6379 fd=72 name= age=2177 idle=2177 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73692 addr=10.196.112.115:59908 laddr=10.196.142.179:6379 fd=84 name= age=2177 idle=2177 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73693 addr=10.196.112.115:59910 laddr=10.196.142.179:6379 fd=86 name= age=2177 idle=2177 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73695 addr=10.196.112.115:59926 laddr=10.196.142.179:6379 fd=88 name= age=2177 idle=2177 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=11 addr=10.196.73.93:6379 laddr=10.196.142.179:43785 fd=13 name= age=60403 idle=0 flags=M db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61480 events=r cmd=rreplay user=(superuser) redir=-1
id=3913 addr=10.196.112.115:56314 laddr=10.196.142.179:6379 fd=50 name= age=57411 idle=54 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=del user=default redir=-1
id=3983 addr=10.196.118.172:42604 laddr=10.196.142.179:6379 fd=78 name= age=57387 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3980 addr=10.196.112.115:33956 laddr=10.196.142.179:6379 fd=77 name= age=57387 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=73117 addr=10.196.118.172:44836 laddr=10.196.142.179:6379 fd=38 name= age=2639 idle=2639 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=3921 addr=10.196.112.115:56346 laddr=10.196.142.179:6379 fd=34 name= age=57408 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=3895 addr=10.196.112.115:56214 laddr=10.196.142.179:6379 fd=42 name= age=57413 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3896 addr=10.196.112.115:56228 laddr=10.196.142.179:6379 fd=43 name= age=57413 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=3897 addr=10.196.118.172:59520 laddr=10.196.142.179:6379 fd=44 name= age=57413 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3957 addr=10.196.118.172:51290 laddr=10.196.142.179:6379 fd=61 name= age=57398 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3898 addr=10.196.112.115:56232 laddr=10.196.142.179:6379 fd=45 name= age=57413 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=68537 addr=10.196.112.115:37040 laddr=10.196.142.179:6379 fd=81 name= age=6332 idle=86 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3920 addr=10.196.112.115:56344 laddr=10.196.142.179:6379 fd=24 name= age=57408 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=72917 addr=10.196.112.115:43280 laddr=10.196.142.179:6379 fd=29 name= age=2797 idle=2797 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3968 addr=10.196.118.172:51336 laddr=10.196.142.179:6379 fd=71 name= age=57393 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=3956 addr=10.196.118.172:51286 laddr=10.196.142.179:6379 fd=56 name= age=57398 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=72850 addr=10.196.112.115:40128 laddr=10.196.142.179:6379 fd=41 name= age=2847 idle=2847 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=72851 addr=10.196.118.172:42400 laddr=10.196.142.179:6379 fd=49 name= age=2847 idle=2847 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=72852 addr=10.196.118.172:42416 laddr=10.196.142.179:6379 fd=53 name= age=2847 idle=866 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=72853 addr=10.196.118.172:42430 laddr=10.196.142.179:6379 fd=54 name= age=2847 idle=2847 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=72854 addr=10.196.118.172:42436 laddr=10.196.142.179:6379 fd=85 name= age=2847 idle=2847 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=3967 addr=10.196.118.172:51324 laddr=10.196.142.179:6379 fd=70 name= age=57393 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3938 addr=10.196.118.172:34340 laddr=10.196.142.179:6379 fd=55 name= age=57403 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3939 addr=10.196.118.172:34352 laddr=10.196.142.179:6379 fd=57 name= age=57403 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73453 addr=10.196.118.172:45878 laddr=10.196.142.179:6379 fd=64 name= age=2371 idle=2362 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3958 addr=10.196.118.172:51306 laddr=10.196.142.179:6379 fd=68 name= age=57397 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=72916 addr=10.196.112.115:43894 laddr=10.196.142.179:6379 fd=15 name= age=2798 idle=2798 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=73116 addr=10.196.112.115:35586 laddr=10.196.142.179:6379 fd=37 name= age=2639 idle=35 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=keys user=default redir=-1
id=4124 addr=10.196.112.115:37802 laddr=10.196.142.179:6379 fd=95 name= age=57288 idle=171 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3959 addr=10.196.112.115:40388 laddr=10.196.142.179:6379 fd=69 name= age=57397 idle=9 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3943 addr=10.196.112.115:44642 laddr=10.196.142.179:6379 fd=14 name= age=57401 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3944 addr=10.196.112.115:44646 laddr=10.196.142.179:6379 fd=21 name= age=57401 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1

------ MODULES INFO OUTPUT ------

------ FAST MEMORY TEST ------
*** Preparing to test memory region 55e50f983000 (2334720 bytes)
*** Preparing to test memory region 7f4283c00000 (4194304 bytes)
*** Preparing to test memory region 7f428407f000 (26738688 bytes)
*** Preparing to test memory region 7f4285a00000 (8388608 bytes)
*** Preparing to test memory region 7f4286200000 (18874368 bytes)
*** Preparing to test memory region 7f428747f000 (5767168 bytes)
*** Preparing to test memory region 7f4287a00000 (8388608 bytes)
*** Preparing to test memory region 7f4288200000 (4194304 bytes)
*** Preparing to test memory region 7f428877a000 (8388608 bytes)
*** Preparing to test memory region 7f4288f7b000 (8388608 bytes)
*** Preparing to test memory region 7f428977b000 (11010048 bytes)
*** Preparing to test memory region 7f428a1fc000 (8388608 bytes)
*** Preparing to test memory region 7f428a9fd000 (8388608 bytes)
*** Preparing to test memory region 7f428b1fe000 (8388608 bytes)
*** Preparing to test memory region 7f428b9ff000 (8388608 bytes)
*** Preparing to test memory region 7f428c200000 (8388608 bytes)
*** Preparing to test memory region 7f428ca00000 (4194304 bytes)
*** Preparing to test memory region 7f428cf80000 (8388608 bytes)
*** Preparing to test memory region 7f428d780000 (11010048 bytes)
*** Preparing to test memory region 7f428e324000 (69632 bytes)
*** Preparing to test memory region 7f428e368000 (32768 bytes)
*** Preparing to test memory region 7f428e4e6000 (4096 bytes)
*** Preparing to test memory region 7f428e523000 (8192 bytes)
*** Preparing to test memory region 7f428e581000 (4096 bytes)
*** Preparing to test memory region 7f428e6ba000 (4096 bytes)
*** Preparing to test memory region 7f428e6c7000 (8192 bytes)
*** Preparing to test memory region 7f428e8a1000 (8192 bytes)
*** Preparing to test memory region 7f428e8bd000 (8192 bytes)
*** Preparing to test memory region 7f428e905000 (4096 bytes)
*** Preparing to test memory region 7f428e9e3000 (8192 bytes)
*** Preparing to test memory region 7f428ecae000 (8192 bytes)
*** Preparing to test memory region 7f428ee40000 (8192 bytes)
*** Preparing to test memory region 7f428eea7000 (8192 bytes)
*** Preparing to test memory region 7f428ef97000 (8192 bytes)
*** Preparing to test memory region 7f428f08a000 (8192 bytes)
*** Preparing to test memory region 7f428f357000 (16384 bytes)
*** Preparing to test memory region 7f428f37a000 (16384 bytes)
*** Preparing to test memory region 7f428f399000 (8192 bytes)
*** Preparing to test memory region 7f428f6c9000 (12288 bytes)
*** Preparing to test memory region 7f428f99e000 (16384 bytes)
*** Preparing to test memory region 7f428fa57000 (8192 bytes)
*** Preparing to test memory region 7f428fa8b000 (4096 bytes)
.O.O.O.O.O.O.O.O.109506:39:C 20 Dec 2023 06:13:00.921 # KeyDB 6.3.4 crashed by signal: 11, si_code: 1
109506:39:C 20 Dec 2023 06:13:00.921 # Accessing address: 0xffffffffffffffe7
109506:39:C 20 Dec 2023 06:13:00.921 # Crashed running the instruction at: 0x7f4288e75818

------ STACK TRACE ------
EIP:
[0x7f4288e75818]

Backtrace:
/lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f428f36f420]
[0x7f4288e75818]

------ REGISTERS ------
109506:39:C 20 Dec 2023 06:13:00.921 # 
RAX:0000000000000000 RBX:00007f4288e757e8
RCX:00007f4288e79ff8 RDX:0000000000000000
RDI:00007f4288d7a000 RSI:0000000000020000
RBP:00007f4288e757f0 RSP:00007f4288e75820
R8 :0000000000000010 R9 :00007f4288e758a0
R10:0000000000100000 R11:00007f4288f75830
R12:00007f4288e757f8 R13:00007f4288e75800
R14:00007f4288e75808 R15:00007f4288e75810
RIP:00007f4288e75818 EFL:0000000000010246
CSGSFS:002b000000000033
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e7582f) -> 00007f4288e75898
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e7582e) -> 00007f4288e75890
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e7582d) -> 00007f4288e75888
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e7582c) -> 00007f4288e75880
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e7582b) -> 00007f4288e75878
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e7582a) -> 00007f4288e75870
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75829) -> 00007f4288e75868
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75828) -> 00007f4288e75860
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75827) -> 00007f4288e75858
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75826) -> 00007f4288e75850
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75825) -> 00007f4288e75848
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75824) -> 00007f4288e75840
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75823) -> 00007f4288e75838
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75822) -> 00007f4288e75830
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75821) -> 00007f4288e75828
109506:39:C 20 Dec 2023 06:13:00.921 # (00007f4288e75820) -> 00007f4288e75820

------ INFO OUTPUT ------
# Server
redis_version:6.3.4
redis_git_sha1:7e7e5e57
redis_git_dirty:1
redis_build_id:bb8fc59400781b64
redis_mode:standalone
os:Linux 6.0.18-200.fc36.x86_64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:9.4.0
process_id:109506
process_supervised:no
run_id:2c087b00de95c53d0fe501acbaf39c74d1a2ef81
tcp_port:6379
server_time_usec:1703052776826790
uptime_in_seconds:60414
uptime_in_days:0
hz:10
configured_hz:10
lru_clock:8553960
executable:/data/keydb-server
config_file:/etc/keydb/keydb.conf
availability_zone:
features:cluster_mget

# Clients
connected_clients:72
cluster_connections:0
maxclients:10000
client_recent_max_input_buffer:72
client_recent_max_output_buffer:20504
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0
current_client_thread:0
thread_0_clients:73

# Memory
used_memory:19009936
used_memory_human:18.13M
used_memory_rss:40144896
used_memory_rss_human:38.29M
used_memory_peak:33352656
used_memory_peak_human:31.81M
used_memory_peak_perc:57.00%
used_memory_overhead:6589368
used_memory_startup:1712376
used_memory_dataset:12420568
used_memory_dataset_perc:71.81%
allocator_allocated:20070848
allocator_active:22294528
allocator_resident:27926528
total_system_memory:84339466240
total_system_memory_human:78.55G
used_memory_lua:47104
used_memory_lua_human:46.00K
used_memory_scripts:2456
used_memory_scripts_human:2.40K
number_of_cached_scripts:7
maxmemory:268435456
maxmemory_human:256.00M
maxmemory_policy:noeviction
allocator_frag_ratio:1.11
allocator_frag_bytes:2223680
allocator_rss_ratio:1.25
allocator_rss_bytes:5632000
rss_overhead_ratio:1.44
rss_overhead_bytes:12218368
mem_fragmentation_ratio:2.10
mem_fragmentation_bytes:21016504
mem_not_counted_for_evict:762
mem_replication_backlog:1048576
mem_clients_slaves:20512
mem_clients_normal:1477128
mem_aof_buffer:768
mem_allocator:jemalloc-5.2.1
active_defrag_running:0
lazyfree_pending_objects:0
lazyfreed_objects:0
storage_provider:none
available_system_memory:unavailable

# Persistence
loading:0
current_cow_size:0
current_cow_size_age:0
current_fork_perc:0.00
current_save_keys_processed:0
current_save_keys_total:0
rdb_changes_since_last_save:18913662
rdb_bgsave_in_progress:0
rdb_last_save_time:1702992412
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:2
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:2129920
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:11
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:err
aof_last_write_status:ok
aof_last_cow_size:8638464
module_fork_in_progress:0
module_fork_last_cow_size:0
aof_current_size:442091957
aof_base_size:7580881
aof_pending_rewrite:0
aof_buffer_length:0
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:0

# Stats
total_connections_received:76390
total_commands_processed:110615958
instantaneous_ops_per_sec:565
total_net_input_bytes:21086473307
total_net_output_bytes:7034580041
instantaneous_input_kbps:149.43
instantaneous_output_kbps:16.20
rejected_connections:0
sync_full:1
sync_partial_ok:0
sync_partial_err:1
expired_keys:1849
expired_stale_perc:0.00
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:18370
evicted_keys:0
keyspace_hits:19936031
keyspace_misses:8149529
pubsub_channels:2
pubsub_patterns:1
latest_fork_usec:2452
total_forks:608
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
tracking_total_prefixes:0
unexpected_error_replies:21
total_error_replies:22
dump_payload_sanitizations:0
total_reads_processed:15059751
total_writes_processed:14866099
instantaneous_lock_contention:1
avg_lock_contention:0.078125
storage_provider_read_hits:0
storage_provider_read_misses:0

# Replication
role:active-replica
master_global_link_status:up
connected_masters:1
master_host:emp-backend-redis-node-1.emp-backend-redis-headless.evo-vkw-backend-qa.svc.cluster.local
master_port:6379
master_link_status:up
master_last_io_seconds_ago:0
master_sync_in_progress:0
slave_read_repl_offset:8346558085
slave_repl_offset:8346558085
slave_priority:100
slave_read_only:0
replica_announced:1
connected_slaves:1
slave0:ip=10.196.73.93,port=6379,state=online,offset=5745714964,lag=4
master_failover_state:no-failover
master_replid:f030836ebca8346ce74451d47f12826591737e54
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:5745730077
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:5744681502
repl_backlog_histlen:1048576

# CPU
used_cpu_sys:0.088297
used_cpu_user:0.245534
used_cpu_sys_children:0.000000
used_cpu_user_children:0.000000
server_threads:1
long_lock_waits:19
used_cpu_sys_main_thread:0.088297
used_cpu_user_main_thread:0.245534

# Modules

# Commandstats
cmdstat_rpush:calls=16078,usec=167581,usec_per_call=10.42,rejected_calls=0,failed_calls=0
cmdstat_zremrangebyscore:calls=3157,usec=54378,usec_per_call=17.22,rejected_calls=0,failed_calls=0
cmdstat_mget:calls=2087,usec=5650413,usec_per_call=2707.43,rejected_calls=0,failed_calls=0
cmdstat_info:calls=123336,usec=5853413,usec_per_call=47.46,rejected_calls=0,failed_calls=0
cmdstat_zrangebyscore:calls=6809698,usec=34917143,usec_per_call=5.13,rejected_calls=0,failed_calls=0
cmdstat_zadd:calls=10227,usec=439336,usec_per_call=42.96,rejected_calls=0,failed_calls=0
cmdstat_set:calls=16839,usec=624382,usec_per_call=37.08,rejected_calls=0,failed_calls=0
cmdstat_KEYDB.MVCCRESTORE:calls=37548,usec=622176,usec_per_call=16.57,rejected_calls=0,failed_calls=0
cmdstat_zcard:calls=41778,usec=24309,usec_per_call=0.58,rejected_calls=0,failed_calls=0
cmdstat_keys:calls=4020,usec=75812,usec_per_call=18.86,rejected_calls=0,failed_calls=0
cmdstat_latency:calls=4028,usec=10885,usec_per_call=2.70,rejected_calls=0,failed_calls=0
cmdstat_setex:calls=18768478,usec=177708067,usec_per_call=9.47,rejected_calls=0,failed_calls=0
cmdstat_psync:calls=1,usec=1596,usec_per_call=1596.00,rejected_calls=0,failed_calls=0
cmdstat_subscribe:calls=17,usec=236,usec_per_call=13.88,rejected_calls=0,failed_calls=0
cmdstat_select:calls=455,usec=425,usec_per_call=0.93,rejected_calls=0,failed_calls=0
cmdstat_replconf:calls=58712,usec=301933,usec_per_call=5.14,rejected_calls=0,failed_calls=0
cmdstat_rreplay:calls=51543779,usec=409731143,usec_per_call=7.95,rejected_calls=0,failed_calls=0
cmdstat_del:calls=18039,usec=239223,usec_per_call=13.26,rejected_calls=0,failed_calls=0
cmdstat_zrem:calls=8039,usec=258455,usec_per_call=32.15,rejected_calls=0,failed_calls=0
cmdstat_eval:calls=10257222,usec=447598856,usec_per_call=43.64,rejected_calls=0,failed_calls=0
cmdstat_psubscribe:calls=17,usec=55,usec_per_call=3.24,rejected_calls=0,failed_calls=0
cmdstat_config:calls=4028,usec=543814,usec_per_call=135.01,rejected_calls=0,failed_calls=0
cmdstat_setnx:calls=201,usec=2157,usec_per_call=10.73,rejected_calls=0,failed_calls=0
cmdstat_auth:calls=76391,usec=1144899,usec_per_call=14.99,rejected_calls=0,failed_calls=0
cmdstat_client:calls=4028,usec=9830,usec_per_call=2.44,rejected_calls=0,failed_calls=0
cmdstat_exec:calls=19606,usec=926796176,usec_per_call=47271.05,rejected_calls=0,failed_calls=0
cmdstat_llen:calls=20100,usec=28530,usec_per_call=1.42,rejected_calls=0,failed_calls=0
cmdstat_get:calls=19149196,usec=164122528,usec_per_call=8.57,rejected_calls=0,failed_calls=0
cmdstat_exists:calls=13,usec=29,usec_per_call=2.23,rejected_calls=0,failed_calls=0
cmdstat_replping:calls=0,usec=0,usec_per_call=0.00,rejected_calls=1,failed_calls=0
cmdstat_slowlog:calls=8056,usec=55288,usec_per_call=6.86,rejected_calls=0,failed_calls=0
cmdstat_multi:calls=19606,usec=42117,usec_per_call=2.15,rejected_calls=0,failed_calls=0
cmdstat_lpop:calls=3412888,usec=8367127,usec_per_call=2.45,rejected_calls=0,failed_calls=0
cmdstat_ping:calls=77563,usec=58772,usec_per_call=0.76,rejected_calls=0,failed_calls=0

# Errorstats
errorstat_ERR:count=21
errorstat_NOAUTH:count=1

# Cluster
cluster_enabled:0

# Keyspace
db0:keys=12,expires=7,avg_ttl=-9223372036854775808,cached_keys=12
db1:keys=19,expires=23,avg_ttl=15935,cached_keys=19
db2:keys=37529,expires=37529,avg_ttl=2308619995,cached_keys=37529

# KeyDB
mvcc_depth:0

------ CLIENT LIST OUTPUT ------
id=3908 addr=10.196.112.115:56292 laddr=10.196.142.179:6379 fd=47 name= age=57411 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3909 addr=10.196.118.172:59540 laddr=10.196.142.179:6379 fd=48 name= age=57411 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3937 addr=10.196.118.172:34326 laddr=10.196.142.179:6379 fd=40 name= age=57404 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=114 addr=10.196.73.93:44613 laddr=10.196.142.179:6379 fd=60 name= age=60366 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=replconf user=default redir=-1
id=3936 addr=10.196.118.172:34316 laddr=10.196.142.179:6379 fd=22 name= age=57404 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=4201 addr=10.196.112.115:52352 laddr=10.196.142.179:6379 fd=96 name= age=57228 idle=51 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3906 addr=10.196.112.115:56284 laddr=10.196.142.179:6379 fd=39 name= age=57411 idle=3 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=47892 addr=10.196.112.115:43408 laddr=10.196.142.179:6379 fd=30 name= age=22646 idle=866 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3914 addr=10.196.118.172:59556 laddr=10.196.142.179:6379 fd=51 name= age=57410 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=72918 addr=10.196.118.172:38812 laddr=10.196.142.179:6379 fd=79 name= age=2797 idle=2797 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3915 addr=10.196.118.172:59568 laddr=10.196.142.179:6379 fd=52 name= age=57410 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=4036 addr=10.196.112.115:40434 laddr=10.196.142.179:6379 fd=18 name= age=57349 idle=171 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3947 addr=10.196.112.115:44658 laddr=10.196.142.179:6379 fd=58 name= age=57401 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3948 addr=10.196.118.172:34390 laddr=10.196.142.179:6379 fd=59 name= age=57401 idle=5 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3954 addr=10.196.118.172:51276 laddr=10.196.142.179:6379 fd=66 name= age=57399 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3955 addr=10.196.118.172:51284 laddr=10.196.142.179:6379 fd=67 name= age=57399 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3866 addr=10.196.112.115:50706 laddr=10.196.142.179:6379 fd=36 name= age=57421 idle=12 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3905 addr=10.196.118.172:59538 laddr=10.196.142.179:6379 fd=31 name= age=57411 idle=3 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=73680 addr=10.196.112.115:42690 laddr=10.196.142.179:6379 fd=46 name= age=2186 idle=26 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3903 addr=10.196.118.172:59528 laddr=10.196.142.179:6379 fd=26 name= age=57412 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3904 addr=10.196.118.172:59530 laddr=10.196.142.179:6379 fd=27 name= age=57412 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73292 addr=10.196.118.172:60638 laddr=10.196.142.179:6379 fd=74 name= age=2500 idle=2497 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3865 addr=10.196.112.115:50702 laddr=10.196.142.179:6379 fd=23 name= age=57421 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3901 addr=10.196.112.115:56272 laddr=10.196.142.179:6379 fd=19 name= age=57412 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=75983 addr=10.196.112.115:55402 laddr=10.196.142.179:6379 fd=87 name= age=327 idle=327 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=75984 addr=10.196.118.172:56920 laddr=10.196.142.179:6379 fd=89 name= age=327 idle=327 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=75985 addr=10.196.118.172:56934 laddr=10.196.142.179:6379 fd=90 name= age=327 idle=26 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=75986 addr=10.196.118.172:56948 laddr=10.196.142.179:6379 fd=91 name= age=327 idle=327 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=75987 addr=10.196.112.115:55416 laddr=10.196.142.179:6379 fd=92 name= age=327 idle=327 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=3952 addr=10.196.112.115:44668 laddr=10.196.142.179:6379 fd=62 name= age=57399 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3953 addr=10.196.112.115:44672 laddr=10.196.142.179:6379 fd=65 name= age=57399 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73418 addr=10.196.112.115:47324 laddr=10.196.142.179:6379 fd=73 name= age=2400 idle=2389 flags=P db=0 sub=2 psub=1 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=psubscribe user=default redir=-1
id=3902 addr=10.196.112.115:56282 laddr=10.196.142.179:6379 fd=25 name= age=57412 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73118 addr=10.196.112.115:35594 laddr=10.196.142.179:6379 fd=76 name= age=2639 idle=2639 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73119 addr=10.196.112.115:35598 laddr=10.196.142.179:6379 fd=80 name= age=2639 idle=2639 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73120 addr=10.196.118.172:44840 laddr=10.196.142.179:6379 fd=82 name= age=2639 idle=35 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=54646 addr=10.196.118.172:50400 laddr=10.196.142.179:6379 fd=75 name= age=17306 idle=1106 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=73691 addr=10.196.112.115:59892 laddr=10.196.142.179:6379 fd=72 name= age=2177 idle=2177 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73692 addr=10.196.112.115:59908 laddr=10.196.142.179:6379 fd=84 name= age=2177 idle=2177 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73693 addr=10.196.112.115:59910 laddr=10.196.142.179:6379 fd=86 name= age=2177 idle=2177 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=73695 addr=10.196.112.115:59926 laddr=10.196.142.179:6379 fd=88 name= age=2177 idle=2177 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=11 addr=10.196.73.93:6379 laddr=10.196.142.179:43785 fd=13 name= age=60403 idle=0 flags=M db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61480 events=r cmd=rreplay user=(superuser) redir=-1
id=3913 addr=10.196.112.115:56314 laddr=10.196.142.179:6379 fd=50 name= age=57411 idle=54 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=del user=default redir=-1
id=3983 addr=10.196.118.172:42604 laddr=10.196.142.179:6379 fd=78 name= age=57387 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3980 addr=10.196.112.115:33956 laddr=10.196.142.179:6379 fd=77 name= age=57387 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=73117 addr=10.196.118.172:44836 laddr=10.196.142.179:6379 fd=38 name= age=2639 idle=2639 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=3921 addr=10.196.112.115:56346 laddr=10.196.142.179:6379 fd=34 name= age=57408 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=3895 addr=10.196.112.115:56214 laddr=10.196.142.179:6379 fd=42 name= age=57413 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3896 addr=10.196.112.115:56228 laddr=10.196.142.179:6379 fd=43 name= age=57413 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=3897 addr=10.196.118.172:59520 laddr=10.196.142.179:6379 fd=44 name= age=57413 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3957 addr=10.196.118.172:51290 laddr=10.196.142.179:6379 fd=61 name= age=57398 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=3898 addr=10.196.112.115:56232 laddr=10.196.142.179:6379 fd=45 name= age=57413 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=68537 addr=10.196.112.115:37040 laddr=10.196.142.179:6379 fd=81 name= age=6332 idle=86 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3920 addr=10.196.112.115:56344 laddr=10.196.142.179:6379 fd=24 name= age=57408 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=72917 addr=10.196.112.115:43280 laddr=10.196.142.179:6379 fd=29 name= age=2797 idle=2797 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3968 addr=10.196.118.172:51336 laddr=10.196.142.179:6379 fd=71 name= age=57393 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1
id=3956 addr=10.196.118.172:51286 laddr=10.196.142.179:6379 fd=56 name= age=57398 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=72850 addr=10.196.112.115:40128 laddr=10.196.142.179:6379 fd=41 name= age=2847 idle=2847 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=72851 addr=10.196.118.172:42400 laddr=10.196.142.179:6379 fd=49 name= age=2847 idle=2847 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=72852 addr=10.196.118.172:42416 laddr=10.196.142.179:6379 fd=53 name= age=2847 idle=866 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=72853 addr=10.196.118.172:42430 laddr=10.196.142.179:6379 fd=54 name= age=2847 idle=2847 flags=N db=4 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=72854 addr=10.196.118.172:42436 laddr=10.196.142.179:6379 fd=85 name= age=2847 idle=2847 flags=N db=5 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=select user=default redir=-1
id=3967 addr=10.196.118.172:51324 laddr=10.196.142.179:6379 fd=70 name= age=57393 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3938 addr=10.196.118.172:34340 laddr=10.196.142.179:6379 fd=55 name= age=57403 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3939 addr=10.196.118.172:34352 laddr=10.196.142.179:6379 fd=57 name= age=57403 idle=2 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20544 events=r cmd=eval user=default redir=-1
id=73453 addr=10.196.118.172:45878 laddr=10.196.142.179:6379 fd=64 name= age=2371 idle=2362 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=3958 addr=10.196.118.172:51306 laddr=10.196.142.179:6379 fd=68 name= age=57397 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=72916 addr=10.196.112.115:43894 laddr=10.196.142.179:6379 fd=15 name= age=2798 idle=2798 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=info user=default redir=-1
id=73116 addr=10.196.112.115:35586 laddr=10.196.142.179:6379 fd=37 name= age=2639 idle=35 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=keys user=default redir=-1
id=4124 addr=10.196.112.115:37802 laddr=10.196.142.179:6379 fd=95 name= age=57288 idle=171 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=3959 addr=10.196.112.115:40388 laddr=10.196.142.179:6379 fd=69 name= age=57397 idle=9 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=setex user=default redir=-1
id=3943 addr=10.196.112.115:44642 laddr=10.196.142.179:6379 fd=14 name= age=57401 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=3944 addr=10.196.112.115:44646 laddr=10.196.142.179:6379 fd=21 name= age=57401 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61496 events=r cmd=eval user=default redir=-1

------ MODULES INFO OUTPUT ------

------ FAST MEMORY TEST ------
*** Preparing to test memory region 55e50f983000 (2334720 bytes)
*** Preparing to test memory region 7f4283c00000 (4194304 bytes)
*** Preparing to test memory region 7f428407f000 (26738688 bytes)
*** Preparing to test memory region 7f4285a00000 (8388608 bytes)
*** Preparing to test memory region 7f4286200000 (18874368 bytes)
*** Preparing to test memory region 7f428747f000 (5767168 bytes)
*** Preparing to test memory region 7f4287a00000 (8388608 bytes)
*** Preparing to test memory region 7f4288200000 (4194304 bytes)
*** Preparing to test memory region 7f428877a000 (8388608 bytes)
*** Preparing to test memory region 7f4288f7b000 (8388608 bytes)
*** Preparing to test memory region 7f428977b000 (11010048 bytes)
*** Preparing to test memory region 7f428a1fc000 (8388608 bytes)
*** Preparing to test memory region 7f428a9fd000 (8388608 bytes)
*** Preparing to test memory region 7f428b1fe000 (8388608 bytes)
*** Preparing to test memory region 7f428b9ff000 (8388608 bytes)
*** Preparing to test memory region 7f428c200000 (8388608 bytes)
*** Preparing to test memory region 7f428ca00000 (4194304 bytes)
*** Preparing to test memory region 7f428cf80000 (8388608 bytes)
*** Preparing to test memory region 7f428d780000 (11010048 bytes)
*** Preparing to test memory region 7f428e324000 (69632 bytes)
*** Preparing to test memory region 7f428e368000 (32768 bytes)
*** Preparing to test memory region 7f428e4e6000 (4096 bytes)
*** Preparing to test memory region 7f428e523000 (8192 bytes)
*** Preparing to test memory region 7f428e581000 (4096 bytes)
*** Preparing to test memory region 7f428e6ba000 (4096 bytes)
*** Preparing to test memory region 7f428e6c7000 (8192 bytes)
*** Preparing to test memory region 7f428e8a1000 (8192 bytes)
*** Preparing to test memory region 7f428e8bd000 (8192 bytes)
*** Preparing to test memory region 7f428e905000 (4096 bytes)
*** Preparing to test memory region 7f428e9e3000 (8192 bytes)
*** Preparing to test memory region 7f428ecae000 (8192 bytes)
*** Preparing to test memory region 7f428ee40000 (8192 bytes)
*** Preparing to test memory region 7f428eea7000 (8192 bytes)
*** Preparing to test memory region 7f428ef97000 (8192 bytes)
*** Preparing to test memory region 7f428f08a000 (8192 bytes)
*** Preparing to test memory region 7f428f357000 (16384 bytes)
*** Preparing to test memory region 7f428f37a000 (16384 bytes)
*** Preparing to test memory region 7f428f399000 (8192 bytes)
*** Preparing to test memory region 7f428f6c9000 (12288 bytes)
*** Preparing to test memory region 7f428f99e000 (16384 bytes)
*** Preparing to test memory region 7f428fa57000 (8192 bytes)
*** Preparing to test memory region 7f428fa8b000 (4096 bytes)
.O.O.O.O.O.O.O.O.1:39:S 20 Dec 2023 06:13:11.023 # Background AOF rewrite terminated by signal 11
1:39:S 20 Dec 2023 06:13:11.123 * Starting automatic rewriting of AOF on 5764% growth
1:39:S 20 Dec 2023 06:13:11.125 * Background append only file rewriting started by pid 109525

Aditional information

  1. eqalpha/keydb:x86_64_v6.3.4 Docker image
  2. Steps to reproduce (if any): At normal operation the AOF file grows and is not rewritten when the size is reached. Upgrade from 6.3.1 to 6.3.4, after the upgrade the error above appeared