RedisLabs / redis-cluster-proxy

A proxy for Redis clusters.
GNU Affero General Public License v3.0
990 stars 129 forks source link

Crash 12 threads with 9 masters and 9 replicas #26

Closed aleshkin closed 4 years ago

aleshkin commented 4 years ago

=== PROXY BUG REPORT START: Cut & paste starting from here === [2020-02-03 08:37:36.040] Redis Cluster Prxoy 999.999.999 crashed by signal: 11 [2020-02-03 08:37:36.040] Crashed running the instruction at: 0x55ad33061676 [2020-02-03 08:37:36.040] Accessing address: 0x7fee8f2115f0 [2020-02-03 08:37:36.040] Handling crash on thread: 2

------ STACK TRACE ------ EIP: /usr/local/bin/redis-cluster-proxy(aeProcessEvents+0x156)[0x55ad33061676]

Backtrace: /usr/local/bin/redis-cluster-proxy(logStackTrace+0x44)[0x55ad33065af4] /usr/local/bin/redis-cluster-proxy(sigsegvHandler+0xed)[0x55ad3306619d] /lib/x86_64-linux-gnu/libpthread.so.0(+0x12890)[0x7fee8e868890] /usr/local/bin/redis-cluster-proxy(aeProcessEvents+0x156)[0x55ad33061676] /usr/local/bin/redis-cluster-proxy(aeMain+0x2b)[0x55ad33061a5b] /usr/local/bin/redis-cluster-proxy(+0x12b1d)[0x55ad33069b1d] /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db)[0x7fee8e85d6db] /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7fee8e58688f]

------ INFO OUTPUT ------

Proxy

proxy_version:999.999.999 proxy_git_sha1:f8dc227a proxy_git_dirty:0 os:Linux 4.15.0-34-generic x86_64 arch_bits:64 multiplexing_api:epoll gcc_version:7.4.0 process_id:15625 threads:12 tcp_port:6363 uptime_in_seconds:13 uptime_in_days:0 config_file: acl_user:default

Memory

used_memory:169477384 used_memory_human:161.63M total_system_memory:67469664256 total_system_memory_human:62.84G

Clients

connected_clients:4059

Cluster

address:94.130.70.112 entry_node:94.130.70.112:6379

------ REGISTERS ------

RAX:0000000000000000 RBX:0000000000000001 RCX:000055ad33079c30 RDX:000055ad33085f60 RDI:000055ad33085f4c RSI:0000000000000008 RBP:00007fee8f2115f0 RSP:00007fee8d461e70 R8 :000055ad3472c603 R9 :000000000000aeb0 R10:00007fee8d460d8c R11:0000000000000246 R12:000055ad33b916d0 R13:0000000000000000 R14:0000000000000001 R15:000000000000002f RIP:000055ad33061676 EFL:0000000000010246 CSGSFS:002b000000000033 (00007fee8d461e7f) -> 000055ad33069b1d (00007fee8d461e7e) -> 000055ad33a4beb0 (00007fee8d461e7d) -> 000055ad33061a5b (00007fee8d461e7c) -> 00007ffc995a9e40 (00007fee8d461e7b) -> 000055ad33a4beb0 (00007fee8d461e7a) -> 0000000000000000 (00007fee8d461e79) -> 00007fee8d461fc0 (00007fee8d461e78) -> 0000000000000000 (00007fee8d461e77) -> 000055ad33b916d0 (00007fee8d461e76) -> 0000000000000000 (00007fee8d461e75) -> a2087e4bebd11200 (00007fee8d461e74) -> 0000000000000000 (00007fee8d461e73) -> 000055ad33071a9e (00007fee8d461e72) -> 00007ffc995a9e40 (00007fee8d461e71) -> 000055ad0000000b (00007fee8d461e70) -> 000055ad33b916d0

------ FAST MEMORY TEST ------ Preparing to test memory region 55ad33290000 (4096 bytes) Preparing to test memory region 55ad337c3000 (22859776 bytes) Preparing to test memory region 7fee50000000 (12791808 bytes) Preparing to test memory region 7fee58000000 (12701696 bytes) Preparing to test memory region 7fee60000000 (12677120 bytes) Preparing to test memory region 7fee64000000 (12787712 bytes) Preparing to test memory region 7fee68000000 (12652544 bytes) Preparing to test memory region 7fee6c000000 (12603392 bytes) Preparing to test memory region 7fee70000000 (12726272 bytes) Preparing to test memory region 7fee74000000 (12722176 bytes) Preparing to test memory region 7fee78000000 (12648448 bytes) Preparing to test memory region 7fee7c000000 (12709888 bytes) Preparing to test memory region 7fee80000000 (12754944 bytes) Preparing to test memory region 7fee84000000 (12640256 bytes) Preparing to test memory region 7fee8845a000 (8388608 bytes) Preparing to test memory region 7fee88c5b000 (8388608 bytes) Preparing to test memory region 7fee8945c000 (8388608 bytes) Preparing to test memory region 7fee89c5d000 (8388608 bytes) Preparing to test memory region 7fee8a45e000 (8388608 bytes) Preparing to test memory region 7fee8ac5f000 (8388608 bytes) Preparing to test memory region 7fee8b460000 (8388608 bytes) Preparing to test memory region 7fee8bc61000 (8388608 bytes) Preparing to test memory region 7fee8c462000 (8388608 bytes) Preparing to test memory region 7fee8cc63000 (8388608 bytes) Preparing to test memory region 7fee8d464000 (8388608 bytes) Preparing to test memory region 7fee8dc65000 (8388608 bytes) Preparing to test memory region 7fee8e852000 (16384 bytes) Preparing to test memory region 7fee8ea71000 (16384 bytes) Preparing to test memory region 7fee8f1cc000 (143360 bytes) Preparing to test memory region 7fee8f1ef000 (139264 bytes) Preparing to test memory region 7fee8f233000 (16384 bytes) Preparing to test memory region 7fee8f240000 (4096 bytes) .O.Segmentation fault (core dumped)

artix75 commented 4 years ago

Hello @aleshkin, thank you for the report. Could you provide further details about the context of the bug? (ie. git branch, what where you doing, etc.)

artix75 commented 4 years ago

@aleshkin Fixed in commit d44e24f