dragonflydb / dragonfly

A modern replacement for Redis and Memcached
https://www.dragonflydb.io/
Other
25.93k stars 951 forks source link

deadlock during shutdown in test_replicaof_flag_disconnect #3468

Open kostasrim opened 3 months ago

kostasrim commented 3 months ago

see https://github.com/dragonflydb/dragonfly/actions/runs/10296756650/job/28498658061#step:6:840

kostasrim commented 2 months ago

I will include in this issue all the related shutdown failures now that we have logs

kostasrim commented 2 months ago

1.test_replicaof_flag_disconnect

link https://github.com/dragonflydb/dragonfly/actions/runs/10843855154/job/30091703596

The issue: stack in BreakListeners -- we never break them -- the spawned fibers do not make progress in closing the sockets

kostasrim commented 2 months ago
  1. test_memory_counters

link https://github.com/dragonflydb/dragonfly/actions/runs/10867623047/job/30156600949

The issue: during shutdown of the connections one of the proactors is not making progress -- does not close all connections

kostasrim commented 2 months ago
  1. test_replica_reconnect

link https://github.com/dragonflydb/dragonfly/actions/runs/10889384627/job/30215916029