python-zk / kazoo

Kazoo is a high-level Python library that makes it easier to use Apache Zookeeper.
https://kazoo.readthedocs.io
Apache License 2.0
1.3k stars 386 forks source link

Abort in `selector_select` #709

Closed alexey-milovidov closed 6 months ago

alexey-milovidov commented 1 year ago

Expected Behavior

No crash.

Actual Behavior

See https://github.com/ClickHouse/ClickHouse/issues/45367

Thread 0x00007fcc767fc700 (most recent call first):
  File "/usr/lib/python3.8/selectors.py", line 468 in select
  File "/usr/local/lib/python3.8/dist-packages/kazoo/handlers/utils.py", line 380 in selector_select
  File "/usr/local/lib/python3.8/dist-packages/kazoo/handlers/threading.py", line 172 in select
  File "/usr/local/lib/python3.8/dist-packages/kazoo/protocol/connection.py", line 592 in _connect_attempt
  File "/usr/local/lib/python3.8/dist-packages/kazoo/protocol/connection.py", line 552 in _connect_loop
  File "/usr/local/lib/python3.8/dist-packages/kazoo/retry.py", line 126 in __call__
  File "/usr/local/lib/python3.8/dist-packages/kazoo/protocol/connection.py", line 512 in zk_loop
  File "/usr/lib/python3.8/threading.py", line 870 in run
  File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
  File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap

Thread 0x00007fcc76ffd700 (most recent call first):
  File "/usr/lib/python3.8/threading.py", line 302 in wait
  File "/usr/lib/python3.8/queue.py", line 170 in get
  File "/usr/local/lib/python3.8/dist-packages/kazoo/handlers/threading.py", line 119 in _thread_worker
  File "/usr/lib/python3.8/threading.py", line 870 in run
  File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
  File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap

Snippet to Reproduce the Problem

I don't know how to reproduce this issue, but it reproduces sporadically in our CI. I don't expect it will be easy to figure out, but I'm creating an issue just in case anyone finds something similar. Feel free to close if the information is not enough.

Logs with logging in DEBUG mode

We did not collect them.

Specifications

a-ungurianu commented 1 year ago

Hey!

Thanks for bringing this to our attention. Could you point us to which file in the reports that are linked in https://github.com/ClickHouse/ClickHouse/issues/45367 which contain the log lines above , so we get some more context?