search

saltstack / salt

Software to automate the management and configuration of any infrastructure or application at scale. Get access to the Salt software package repository here:
https://repo.saltproject.io/
Apache License 2.0
14.1k stars 5.47k forks source link

Salt 3007.1 gets stuck #66868

Open SwimGeek opened 2 weeks ago

SwimGeek commented 2 weeks ago

Description Salt 3007.1 gets stuck after about a day - have to reboot the master to make it responsive again.

Setup Debian 12 VM as controller, kernel 6.1.99. Salt: 3007.1

Steps to Reproduce the behavior Run master for a few days, the issue some basic commands like: salt '*' pkg.list_upgrades

Expected behavior Expecting salt master to get and show responses in a few seconds, but it gets stuck.

Screenshots If applicable, add screenshots to help explain your problem.

Versions Report

salt --versions-report

Salt Version: Salt: 3007.1

Python Version: Python: 3.10.14 (main, Apr 3 2024, 21:30:09) [GCC 11.2.0]

Dependency Versions: cffi: 1.16.0 cherrypy: unknown dateutil: 2.8.2 docker-py: Not Installed gitdb: Not Installed gitpython: Not Installed Jinja2: 3.1.4 libgit2: Not Installed looseversion: 1.3.0 M2Crypto: Not Installed Mako: Not Installed msgpack: 1.0.7 msgpack-pure: Not Installed mysql-python: Not Installed packaging: 23.1 pycparser: 2.21 pycrypto: Not Installed pycryptodome: 3.19.1 pygit2: Not Installed python-gnupg: 0.5.2 PyYAML: 6.0.1 PyZMQ: 25.1.2 relenv: 0.16.0 smmap: Not Installed timelib: 0.3.0 Tornado: 6.3.3 ZMQ: 4.3.4

Salt Package Information: Package Type: onedir

System Versions: dist: debian 12.6 bookworm locale: utf-8 machine: x86_64 release: 6.1.0-23-amd64 system: Linux version: Debian GNU/Linux 12.6 bookworm

Additional context Here are some errors / warnings I get:

salt '*' test.ping

^C Exiting gracefully on Ctrl-c This event loop is already running

salt '*' test.ping

Minion did not return. [No response]

uname -a

Linux cpt-ter-srv2 6.1.0-23-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.99-1 (2024-07-15) x86_64 GNU/Linux

uptime

18:08:45 up 1 day, 6:26, 1 user, load average: 0.00, 0.01, 0.00

whytewolf commented 2 weeks ago

do you have any scanning happening from a vulnerability scanner? check https://github.com/saltstack/salt/issues/66519 to see if it results are similar.