saltstack / salt

Software to automate the management and configuration of any infrastructure or application at scale. Get access to the Salt software package repository here:
https://repo.saltproject.io/
Apache License 2.0
14.15k stars 5.48k forks source link

[BUG] salt waiting few more seconds after successfully receiving and displaying the obtained minion result #62599

Open onlineque opened 2 years ago

onlineque commented 2 years ago

Description salt waiting few more seconds after successfully receiving and displaying the obtained minion result

Setup I am having one master and one minion, both running in a container, salt-master together with salt-minion, it's a Docker container

master config:

{"master_id": "dna-backend-master", "pidfile": "/var/run/salt/salt-master.pid", "sock_dir": "/var/run/salt/master", "order_masters": true, "log_level": "debug", "fileserver_backend": ["roots"], "file_roots": {"base": ["/srv/salt"]}, "auto_accept": true}

minion config:

{"id": "dna-backend-master", "master": "dna-backend-master", "pidfile": "/var/run/salt/salt-minion.pid", "sock_dir": "/var/run/salt/minion", "log_level": "debug", "beacons": {"load": [{"averages": {"1m": [0, 0], "5m": [0, 0], "15m": [0, 0]}}, {"emitatstartup": true}, {"onchangeonly": false}, {"interval": 30}], "memusage": [{"percent": "0%"}, {"emitatstartup": true}, {"onchangeonly": false}, {"interval": 30}], "status": [{"cpustats": ["all"]}, {"interval": 30}]}, "schedule": {"job1": {"function": "saltutil.sync_all", "cron": "*/5 * * * *"}}}

Steps to Reproduce the behavior

[salt@dna-backend-master /]$ date;salt -l garbage 'dna-backend-master' test.ping; date
Wed Aug 31 21:19:45 UTC 2022
[TRACE   ] Setting up log file logging: {'log_path': '/var/log/salt/master', 'log_level': 'debug', 'log_format': '%(asctime)s,%(msecs)03d [%(name)-17s:%(lineno)-4d][%(levelname)-8s][%(process)d] %(message)s', 'date_format': '%Y-%m-%d %H:%M:%S', 'max_bytes': 0, 'backup_count': 0, 'user': 'salt'}
[TRACE   ] The required configuration section, 'fluent_handler', was not found the in the configuration. Not loading the fluent logging handlers module.
[TRACE   ] None of the required configuration sections, 'logstash_udp_handler' and 'logstash_zmq_handler', were found in the configuration. Not loading the Logstash logging handlers module.
[TRACE   ] Error loading log_handlers.sentry_mod: Cannot find 'raven' python library, 'sentry_handler' config is empty or not defined
[TRACE   ] Processing <bound method SaltfileMixIn.process_saltfile of <salt.cli.salt.SaltCMD object at 0x7f4c6e1436d8>>
[TRACE   ] Processing <bound method ConfigDirMixIn.process_config_dir of <salt.cli.salt.SaltCMD object at 0x7f4c6e1436d8>>
[DEBUG   ] Reading configuration from /etc/salt/master
[DEBUG   ] Including configuration from '/etc/salt/master.d/api.conf'
[DEBUG   ] Reading configuration from /etc/salt/master.d/api.conf
[DEBUG   ] Including configuration from '/etc/salt/master.d/beacons.conf'
[DEBUG   ] Reading configuration from /etc/salt/master.d/beacons.conf
[DEBUG   ] Including configuration from '/etc/salt/master.d/master.conf'
[DEBUG   ] Reading configuration from /etc/salt/master.d/master.conf
[DEBUG   ] Including configuration from '/etc/salt/master.d/user.conf'
[DEBUG   ] Reading configuration from /etc/salt/master.d/user.conf
[TRACE   ] 'ip' could not be found in the following search path: '['/home/salt/.local/bin', '/home/salt/bin', '/usr/local/sbin', '/usr/local/bin', '/usr/sbin', '/usr/bin', '/sbin', '/bin']'
[TRACE   ] 'ifconfig' could not be found in the following search path: '['/home/salt/.local/bin', '/home/salt/bin', '/usr/local/sbin', '/usr/local/bin', '/usr/sbin', '/usr/bin', '/sbin', '/bin']'
[DEBUG   ] Missing configuration file: /home/salt/.saltrc
[TRACE   ] Processing <bound method ExtendedTargetOptionsMixIn.process_pillar_target of <salt.cli.salt.SaltCMD object at 0x7f4c6e1436d8>>
[TRACE   ] Processing <bound method OutputOptionsMixIn.process_output of <salt.cli.salt.SaltCMD object at 0x7f4c6e1436d8>>
[TRACE   ] Processing <bound method OutputOptionsMixIn.process_output_file of <salt.cli.salt.SaltCMD object at 0x7f4c6e1436d8>>
[TRACE   ] Processing <bound method OutputOptionsMixIn.process_state_verbose of <salt.cli.salt.SaltCMD object at 0x7f4c6e1436d8>>
[TRACE   ] Processing <bound method NoParseMixin.process_no_parse of <salt.cli.salt.SaltCMD object at 0x7f4c6e1436d8>>
[TRACE   ] Processing functools.partial(<function TargetOptionsMixIn._create_process_functions.<locals>.process at 0x7f4c739d1f28>, <CustomOption at 0x7f4c66576f98: -H/--hosts>)
[TRACE   ] Processing functools.partial(<function TargetOptionsMixIn._create_process_functions.<locals>.process at 0x7f4c6bb62400>, <CustomOption at 0x7f4c66576ef0: -E/--pcre>)
[TRACE   ] Processing functools.partial(<function TargetOptionsMixIn._create_process_functions.<locals>.process at 0x7f4c6659f840>, <CustomOption at 0x7f4c66576f28: -L/--list>)
[TRACE   ] Processing functools.partial(<function TargetOptionsMixIn._create_process_functions.<locals>.process at 0x7f4c6659f8c8>, <CustomOption at 0x7f4c665a2048: -G/--grain>)
[TRACE   ] Processing functools.partial(<function TargetOptionsMixIn._create_process_functions.<locals>.process at 0x7f4c6659f950>, <CustomOption at 0x7f4c665a20b8: -P/--grain-pcre>)
[TRACE   ] Processing functools.partial(<function TargetOptionsMixIn._create_process_functions.<locals>.process at 0x7f4c6659f9d8>, <CustomOption at 0x7f4c665a2128: -N/--nodegroup>)
[TRACE   ] Processing functools.partial(<function TargetOptionsMixIn._create_process_functions.<locals>.process at 0x7f4c6659fa60>, <CustomOption at 0x7f4c665a2160: -R/--range>)
[TRACE   ] Processing functools.partial(<function TargetOptionsMixIn._create_process_functions.<locals>.process at 0x7f4c6659fb70>, <CustomOption at 0x7f4c665a2240: -C/--compound>)
[TRACE   ] Processing functools.partial(<function TargetOptionsMixIn._create_process_functions.<locals>.process at 0x7f4c6659fbf8>, <CustomOption at 0x7f4c665a2358: -J/--pillar-pcre>)
[TRACE   ] Processing functools.partial(<function TargetOptionsMixIn._create_process_functions.<locals>.process at 0x7f4c6659fae8>, <CustomOption at 0x7f4c665a2390: -S/--ipcidr>)
[TRACE   ] Processing functools.partial(<function OutputOptionsMixIn._mixin_setup.<locals>.process at 0x7f4c6659fd08>, <CustomOption at 0x7f4c665a27f0: --out-indent/--output-indent>)
[TRACE   ] Processing functools.partial(<function OutputOptionsMixIn._mixin_setup.<locals>.process at 0x7f4c6659fd90>, <CustomOption at 0x7f4c665a28d0: --out-file-append/--output-file-append>)
[TRACE   ] Processing functools.partial(<function OutputOptionsMixIn._mixin_setup.<locals>.process at 0x7f4c6659fc80>, <CustomOption at 0x7f4c665a2908: --no-color/--no-colour>)
[TRACE   ] Processing functools.partial(<function OutputOptionsMixIn._mixin_setup.<locals>.process at 0x7f4c6659fe18>, <CustomOption at 0x7f4c665a2940: --force-color/--force-colour>)
[TRACE   ] Processing functools.partial(<function OutputOptionsMixIn._mixin_setup.<locals>.process at 0x7f4c6659fea0>, <CustomOption at 0x7f4c665a2978: --state-output/--state_output>)
[TRACE   ] Processing <bound method LogLevelMixIn.process_log_level of <salt.cli.salt.SaltCMD object at 0x7f4c6e1436d8>>
[TRACE   ] Processing <bound method LogLevelMixIn.process_log_file of <salt.cli.salt.SaltCMD object at 0x7f4c6e1436d8>>
[TRACE   ] Processing <bound method LogLevelMixIn.process_log_level_logfile of <salt.cli.salt.SaltCMD object at 0x7f4c6e1436d8>>
[TRACE   ] Processing <function TargetOptionsMixIn._mixin_after_parsed at 0x7f4c66590f28>
[TRACE   ] Processing <function OutputOptionsMixIn._mixin_after_parsed at 0x7f4c66592620>
[TRACE   ] Processing <function SaltCMDOptionParser._mixin_after_parsed at 0x7f4c6659a0d0>
[TRACE   ] Processing <function LogLevelMixIn.__setup_logging_routines at 0x7f4c665900d0>
[TRACE   ] Processing <function MergeConfigMixIn.__merge_config_with_cli at 0x7f4c6658dae8>
[TRACE   ] Processing <function LogLevelMixIn.__setup_console_logger_config at 0x7f4c66590378>
[TRACE   ] Processing <function LogLevelMixIn.__setup_logfile_logger_config at 0x7f4c66590400>
[TRACE   ] Processing <function LogLevelMixIn.__setup_logging_config at 0x7f4c66590488>
[TRACE   ] Processing <function LogLevelMixIn.__verify_logging at 0x7f4c66590598>
[WARNING ] Insecure logging configuration detected! Sensitive data may be logged.
[TRACE   ] Processing <function LogLevelMixIn.__setup_logging at 0x7f4c66590510>
[TRACE   ] Setting up console logging: {'log_level': 'garbage', 'log_format': '[%(levelname)-8s] %(message)s', 'date_format': '%H:%M:%S'}
[TRACE   ] Setting up log file logging: {'log_path': '/var/log/salt/master', 'log_level': 'debug', 'log_format': '%(asctime)s,%(msecs)03d [%(name)-17s:%(lineno)-4d][%(levelname)-8s][%(process)d] %(message)s', 'date_format': '%Y-%m-%d %H:%M:%S', 'max_bytes': 0, 'backup_count': 0, 'user': 'salt'}
[TRACE   ] The required configuration section, 'fluent_handler', was not found the in the configuration. Not loading the fluent logging handlers module.
[TRACE   ] None of the required configuration sections, 'logstash_udp_handler' and 'logstash_zmq_handler', were found in the configuration. Not loading the Logstash logging handlers module.
[TRACE   ] Error loading log_handlers.sentry_mod: Cannot find 'raven' python library, 'sentry_handler' config is empty or not defined
[DEBUG   ] Configuration file path: /etc/salt/master
[DEBUG   ] Reading configuration from /etc/salt/master
[DEBUG   ] Including configuration from '/etc/salt/master.d/api.conf'
[DEBUG   ] Reading configuration from /etc/salt/master.d/api.conf
[DEBUG   ] Including configuration from '/etc/salt/master.d/beacons.conf'
[DEBUG   ] Reading configuration from /etc/salt/master.d/beacons.conf
[DEBUG   ] Including configuration from '/etc/salt/master.d/master.conf'
[DEBUG   ] Reading configuration from /etc/salt/master.d/master.conf
[DEBUG   ] Including configuration from '/etc/salt/master.d/user.conf'
[DEBUG   ] Reading configuration from /etc/salt/master.d/user.conf
[TRACE   ] 'ip' could not be found in the following search path: '['/home/salt/.local/bin', '/home/salt/bin', '/usr/local/sbin', '/usr/local/bin', '/usr/sbin', '/usr/bin', '/sbin', '/bin']'
[TRACE   ] 'ifconfig' could not be found in the following search path: '['/home/salt/.local/bin', '/home/salt/bin', '/usr/local/sbin', '/usr/local/bin', '/usr/sbin', '/usr/bin', '/sbin', '/bin']'
[DEBUG   ] Missing configuration file: /home/salt/.saltrc
[DEBUG   ] MasterEvent PUB socket URI: /var/run/salt/master/master_event_pub.ipc
[DEBUG   ] MasterEvent PULL socket URI: /var/run/salt/master/master_event_pull.ipc
[TRACE   ] IPCClient: Connecting to socket: /var/run/salt/master/master_event_pub.ipc
[TRACE   ] ReqChannel send clear load={'cmd': 'publish', 'tgt': 'dna-backend-master', 'fun': 'test.ping', 'arg': [], 'key': 'AuumVLyC7SAlAbLvoDXFtYHE+tUxI5V9K+qCcdIe9b9g1g5gXtvIlZf8lOjcdWS0+Cg9mS+w/Ws=', 'tgt_type': 'glob', 'ret': '', 'jid': '', 'kwargs': {'show_timeout': True, 'show_jid': False, 'delimiter': ':'}, 'user': 'salt', 'to': 5}
[DEBUG   ] Closing AsyncReqChannel instance
[TRACE   ] func get_cli_event_returns()
[DEBUG   ] The functions from module 'local_cache' are being loaded by dir() on the loaded module
[DEBUG   ] LazyLoaded local_cache.get_load
[DEBUG   ] Reading minion list from /var/cache/salt/master/jobs/df/8b308b148a66388ac47a03ab2aaa9222c498e816b7f33294f78cf7125bd17a/.minions.p
[DEBUG   ] get_iter_returns for jid 20220831211946246776 sent to {'dna-backend-master'} will timeout at 21:19:51.262229
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] get_event() received = {'data': {'jid': '20220831211946246776', 'tgt_type': 'glob', 'tgt': 'dna-backend-master', 'user': 'salt', 'fun': 'test.ping', 'arg': [], 'minions': ['dna-backend-master'], 'missing': [], '_stamp': '2022-08-31T21:19:46.248840'}, 'tag': 'salt/job/20220831211946246776/new'}
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] get_event() received = {'data': {'cmd': '_return', 'id': 'dna-backend-master', 'success': True, 'return': True, 'retcode': 0, 'jid': '20220831211946246776', 'fun': 'test.ping', 'fun_args': [], 'master_id': 'dna-backend-master', '_stamp': '2022-08-31T21:19:46.451689'}, 'tag': 'salt/job/20220831211946246776/ret/dna-backend-master'}
[DEBUG   ] jid 20220831211946246776 return from dna-backend-master
[DEBUG   ] return event: {'dna-backend-master': {'ret': True, 'retcode': 0, 'jid': '20220831211946246776'}}
[DEBUG   ] The functions from module 'nested' are being loaded by dir() on the loaded module
[DEBUG   ] LazyLoaded nested.output
[TRACE   ] data = {'dna-backend-master': True}
dna-backend-master:
    True
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[TRACE   ] Get event. tag: (salt/job|syndic/.*)/20220831211946246776
[TRACE   ] _get_event() waited 0 seconds and received nothing
[DEBUG   ] Closing IPCMessageSubscriber instance
Wed Aug 31 21:19:51 UTC 2022

Expected behavior I'd expect salt to finish right after receiving the result completely and not to wait few more seconds and exiting. Not sure if this is a configuration issue on my side or a bug. Please help. Thx !

Versions Report

salt --versions-report [salt@dna-backend-master master.d]$ salt --versions-report Salt Version: Salt: 3005 Dependency Versions: cffi: 1.11.5 cherrypy: unknown dateutil: 2.6.1 docker-py: Not Installed gitdb: Not Installed gitpython: Not Installed Jinja2: 2.10.1 libgit2: Not Installed M2Crypto: 0.35.2 Mako: Not Installed msgpack: 0.6.2 msgpack-pure: Not Installed mysql-python: Not Installed pycparser: 2.14 pycrypto: 3.15.0 pycryptodome: 3.15.0 pygit2: Not Installed Python: 3.6.8 (default, Apr 12 2022, 06:55:39) python-gnupg: Not Installed PyYAML: 3.12 PyZMQ: 20.0.0 smmap: Not Installed timelib: Not Installed Tornado: 4.5.3 ZMQ: 4.3.4 System Versions: dist: rocky 8.6 Green Obsidian locale: UTF-8 machine: x86_64 release: 4.18.0-348.12.2.el8_5.x86_64 system: Linux version: Rocky Linux 8.6 Green Obsidian
welcome[bot] commented 2 years ago

Hi there! Welcome to the Salt Community! Thank you for making your first contribution. We have a lengthy process for issues and PRs. Someone from the Core Team will follow up as soon as possible. In the meantime, here’s some information that may help as you continue your Salt journey. Please be sure to review our Code of Conduct. Also, check out some of our community resources including:

There are lots of ways to get involved in our community. Every month, there are around a dozen opportunities to meet with other contributors and the Salt Core team and collaborate in real time. The best way to keep track is by subscribing to the Salt Community Events Calendar. If you have additional questions, email us at saltproject@vmware.com. We’re glad you’ve joined our community and look forward to doing awesome things with you!

OrangeDog commented 2 years ago

Possibly related to #62550?

garethgreenaway commented 2 years ago

@onlineque Are you using the classic packages or the onedir packages? So far I haven't been able to reproduce this issue using the configurations you provided.

onlineque commented 2 years ago

Not sure what is a 'onedir' package, but I am using Salt using the official repositories: baseurl=https://repo.saltproject.io/py3/redhat/8/x86_64/latest

[salt@dna-backend-master /]$ rpm -qi salt-3005-1.el8
Name        : salt
Version     : 3005
Release     : 1.el8
Architecture: noarch
Install Date: Fri Sep  2 00:09:58 2022
Group       : System Environment/Daemons
Size        : 49688195
License     : ASL 2.0
Signature   : RSA/SHA256, Wed Aug 24 21:03:09 2022, Key ID 0e08a149de57bfbe
Source RPM  : salt-3005-1.el8.src.rpm
Build Date  : Wed Aug 24 20:19:50 2022
Build Host  : ip-10-200-9-238.us-west-2.compute.internal
Relocations : (not relocatable)
URL         : http://saltstack.org/
Summary     : A parallel remote execution system
Description :
Salt is a distributed remote execution system used to execute commands and
query data. It was developed in order to bring the best solutions found in
the world of remote execution together and make them better, faster and more
malleable. Salt accomplishes this via its ability to handle larger loads of
information, and not just dozens, but hundreds or even thousands of individual
servers, handle them quickly and through a simple and manageable interface.

if that may be of any help.

garethgreenaway commented 2 years ago

@onlineque Thanks. That looks like the package type that we're calling classic packages, the onedir packages include everything installed in one directory. I just noticed you indicated that you were running this inside a Docker container, which one are you using?

garethgreenaway commented 2 years ago

Quick update, I was able to reproduce this one running inside a Rocky 8.6 Docker container.

onlineque commented 2 years ago

Awesome ! Basically I've built the Docker image myself, highly inspired by the saltinit script to start Salt; and yes, it's based on Rocky 8.6 image, so it is exactly matching the environment you were able to reproduce it on.

garethgreenaway commented 2 years ago

@onlineque It looks like the cause of the issue is the order_masters: True option you have in your master configuration. Removing that and the command returns right away. This is a hint to where in the code things are broken.

onlineque commented 2 years ago

Thanks a lot, @garethgreenaway , I can confirm removing that from the config fixed the issue for me.