Ansible is a radically simple IT automation platform that makes your applications and systems easier to deploy and maintain. Automate everything from code deployment to network configuration to cloud management, in a language that approaches plain English, using SSH, with no agents to install on remote systems. https://docs.ansible.com.
To verify that a reboot actually took place, the ansible.builtin.reboot module compares an initial output of boot_time_command (execution # 1) with successive ones (execution # 2, # 3, # 4, ...) and considers the host as rebooted the first time they differ to continue with post-reboot checks.
It however fails to correctly handle certain cases where setup for the execution of boot_time_command fails before even executing that command and interprets the output of that failure as the actual output of boot_time_command which consequently differ from a correct execution and mark the host as rebooted.
Failure of setting up for the execution of boot_time_command is to be considered a normal case while the host is rebooting as various parts of the system no longer work as normal (filesystems get umounted, ...).
A work around is to set post_reboot_delay with a "high-enough" value, but a safe threshold to be found varies with the speed at which a system properly shut downs.
For an end user, the result is similar to #78007: the module may completes and mark the host as successfully rebooted while it is in fact still rebooting, neither verifying if the reboots was indeed successful and possibly failing in the middle of following tasks.
The work around of #78007 does not work since boot_time_commmand is not even executed in our case. The associated PR was also rejected and doesn't look like it would solve this instance of the problem.
The issue can be reproduced about 50% of the time on a freshly installed debian12 systems running in a virtual machine on vmware and executing the reboot module as an adhoc command with the latest currently released version of ansible (2.16.5).
While reproducing the issue may be difficult due to it possibly be a race condition, I encourage to understand the kind of error that get's generated in the attached exeuction and verify that this particular category of error is not treated as such by the current source code and rather as the normal execution of boot_time_command.
line 226 contains cb8d4303-f662-496a-b5de-df2a4ac85da7\r\n which is the first execution of cat /proc/sys/kernel/random/boot_id which is the default value of boot_time_command
line 294 is execution of the shutdown command
lines 308 and 320 are successful execution of boot_time_command # 2 and # 3
line 332 contains Could not chdir to home directory /home/automation: No such file or directory\r\ncb8d4303-f662-496a-b5de-df2a4ac85da7\r\n which is a mixup of the error generated by setting up the execution of boot_time_command's # 4 and its own output. Due to the race conditions getting involved, we have seen multiple kind of errors messages. In this particular instance, we may speculate that /home had been unmounted and as such /home/automation no longer existed. We have been able to reproduce similar errors even if changing remote_tmp in ansible.cfg.
line 333 acknowledges that the module considers the host as already rebooted
Note:
This is our partition table for full disclosure
mount | grep vg
/dev/mapper/vgroot-lvroot on / type ext4 (rw,relatime,seclabel,errors=remount-ro)
/dev/mapper/vgroot-lvhome on /home type ext4 (rw,nodev,relatime,seclabel)
/dev/mapper/vgroot-lvopt on /opt type ext4 (rw,nodev,relatime,seclabel)
/dev/mapper/vgroot-lvvar on /var type ext4 (rw,relatime,seclabel)
/dev/mapper/vgroot-lvtmp on /tmp type ext4 (rw,nosuid,nodev,relatime,seclabel)
/dev/mapper/vgroot-lvvarlog on /var/log type ext4 (rw,nosuid,nodev,noexec,relatime,seclabel)
/dev/mapper/vgroot-lvvartmp on /var/tmp type ext4 (rw,nosuid,nodev,noexec,relatime,seclabel)
/dev/mapper/vgroot-lvvarlogaudit on /var/log/audit type ext4 (rw,nosuid,nodev,noexec,relatime,seclabel)
Actual Results
ansible [core 2.16.5]
config file = /home/shk3bq4d/git/myotherproject/myproject/ans/ansible.cfg
configured module search path = ['/home/shk3bq4d/git/myotherproject/myproject/ans/modules-external/ansible-graylog-modules/plugins/modules']
ansible python module location = /home/shk3bq4d/.virtualenvs/ansible-latest/lib/python3.10/site-packages/ansible
ansible collection location = /home/shk3bq4d/git/myotherproject/myproject/ans
executable location = /home/shk3bq4d/.virtualenvs/ansible-latest/bin/ansible
python version = 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] (/home/shk3bq4d/.virtualenvs/ansible-latest/bin/python3)
jinja version = 3.1.3
libyaml = True
Using /home/shk3bq4d/git/myotherproject/myproject/ans/ansible.cfg as config file
setting up inventory plugins
Loading collection ansible.builtin from
host_list declined parsing /home/shk3bq4d/git/myotherproject/myproject/ans/inventory.yml as it did not pass its verify_file() method
script declined parsing /home/shk3bq4d/git/myotherproject/myproject/ans/inventory.yml as it did not pass its verify_file() method
Parsed /home/shk3bq4d/git/myotherproject/myproject/ans/inventory.yml inventory source with yaml plugin
redirecting (type: callback) ansible.builtin.yaml to community.general.yaml
Loading collection community.general from /home/shk3bq4d/git/myotherproject/myproject/ans/ansible_collections/community/general
redirecting (type: callback) ansible.builtin.yaml to community.general.yaml
Loading callback plugin community.general.yaml of type stdout, v2.0 from /home/shk3bq4d/git/myotherproject/myproject/ans/ansible_collections/community/general/plugins/callback/yaml.py
Attempting to use 'default' callback.
Skipping callback 'default', as we already have a stdout callback.
Attempting to use 'junit' callback.
Attempting to use 'minimal' callback.
Skipping callback 'minimal', as we already have a stdout callback.
Attempting to use 'oneline' callback.
Skipping callback 'oneline', as we already have a stdout callback.
Attempting to use 'tree' callback.
PLAYBOOK: __adhoc_playbook__ ***************************************************
Positional arguments: d e b i a n 1 2 - i m a g e . m y d o m a i n
verbosity: 10
become: True
become_method: sudo
inventory: ('/home/shk3bq4d/git/myotherproject/myproject/ans/inventory.yml',)
poll_interval: 15
connection: ssh
forks: 18
module_name: reboot
PLAY [Ansible Ad-Hoc] **********************************************************
TASK [reboot] ******************************************************************
Merge variables with suffix: _ansible_ssh_extra_args__to_merge
The following variables will be merged: ['all_ansible_ssh_extra_args__to_merge']
Loading collection ansible.utils from /home/shk3bq4d/.virtualenvs/ansible-latest/lib/python3.10/site-packages/ansible_collections/ansible/utils
Merge variables with suffix: _ansible_ssh_extra_args__to_merge
The following variables will be merged: ['all_ansible_ssh_extra_args__to_merge']
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no 10.2.1.6 '/bin/sh -c '"'"'echo ~automation && sleep 0'"'"''
<10.2.1.6> (0, b'/home/automation\n', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no 10.2.1.6 '/bin/sh -c '"'"'( umask 77 && mkdir -p "` echo /home/automation/.ansible/tmp `"&& mkdir "` echo /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354 `" && echo ansible-tmp-1712823989.226468-599523-140907275976354="` echo /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354 `" ) && sleep 0'"'"''
<10.2.1.6> (0, b'ansible-tmp-1712823989.226468-599523-140907275976354=/home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354\n', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
Including module_utils file ansible/__init__.py
Including module_utils file ansible/module_utils/__init__.py
Including module_utils file ansible/module_utils/basic.py
Including module_utils file ansible/module_utils/_text.py
Including module_utils file ansible/module_utils/common/_json_compat.py
Including module_utils file ansible/module_utils/common/__init__.py
Including module_utils file ansible/module_utils/common/_utils.py
Including module_utils file ansible/module_utils/common/arg_spec.py
Including module_utils file ansible/module_utils/common/file.py
Including module_utils file ansible/module_utils/common/locale.py
Including module_utils file ansible/module_utils/common/parameters.py
Including module_utils file ansible/module_utils/common/collections.py
Including module_utils file ansible/module_utils/common/process.py
Including module_utils file ansible/module_utils/common/sys_info.py
Including module_utils file ansible/module_utils/common/text/converters.py
Including module_utils file ansible/module_utils/common/text/__init__.py
Including module_utils file ansible/module_utils/common/text/formatters.py
Including module_utils file ansible/module_utils/common/validation.py
Including module_utils file ansible/module_utils/common/warnings.py
Including module_utils file ansible/module_utils/compat/selectors.py
Including module_utils file ansible/module_utils/compat/__init__.py
Including module_utils file ansible/module_utils/compat/_selectors2.py
Including module_utils file ansible/module_utils/compat/selinux.py
Including module_utils file ansible/module_utils/distro/__init__.py
Including module_utils file ansible/module_utils/distro/_distro.py
Including module_utils file ansible/module_utils/errors.py
Including module_utils file ansible/module_utils/facts/ansible_collector.py
Including module_utils file ansible/module_utils/compat/typing.py
Including module_utils file ansible/module_utils/facts/__init__.py
Including module_utils file ansible/module_utils/facts/collector.py
Including module_utils file ansible/module_utils/facts/compat.py
Including module_utils file ansible/module_utils/facts/default_collectors.py
Including module_utils file ansible/module_utils/facts/hardware/aix.py
Including module_utils file ansible/module_utils/facts/hardware/__init__.py
Including module_utils file ansible/module_utils/facts/hardware/base.py
Including module_utils file ansible/module_utils/facts/hardware/darwin.py
Including module_utils file ansible/module_utils/facts/hardware/dragonfly.py
Including module_utils file ansible/module_utils/facts/hardware/freebsd.py
Including module_utils file ansible/module_utils/facts/hardware/hpux.py
Including module_utils file ansible/module_utils/facts/hardware/hurd.py
Including module_utils file ansible/module_utils/facts/hardware/linux.py
Including module_utils file ansible/module_utils/facts/hardware/netbsd.py
Including module_utils file ansible/module_utils/facts/hardware/openbsd.py
Including module_utils file ansible/module_utils/facts/hardware/sunos.py
Including module_utils file ansible/module_utils/facts/namespace.py
Including module_utils file ansible/module_utils/facts/network/aix.py
Including module_utils file ansible/module_utils/facts/network/__init__.py
Including module_utils file ansible/module_utils/facts/network/base.py
Including module_utils file ansible/module_utils/facts/network/darwin.py
Including module_utils file ansible/module_utils/facts/network/dragonfly.py
Including module_utils file ansible/module_utils/facts/network/fc_wwn.py
Including module_utils file ansible/module_utils/facts/network/freebsd.py
Including module_utils file ansible/module_utils/facts/network/generic_bsd.py
Including module_utils file ansible/module_utils/facts/network/hpux.py
Including module_utils file ansible/module_utils/facts/network/hurd.py
Including module_utils file ansible/module_utils/facts/network/iscsi.py
Including module_utils file ansible/module_utils/facts/network/linux.py
Including module_utils file ansible/module_utils/facts/network/netbsd.py
Including module_utils file ansible/module_utils/facts/network/nvme.py
Including module_utils file ansible/module_utils/facts/network/openbsd.py
Including module_utils file ansible/module_utils/facts/network/sunos.py
Including module_utils file ansible/module_utils/facts/other/facter.py
Including module_utils file ansible/module_utils/facts/other/__init__.py
Including module_utils file ansible/module_utils/facts/other/ohai.py
Including module_utils file ansible/module_utils/facts/sysctl.py
Including module_utils file ansible/module_utils/facts/system/apparmor.py
Including module_utils file ansible/module_utils/facts/system/__init__.py
Including module_utils file ansible/module_utils/facts/system/caps.py
Including module_utils file ansible/module_utils/facts/system/chroot.py
Including module_utils file ansible/module_utils/facts/system/cmdline.py
Including module_utils file ansible/module_utils/facts/system/date_time.py
Including module_utils file ansible/module_utils/compat/datetime.py
Including module_utils file ansible/module_utils/facts/system/distribution.py
Including module_utils file ansible/module_utils/facts/system/dns.py
Including module_utils file ansible/module_utils/facts/system/env.py
Including module_utils file ansible/module_utils/facts/system/fips.py
Including module_utils file ansible/module_utils/facts/system/loadavg.py
Including module_utils file ansible/module_utils/facts/system/local.py
Including module_utils file ansible/module_utils/facts/system/lsb.py
Including module_utils file ansible/module_utils/facts/system/pkg_mgr.py
Including module_utils file ansible/module_utils/facts/system/platform.py
Including module_utils file ansible/module_utils/facts/system/python.py
Including module_utils file ansible/module_utils/facts/system/selinux.py
Including module_utils file ansible/module_utils/facts/system/service_mgr.py
Including module_utils file ansible/module_utils/compat/version.py
Including module_utils file ansible/module_utils/facts/system/ssh_pub_keys.py
Including module_utils file ansible/module_utils/facts/system/user.py
Including module_utils file ansible/module_utils/facts/timeout.py
Including module_utils file ansible/module_utils/facts/utils.py
Including module_utils file ansible/module_utils/facts/virtual/base.py
Including module_utils file ansible/module_utils/facts/virtual/__init__.py
Including module_utils file ansible/module_utils/facts/virtual/dragonfly.py
Including module_utils file ansible/module_utils/facts/virtual/freebsd.py
Including module_utils file ansible/module_utils/facts/virtual/hpux.py
Including module_utils file ansible/module_utils/facts/virtual/linux.py
Including module_utils file ansible/module_utils/facts/virtual/netbsd.py
Including module_utils file ansible/module_utils/facts/virtual/openbsd.py
Including module_utils file ansible/module_utils/facts/virtual/sunos.py
Including module_utils file ansible/module_utils/facts/virtual/sysctl.py
Including module_utils file ansible/module_utils/parsing/convert_bool.py
Including module_utils file ansible/module_utils/parsing/__init__.py
Including module_utils file ansible/module_utils/pycompat24.py
Including module_utils file ansible/module_utils/six/__init__.py
<debian12-image.mydomain> Attempting python interpreter discovery
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no 10.2.1.6 '/bin/sh -c '"'"'echo PLATFORM; uname; echo FOUND; command -v '"'"'"'"'"'"'"'"'python3.12'"'"'"'"'"'"'"'"'; command -v '"'"'"'"'"'"'"'"'python3.11'"'"'"'"'"'"'"'"'; command -v '"'"'"'"'"'"'"'"'python3.10'"'"'"'"'"'"'"'"'; command -v '"'"'"'"'"'"'"'"'python3.9'"'"'"'"'"'"'"'"'; command -v '"'"'"'"'"'"'"'"'python3.8'"'"'"'"'"'"'"'"'; command -v '"'"'"'"'"'"'"'"'python3.7'"'"'"'"'"'"'"'"'; command -v '"'"'"'"'"'"'"'"'python3.6'"'"'"'"'"'"'"'"'; command -v '"'"'"'"'"'"'"'"'/usr/bin/python3'"'"'"'"'"'"'"'"'; command -v '"'"'"'"'"'"'"'"'/usr/libexec/platform-python'"'"'"'"'"'"'"'"'; command -v '"'"'"'"'"'"'"'"'python2.7'"'"'"'"'"'"'"'"'; command -v '"'"'"'"'"'"'"'"'/usr/bin/python'"'"'"'"'"'"'"'"'; command -v '"'"'"'"'"'"'"'"'python'"'"'"'"'"'"'"'"'; echo ENDFOUND && sleep 0'"'"''
<10.2.1.6> (0, b'PLATFORM\nLinux\nFOUND\n/usr/bin/python3.11\n/usr/bin/python3\nENDFOUND\n', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no 10.2.1.6 '/bin/sh -c '"'"'/usr/bin/python3.11 && sleep 0'"'"''
<10.2.1.6> (0, b'{"platform_dist_result": [], "osrelease_content": "PRETTY_NAME=\\"Debian GNU/Linux 12 (bookworm)\\"\\nNAME=\\"Debian GNU/Linux\\"\\nVERSION_ID=\\"12\\"\\nVERSION=\\"12 (bookworm)\\"\\nVERSION_CODENAME=bookworm\\nID=debian\\nHOME_URL=\\"https://www.debian.org/\\"\\nSUPPORT_URL=\\"https://www.debian.org/support\\"\\nBUG_REPORT_URL=\\"https://bugs.debian.org/\\"\\n"}\n', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
Using module file /home/shk3bq4d/.virtualenvs/ansible-latest/lib/python3.10/site-packages/ansible/modules/setup.py
<10.2.1.6> PUT /home/shk3bq4d/.ansible/tmp/ansible-local-599520jlnnj9o1/tmpmhmex9e7 TO /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354/AnsiballZ_setup.py
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set sftp_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC sftp -b - -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no '[10.2.1.6]'
<10.2.1.6> (0, b'sftp> put /home/shk3bq4d/.ansible/tmp/ansible-local-599520jlnnj9o1/tmpmhmex9e7 /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354/AnsiballZ_setup.py\n', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no 10.2.1.6 '/bin/sh -c '"'"'chmod u+x /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354/ /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354/AnsiballZ_setup.py && sleep 0'"'"''
<10.2.1.6> (0, b'', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no -tt 10.2.1.6 '/bin/sh -c '"'"'sudo -H -S -n -u root /bin/sh -c '"'"'"'"'"'"'"'"'echo BECOME-SUCCESS-oibnruilkwddbhmroibfijqoyvlhflbf ; /usr/bin/python3 /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354/AnsiballZ_setup.py'"'"'"'"'"'"'"'"' && sleep 0'"'"''
Escalation succeeded
<10.2.1.6> (0, b'\r\n{"ansible_facts": {"ansible_distribution": "Debian", "ansible_distribution_release": "bookworm", "ansible_distribution_version": "12.5", "ansible_distribution_major_version": "12", "ansible_distribution_file_path": "/etc/os-release", "ansible_distribution_file_variety": "Debian", "ansible_distribution_file_parsed": true, "ansible_distribution_minor_version": "5", "ansible_os_family": "Debian", "ansible_local": {}, "ansible_selinux_python_present": true, "ansible_selinux": {"status": "enabled", "policyvers": 33, "config_mode": "permissive", "mode": "permissive", "type": "default"}, "ansible_date_time": {"year": "2024", "month": "04", "weekday": "Thursday", "weekday_number": "4", "weeknumber": "15", "day": "11", "hour": "08", "minute": "26", "second": "31", "epoch": "1712823991", "epoch_int": "1712823991", "date": "2024-04-11", "time": "08:26:31", "iso8601_micro": "2024-04-11T08:26:31.225339Z", "iso8601": "2024-04-11T08:26:31Z", "iso8601_basic": "20240411T082631225339", "iso8601_basic_short": "20240411T082631", "tz": "UTC", "tz_dst": "UTC", "tz_offset": "+0000"}, "ansible_system_capabilities_enforced": "False", "ansible_system_capabilities": [], "ansible_fips": false, "ansible_dns": {"nameservers": ["10.8.2.1", "10.9.2.1"]}, "ansible_user_id": "root", "ansible_user_uid": 0, "ansible_user_gid": 0, "ansible_user_gecos": "root", "ansible_user_dir": "/root", "ansible_user_shell": "/bin/bash", "ansible_real_user_id": 0, "ansible_effective_user_id": 0, "ansible_real_group_id": 0, "ansible_effective_group_id": 0, "ansible_apparmor": {"status": "disabled"}, "ansible_system": "Linux", "ansible_kernel": "6.1.0-18-amd64", "ansible_kernel_version": "#1 SMP PREEMPT_DYNAMIC Debian 6.1.76-1 (2024-02-01)", "ansible_machine": "x86_64", "ansible_python_version": "3.11.2", "ansible_fqdn": "localhost", "ansible_hostname": "localhost", "ansible_nodename": "localhost", "ansible_domain": "", "ansible_userspace_bits": "64", "ansible_architecture": "x86_64", "ansible_userspace_architecture": "x86_64", "ansible_machine_id": "d8260323ccb24ffdbe9620c18a1b4b33", "ansible_ssh_host_key_dsa_public": "AAAAB3NzaC1kc3MAAACBALjEcfIRhH0DPlVnbiw8pwC0Hrp0zINEOS+3apnuIwUabpMY4N9SkPGL4EjiaDy+mAeLj598BK7LvAzoZudDVQ7LYI3YooChC9TNtewt6DMI7cjWzb7XqJRmKGnfgEE7U9HLqlimhTBfsOk7jnkG3AfYK009EtlUxgovbxSJN21HAAAAFQCz/4hQ7pYkkRMZ4w2hQiwGOkfTUwAAAIAK0tT5FPDCZl1Ey1GAQAby6XUjLhjabMwn3D+usx5z0JtyRVs5EBo7v+tw7G4jnf6F+CZ4jLSCSZ4QKVeRiUgm9ZQhugZEkpHxnqByGHw5JQd3/+C3uecIKD+4Prtv8gtA26iTuGV6kn/F5OE2qsEsCKjxGShS7+c+Lb05bPSK3gAAAIEAnayEtfH6zokr1D54LoGT94EoX3KSfDGFyh3H13Dj3MchsmxT6svUN9bF17u/DUdvvFx33o3F7RWvg9iBSetZ0XHKyF9daPOCT/5gbi9rdwz4vkF442jvphwTXwxfivf+xFomRyxy3nVVbpwqhwLjB9+N82Q8WQXWcVky3S1AAzA=", "ansible_ssh_host_key_dsa_public_keytype": "ssh-dss", "ansible_ssh_host_key_rsa_public": "AAAAB3NzaC1yc2EAAAADAQABAAABgQCo5OcAgqytuJ+WwIvq380F2c/5YREcRjnkYtFahbGGLrEc8EKlLmRuHHOihqa20hvq/qDPbR/bvocL3HvXQZRiTQj8IgRXFdVL9ZkdPBFcJ2ZZllR7vORCt0SQU5uWzQ6LCVIju7jOWMr+B9dFAyXhNR/unRO2FVOhe9ZxMh0YrLVc1Ni3D8sMXj1oyOY7Hwte6Iu0NtI9/oUGebCMUTanjZq2AqIikMUuOD0EecENZfAnnPtr6CZu0p744DMoVVlkaHRj5GzQ5ij996vFUlZFj4uwlKoSNDD8eWtZqN3unN+Kpwrke7SfXSGI0lreYNwHGUFuKYdyXcA6l+v9epPM8iPg8CUryWjNHBIWZpBQMt/Ez6diCMNeNVRIl+tn9wzaAMtOr7oV/5pfsY+LPrbpbxB4wtc6cJj2o/ol+pUK48lU2vN3WHweY7OADm5umWaj+SkWbs1j2ZSdski3G9sK633KWUT63BN0h0tR61jfpGkg7UKf/JZuDAZr5o1lwI0=", "ansible_ssh_host_key_rsa_public_keytype": "ssh-rsa", "ansible_ssh_host_key_ecdsa_public": "AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIxaFd/duQxIZBLQc5g7VYQs773nJpVzSqOWZseKLM5R8YLpgX5x2ineXqso3BPTSJQgqCddyoy/8iZbqv3lBGU=", "ansible_ssh_host_key_ecdsa_public_keytype": "ecdsa-sha2-nistp256", "ansible_ssh_host_key_ed25519_public": "AAAAC3NzaC1lZDI1NTE5AAAAIDi+ADi+fxA+V7Uu+od6CDETdahnJNOSHsScW6ush8om", "ansible_ssh_host_key_ed25519_public_keytype": "ssh-ed25519", "ansible_python": {"version": {"major": 3, "minor": 11, "micro": 2, "releaselevel": "final", "serial": 0}, "version_info": [3, 11, 2, "final", 0], "executable": "/usr/bin/python3", "has_sslcontext": true, "type": "cpython"}, "ansible_lsb": {"id": "Debian", "description": "Debian GNU/Linux 12 (bookworm)", "release": "12", "codename": "bookworm", "major_release": "12"}, "ansible_pkg_mgr": "apt", "ansible_service_mgr": "systemd", "ansible_cmdline": {"BOOT_IMAGE": "/vmlinuz-6.1.0-18-amd64", "root": "/dev/mapper/vgroot-lvroot", "ro": true, "security": "selinux", "ipv6.disable": "1", "quiet": true}, "ansible_proc_cmdline": {"BOOT_IMAGE": "/vmlinuz-6.1.0-18-amd64", "root": "/dev/mapper/vgroot-lvroot", "ro": true, "security": "selinux", "ipv6.disable": "1", "quiet": true}, "ansible_env": {"SUDO_GID": "7053", "MAIL": "/var/mail/root", "USER": "root", "HOME": "/root", "SUDO_UID": "7053", "LOGNAME": "root", "TERM": "xterm-256color", "PATH": "/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin", "LANG": "en_US.UTF-8", "SUDO_COMMAND": "/bin/sh -c echo BECOME-SUCCESS-oibnruilkwddbhmroibfijqoyvlhflbf ; /usr/bin/python3 /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354/AnsiballZ_setup.py", "SHELL": "/bin/bash", "SUDO_USER": "automation", "PWD": "/home/automation"}, "gather_subset": ["min"], "module_setup": true}, "invocation": {"module_args": {"gather_subset": ["min"], "gather_timeout": 10, "filter": [], "fact_path": "/etc/ansible/facts.d"}}}\r\n', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no -tt 10.2.1.6 '/bin/sh -c '"'"'sudo -H -S -n -u root /bin/sh -c '"'"'"'"'"'"'"'"'echo BECOME-SUCCESS-gadpdtstjjsfgyqxiksoemmmkwtvihaa ; cat /proc/sys/kernel/random/boot_id'"'"'"'"'"'"'"'"' && sleep 0'"'"''
Escalation succeeded
<10.2.1.6> (0, b'cb8d4303-f662-496a-b5de-df2a4ac85da7\r\n', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
Including module_utils file ansible/__init__.py
Including module_utils file ansible/module_utils/__init__.py
Including module_utils file ansible/module_utils/basic.py
Including module_utils file ansible/module_utils/_text.py
Including module_utils file ansible/module_utils/common/_json_compat.py
Including module_utils file ansible/module_utils/common/__init__.py
Including module_utils file ansible/module_utils/common/_utils.py
Including module_utils file ansible/module_utils/common/arg_spec.py
Including module_utils file ansible/module_utils/common/file.py
Including module_utils file ansible/module_utils/common/locale.py
Including module_utils file ansible/module_utils/common/parameters.py
Including module_utils file ansible/module_utils/common/collections.py
Including module_utils file ansible/module_utils/common/process.py
Including module_utils file ansible/module_utils/common/sys_info.py
Including module_utils file ansible/module_utils/common/text/converters.py
Including module_utils file ansible/module_utils/common/text/__init__.py
Including module_utils file ansible/module_utils/common/text/formatters.py
Including module_utils file ansible/module_utils/common/validation.py
Including module_utils file ansible/module_utils/common/warnings.py
Including module_utils file ansible/module_utils/compat/selectors.py
Including module_utils file ansible/module_utils/compat/__init__.py
Including module_utils file ansible/module_utils/compat/_selectors2.py
Including module_utils file ansible/module_utils/compat/selinux.py
Including module_utils file ansible/module_utils/distro/__init__.py
Including module_utils file ansible/module_utils/distro/_distro.py
Including module_utils file ansible/module_utils/errors.py
Including module_utils file ansible/module_utils/parsing/convert_bool.py
Including module_utils file ansible/module_utils/parsing/__init__.py
Including module_utils file ansible/module_utils/pycompat24.py
Including module_utils file ansible/module_utils/six/__init__.py
Using module file /home/shk3bq4d/.virtualenvs/ansible-latest/lib/python3.10/site-packages/ansible/modules/find.py
<10.2.1.6> PUT /home/shk3bq4d/.ansible/tmp/ansible-local-599520jlnnj9o1/tmp46b3pnd9 TO /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354/AnsiballZ_find.py
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set sftp_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC sftp -b - -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no '[10.2.1.6]'
<10.2.1.6> (0, b'sftp> put /home/shk3bq4d/.ansible/tmp/ansible-local-599520jlnnj9o1/tmp46b3pnd9 /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354/AnsiballZ_find.py\n', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no 10.2.1.6 '/bin/sh -c '"'"'chmod u+x /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354/ /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354/AnsiballZ_find.py && sleep 0'"'"''
<10.2.1.6> (0, b'', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no -tt 10.2.1.6 '/bin/sh -c '"'"'sudo -H -S -n -u root /bin/sh -c '"'"'"'"'"'"'"'"'echo BECOME-SUCCESS-qhplcifveevqagonjtmuodsyavaihwac ; /usr/bin/python3 /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354/AnsiballZ_find.py'"'"'"'"'"'"'"'"' && sleep 0'"'"''
Escalation succeeded
<10.2.1.6> (0, b'\r\n{"files": [{"path": "/sbin/shutdown", "mode": "0777", "isdir": false, "ischr": false, "isblk": false, "isreg": false, "isfifo": false, "islnk": true, "issock": false, "uid": 0, "gid": 0, "size": 14, "inode": 395601, "dev": 65024, "nlink": 1, "atime": 1712773804.2942214, "mtime": 1706305716.0, "ctime": 1712772945.7159996, "gr_name": "root", "pw_name": "root", "wusr": true, "rusr": true, "xusr": true, "wgrp": true, "rgrp": true, "xgrp": true, "woth": true, "roth": true, "xoth": true, "isuid": false, "isgid": false}, {"path": "/usr/sbin/shutdown", "mode": "0777", "isdir": false, "ischr": false, "isblk": false, "isreg": false, "isfifo": false, "islnk": true, "issock": false, "uid": 0, "gid": 0, "size": 14, "inode": 395601, "dev": 65024, "nlink": 1, "atime": 1712773804.2942214, "mtime": 1706305716.0, "ctime": 1712772945.7159996, "gr_name": "root", "pw_name": "root", "wusr": true, "rusr": true, "xusr": true, "wgrp": true, "rgrp": true, "xgrp": true, "woth": true, "roth": true, "xoth": true, "isuid": false, "isgid": false}], "changed": false, "msg": "All paths examined", "matched": 2, "examined": 2058, "skipped_paths": {}, "invocation": {"module_args": {"paths": ["/sbin", "/bin", "/usr/sbin", "/usr/bin", "/usr/local/sbin"], "patterns": ["shutdown"], "file_type": "any", "read_whole_file": false, "age_stamp": "mtime", "recurse": false, "hidden": false, "follow": false, "get_checksum": false, "use_regex": false, "exact_mode": true, "excludes": null, "contains": null, "age": null, "size": null, "depth": null, "mode": null}}}\r\n', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
reboot: rebooting server...
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no -tt 10.2.1.6 '/bin/sh -c '"'"'sudo -H -S -n -u root /bin/sh -c '"'"'"'"'"'"'"'"'echo BECOME-SUCCESS-fgxbnllajzhtepxmakhkrjugxwxvdkwm ; /sbin/shutdown -r 0 "Reboot initiated by Ansible"'"'"'"'"'"'"'"'"' && sleep 0'"'"''
Escalation succeeded
<10.2.1.6> (0, b"Reboot scheduled for Thu 2024-04-11 08:26:32 UTC, use 'shutdown -c' to cancel.\r\r\n", b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
reboot: validating reboot
reboot: attempting to get system boot time
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no -tt 10.2.1.6 '/bin/sh -c '"'"'sudo -H -S -n -u root /bin/sh -c '"'"'"'"'"'"'"'"'echo BECOME-SUCCESS-nvymqkznhorvconcyqxlusbsmnwbomub ; cat /proc/sys/kernel/random/boot_id'"'"'"'"'"'"'"'"' && sleep 0'"'"''
Escalation succeeded
<10.2.1.6> (0, b'cb8d4303-f662-496a-b5de-df2a4ac85da7\r\n', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
reboot: last boot time check fail 'boot time has not changed', retrying in 1.7250 seconds...
reboot: attempting to get system boot time
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no -tt 10.2.1.6 '/bin/sh -c '"'"'sudo -H -S -n -u root /bin/sh -c '"'"'"'"'"'"'"'"'echo BECOME-SUCCESS-iinnsimfvcsirskrbducjgkauuiuekit ; cat /proc/sys/kernel/random/boot_id'"'"'"'"'"'"'"'"' && sleep 0'"'"''
Escalation succeeded
<10.2.1.6> (0, b'cb8d4303-f662-496a-b5de-df2a4ac85da7\r\n', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
reboot: last boot time check fail 'boot time has not changed', retrying in 2.6180 seconds...
reboot: attempting to get system boot time
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no -tt 10.2.1.6 '/bin/sh -c '"'"'sudo -H -S -n -u root /bin/sh -c '"'"'"'"'"'"'"'"'echo BECOME-SUCCESS-fojflfozsjntdodrgempmvsqngjwzdcs ; cat /proc/sys/kernel/random/boot_id'"'"'"'"'"'"'"'"' && sleep 0'"'"''
Escalation succeeded
<10.2.1.6> (0, b'Could not chdir to home directory /home/automation: No such file or directory\r\ncb8d4303-f662-496a-b5de-df2a4ac85da7\r\n', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
reboot: attempting post-reboot test command
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no -tt 10.2.1.6 '/bin/sh -c '"'"'sudo -H -S -n -u root /bin/sh -c '"'"'"'"'"'"'"'"'echo BECOME-SUCCESS-viwdyiuphreetwczidqvcowwwmgascxv ; whoami'"'"'"'"'"'"'"'"' && sleep 0'"'"''
Escalation succeeded
<10.2.1.6> (0, b'Could not chdir to home directory /home/automation: No such file or directory\r\nroot\r\n', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
reboot: system successfully rebooted
<10.2.1.6> ESTABLISH SSH CONNECTION FOR USER: automation
<10.2.1.6> SSH: ansible.cfg set ssh_args: (-C)(-o)(ControlMaster=auto)(-o)(ControlPersist=3600s)(-o)(ControlPath=~/.ssh/c/%h_%r_%p)
<10.2.1.6> SSH: ansible_password/ansible_ssh_password not set: (-o)(KbdInteractiveAuthentication=no)(-o)(PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey)(-o)(PasswordAuthentication=no)
<10.2.1.6> SSH: ANSIBLE_REMOTE_USER/remote_user/ansible_user/user/-u set: (-o)(User="automation")
<10.2.1.6> SSH: ANSIBLE_TIMEOUT/timeout set: (-o)(ConnectTimeout=8)
<10.2.1.6> SSH: Set ssh_common_args: ()
<10.2.1.6> SSH: Set ssh_extra_args: (-F)(/home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config)(-o)(ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain)(-o)(StrictHostKeyChecking=no)
<10.2.1.6> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=3600s -o 'ControlPath=~/.ssh/c/%h_%r_%p' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="automation"' -o ConnectTimeout=8 -F /home/shk3bq4d/git/myotherproject/myproject/ans/group_vars/ssh_config -o 'ProxyCommand=ssh -W %h:%p -p 22 -o ControlMaster=auto -o ControlPersist=30s -o ControlPath=~/.ssh/c/nmrud.mydomain_automation_22 -o StrictHostKeyChecking=no automation@nmrud.mydomain' -o StrictHostKeyChecking=no 10.2.1.6 '/bin/sh -c '"'"'rm -f -r /home/automation/.ansible/tmp/ansible-tmp-1712823989.226468-599523-140907275976354/ > /dev/null 2>&1 && sleep 0'"'"''
<10.2.1.6> (0, b'', b'OpenSSH_8.9p1 Ubuntu-3ubuntu0.6, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Truncating as irrelevant\r\n')
changed: [debian12-image.mydomain] => changed=true
elapsed: 5
rebooted: true
PLAY RECAP *********************************************************************
debian12-image.mydomain : ok=1 changed=1 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0
ansibot
commented
7 months ago
Summary
To verify that a reboot actually took place, the
ansible.builtin.rebootmodule compares an initial output ofboot_time_command(execution # 1) with successive ones (execution # 2, # 3, # 4, ...) and considers the host as rebooted the first time they differ to continue with post-reboot checks.It however fails to correctly handle certain cases where setup for the execution of
boot_time_commandfails before even executing that command and interprets the output of that failure as the actual output ofboot_time_commandwhich consequently differ from a correct execution and mark the host as rebooted.Failure of setting up for the execution of
boot_time_commandis to be considered a normal case while the host is rebooting as various parts of the system no longer work as normal (filesystems get umounted, ...).A work around is to set
post_reboot_delaywith a "high-enough" value, but a safe threshold to be found varies with the speed at which a system properly shut downs.For an end user, the result is similar to #78007: the module may completes and mark the host as successfully rebooted while it is in fact still rebooting, neither verifying if the reboots was indeed successful and possibly failing in the middle of following tasks.
The work around of #78007 does not work since
boot_time_commmandis not even executed in our case. The associated PR was also rejected and doesn't look like it would solve this instance of the problem.The issue can be reproduced about 50% of the time on a freshly installed debian12 systems running in a virtual machine on vmware and executing the
rebootmodule as an adhoc command with the latest currently released version of ansible (2.16.5).While reproducing the issue may be difficult due to it possibly be a race condition, I encourage to understand the kind of error that get's generated in the attached exeuction and verify that this particular category of error is not treated as such by the current source code and rather as the normal execution of
boot_time_command.Issue Type
Bug Report
Component Name
ansible.builtin.reboot
Ansible Version
Configuration
OS / Environment
controller: ubuntu 22.04 target host: debian12
Steps to Reproduce
Expected Results
cb8d4303-f662-496a-b5de-df2a4ac85da7\r\nwhich is the first execution ofcat /proc/sys/kernel/random/boot_idwhich is the default value of boot_time_commandboot_time_command# 2 and # 3Could not chdir to home directory /home/automation: No such file or directory\r\ncb8d4303-f662-496a-b5de-df2a4ac85da7\r\nwhich is a mixup of the error generated by setting up the execution ofboot_time_command's # 4 and its own output. Due to the race conditions getting involved, we have seen multiple kind of errors messages. In this particular instance, we may speculate that /home had been unmounted and as such /home/automation no longer existed. We have been able to reproduce similar errors even if changingremote_tmpinansible.cfg.line 333 acknowledges that the module considers the host as already rebooted
Note: This is our partition table for full disclosure
Actual Results
Code of Conduct