search

IBM / ansible-power-hmc

Developer contributions for Ansible Automation on Power (HMC)
GNU General Public License v3.0
26 stars 41 forks source link

powervm_lpar_instance generates a "EPOW_SUS_CHRP" environmental error in the error log and fails to shut the LPAR down #99

Closed saffer58 closed 6 months ago

saffer58 commented 1 year ago

powervm_lpar_instance generates a "EPOW_SUS_CHRP" environmental error in the error log and fails to shut the LPAR down To Reproduce

Using the YAML playbook below, the LPAR fails to shutdown and the HMC displays a D200A200 reference code. On invocation of the playbook, the following error is noted in the error log and timeout occurs. HMC GUI lpar shutdown works without any issues. There are no applications running on the test lpar

ErrorLog `LABEL: EPOW_SUS_CHRP IDENTIFIER: BE0A03E5

Date/Time: Wed Apr 19 11:22:12 2023 Sequence Number: 8331 Machine Id: 00FADCA74C00 Node Id: goldaix72 Class: H Type: PERM WPAR: Global Resource Name: sysplanar0 Resource Class: planar Resource Type: sysplanar_rspc Location:

Description ENVIRONMENTAL PROBLEM

Probable Causes Power Turned Off Without a Shutdown POWER OR FAN COMPONENT

    Recommended Actions
    RUN SYSTEM DIAGNOSTICS.
    PERFORM PROBLEM DETERMINATION PROCEDURES

Detail Data POWER STATUS REGISTER 0000 0003 PROBLEM DATA 0624 0040 0000 00BC 8600 8E00 0000 0000 0000 0000 4942 4D00 5048 0030 0100 A207 2023 0419 0922 1200 0000 0000 0000 0000 4C00 0004 0000 0000 0000 0000 0000 0000 83B8 CD1A 0000 0000 5548 0018 0100 A207 8303 0001 0000 0000 0000 0000 0000 0000 4548 0050 0100 A207 3832 3836 2D34 3241 3231 4443 4137 5700 0000 0000 5356 3836 305F 3234 3300 0000 0000 0000 5046 3231 3131 3034 2E70 6677 3836 3000 0000 0000 0000 0000 0000 0000 0000 0004 0000 0000 4550 0014 0200 A207 0301 0100 0420 0000 0000 0000

Diagnostic Analysis Diagnostic Log sequence number: 31 Resource tested: sysplanar0 Menu Number: 651303 Description:

The following informational event was reported by Platform Firmware.

Platform Firmware Miscellaneous, Information Only.

Normal system shutdown with no additional delay. ---

PLAYBOOK: testoff.yml **** 1 plays in testoff.yml

PLAY [HMC poweroff] **

TASK [Gathering Facts] *** task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:2

ESTABLISH LOCAL CONNECTION FOR USER: ansibleaix EXEC /bin/sh -c 'echo ~ansibleaix && sleep 0' EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/ansibleaix/.ansible/tmp `"&& mkdir "` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201 `" && echo ansible-tmp-1681896125.1607473-1410988-279106458273201="` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201 `" ) && sleep 0' Attempting python interpreter discovery EXEC /bin/sh -c 'echo PLATFORM; uname; echo FOUND; command -v '"'"'python3.10'"'"'; command -v '"'"'python3.9'"'"'; command -v '"'"'python3.8'"'"'; command -v '"'"'python3.7'"'"'; command -v '"'"'python3.6'"'"'; command -v '"'"'python3.5'"'"'; command -v '"'"'/usr/bin/python3'"'"'; command -v '"'"'/usr/libexec/platform-python'"'"'; command -v '"'"'python2.7'"'"'; command -v '"'"'/usr/bin/python'"'"'; command -v '"'"'python'"'"'; echo ENDFOUND && sleep 0' EXEC /bin/sh -c '/usr/bin/python3.9 && sleep 0' Using module file /usr/lib/python3.9/site-packages/ansible/modules/setup.py PUT /home/ansibleaix/.ansible/tmp/ansible-local-1410953e0mq67ia/tmp047lclkk TO /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/AnsiballZ_setup.py EXEC /bin/sh -c 'chmod u+x /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/ /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/AnsiballZ_setup.py && sleep 0' EXEC /bin/sh -c 'http_proxy='"'"''"'"' https_proxy='"'"''"'"' /usr/libexec/platform-python /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/AnsiballZ_setup.py && sleep 0' EXEC /bin/sh -c 'rm -f -r /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/ > /dev/null 2>&1 && sleep 0' ok: [hmc-hodc1] META: ran handlers TASK [list managed system details] *********************************************************************************************************************************************************** task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:23 ESTABLISH LOCAL CONNECTION FOR USER: ansibleaix EXEC /bin/sh -c 'echo ~ansibleaix && sleep 0' EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/ansibleaix/.ansible/tmp `"&& mkdir "` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751 `" && echo ansible-tmp-1681896126.2477672-1411102-100846569923751="` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751 `" ) && sleep 0' Using module file /home/ansibleaix/.ansible/collections/ansible_collections/ibm/power_hmc/plugins/modules/power_system.py PUT /home/ansibleaix/.ansible/tmp/ansible-local-1410953e0mq67ia/tmp51dvmydf TO /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/AnsiballZ_power_system.py EXEC /bin/sh -c 'chmod u+x /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/ /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/AnsiballZ_power_system.py && sleep 0' EXEC /bin/sh -c 'http_proxy='"'"''"'"' https_proxy='"'"''"'"' /usr/libexec/platform-python /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/AnsiballZ_power_system.py && sleep 0' EXEC /bin/sh -c 'rm -f -r /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/ > /dev/null 2>&1 && sleep 0' ok: [hmc-hodc1] => { "changed": false, "invocation": { "module_args": { "action": null, "hmc_auth": { "password": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER", "username": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER" }, "hmc_host": "hmc-hodc1", "mem_mirroring_mode": null, "new_name": null, "pend_mem_region_size": null, "power_off_policy": null, "power_on_lpar_start_policy": null, "requested_num_sys_huge_pages": null, "state": "facts", "system_name": "SAPPRD" } }, "system_info": { "ActivatedLevel": "243", "ActivatedServicePackNameAndLevel": "FW860.B1 (243)", "BMCVersion": null, "CapacityOnDemandMemoryCapable": "true", "CapacityOnDemandProcessorCapable": "true", "ConfigurableSystemMemory": 524288, "ConfigurableSystemProcessorUnits": 24, "CurrentAvailableSystemMemory": 484096, "CurrentAvailableSystemProcessorUnits": 18.6, "DeferredLevel": null, "DeferredServicePackNameAndLevel": null, "Description": null, "IPAddress": "10.128.128.8", "InstalledSystemMemory": 524288, "InstalledSystemProcessorUnits": 24, "IsClassicHMCManagement": "true", "IsNotPowerVMManagementMaster": "false", "IsPowerVMManagementMaster": "false", "MTMS": "8286-42A*21DCA7W", "ManufacturingDefaultConfigurationEnabled": "false", "MaximumPartitions": 480, "MemoryDefragmentationState": "Not_In_Progress", "MergedReferenceCode": " ", "MeteredPoolID": null, "PNORVersion": null, "PermanentSystemMemory": 524288, "PermanentSystemProcessors": 24, "PhysicalSystemAttentionLEDState": "false", "ProcessorThrottling": "false", "ReferenceCode": " ", "ServiceProcessorVersion": "0008000C", "State": "operating", "SystemFirmware": "SV860_FW860.B1 (243)", "SystemLocation": null, "SystemName": "SAPPRD", "SystemType": "fsp" } } TASK [Stdout the managed system details] ***************************************************************************************************************************************************** task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:31 ok: [hmc-hodc1] => { "msg": { "changed": false, "failed": false, "system_info": { "ActivatedLevel": "243", "ActivatedServicePackNameAndLevel": "FW860.B1 (243)", "BMCVersion": null, "CapacityOnDemandMemoryCapable": "true", "CapacityOnDemandProcessorCapable": "true", "ConfigurableSystemMemory": 524288, "ConfigurableSystemProcessorUnits": 24, "CurrentAvailableSystemMemory": 484096, "CurrentAvailableSystemProcessorUnits": 18.6, "DeferredLevel": null, "DeferredServicePackNameAndLevel": null, "Description": null, "IPAddress": "10.128.128.8", "InstalledSystemMemory": 524288, "InstalledSystemProcessorUnits": 24, "IsClassicHMCManagement": "true", "IsNotPowerVMManagementMaster": "false", "IsPowerVMManagementMaster": "false", "MTMS": "8286-42A*21DCA7W", "ManufacturingDefaultConfigurationEnabled": "false", "MaximumPartitions": 480, "MemoryDefragmentationState": "Not_In_Progress", "MergedReferenceCode": " ", "MeteredPoolID": null, "PNORVersion": null, "PermanentSystemMemory": 524288, "PermanentSystemProcessors": 24, "PhysicalSystemAttentionLEDState": "false", "ProcessorThrottling": "false", "ReferenceCode": " ", "ServiceProcessorVersion": "0008000C", "State": "operating", "SystemFirmware": "SV860_FW860.B1 (243)", "SystemLocation": null, "SystemName": "ansible-playbook [core 2.13.3] config file = /home/ansibleaix/.ansible.cfg configured module search path = ['/usr/share/ansible/fos/library'] ansible python module location = /usr/lib/python3.9/site-packages/ansible ansible collection location = /home/ansibleaix/.ansible/collections:/usr/share/ansible/collections executable location = /usr/bin/ansible-playbook python version = 3.9.13 (main, Nov 9 2022, 13:16:24) [GCC 8.5.0 20210514 (Red Hat 8.5.0-15)] jinja version = 3.1.2 libyaml = True Using /home/ansibleaix/.ansible.cfg as config file Vault password: host_list declined parsing /home/ansibleaix/etc/hosts as it did not pass its verify_file() method script declined parsing /home/ansibleaix/etc/hosts as it did not pass its verify_file() method auto declined parsing /home/ansibleaix/etc/hosts as it did not pass its verify_file() method Parsed /home/ansibleaix/etc/hosts inventory source with ini plugin Skipping callback 'default', as we already have a stdout callback. Skipping callback 'minimal', as we already have a stdout callback. Skipping callback 'oneline', as we already have a stdout callback. PLAYBOOK: testoff.yml ************************************************************************************************************************************************************************ 1 plays in testoff.yml PLAY [HMC poweroff] ************************************************************************************************************************************************************************** TASK [Gathering Facts] *********************************************************************************************************************************************************************** task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:2 ESTABLISH LOCAL CONNECTION FOR USER: ansibleaix EXEC /bin/sh -c 'echo ~ansibleaix && sleep 0' EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/ansibleaix/.ansible/tmp `"&& mkdir "` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201 `" && echo ansible-tmp-1681896125.1607473-1410988-279106458273201="` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201 `" ) && sleep 0' Attempting python interpreter discovery EXEC /bin/sh -c 'echo PLATFORM; uname; echo FOUND; command -v '"'"'python3.10'"'"'; command -v '"'"'python3.9'"'"'; command -v '"'"'python3.8'"'"'; command -v '"'"'python3.7'"'"'; command -v '"'"'python3.6'"'"'; command -v '"'"'python3.5'"'"'; command -v '"'"'/usr/bin/python3'"'"'; command -v '"'"'/usr/libexec/platform-python'"'"'; command -v '"'"'python2.7'"'"'; command -v '"'"'/usr/bin/python'"'"'; command -v '"'"'python'"'"'; echo ENDFOUND && sleep 0' EXEC /bin/sh -c '/usr/bin/python3.9 && sleep 0' Using module file /usr/lib/python3.9/site-packages/ansible/modules/setup.py PUT /home/ansibleaix/.ansible/tmp/ansible-local-1410953e0mq67ia/tmp047lclkk TO /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/AnsiballZ_setup.py EXEC /bin/sh -c 'chmod u+x /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/ /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/AnsiballZ_setup.py && sleep 0' EXEC /bin/sh -c 'http_proxy='"'"''"'"' https_proxy='"'"''"'"' /usr/libexec/platform-python /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/AnsiballZ_setup.py && sleep 0' EXEC /bin/sh -c 'rm -f -r /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/ > /dev/null 2>&1 && sleep 0' ok: [hmc-hodc1] META: ran handlers TASK [list managed system details] *********************************************************************************************************************************************************** task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:23 ESTABLISH LOCAL CONNECTION FOR USER: ansibleaix EXEC /bin/sh -c 'echo ~ansibleaix && sleep 0' EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/ansibleaix/.ansible/tmp `"&& mkdir "` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751 `" && echo ansible-tmp-1681896126.2477672-1411102-100846569923751="` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751 `" ) && sleep 0' Using module file /home/ansibleaix/.ansible/collections/ansible_collections/ibm/power_hmc/plugins/modules/power_system.py PUT /home/ansibleaix/.ansible/tmp/ansible-local-1410953e0mq67ia/tmp51dvmydf TO /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/AnsiballZ_power_system.py EXEC /bin/sh -c 'chmod u+x /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/ /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/AnsiballZ_power_system.py && sleep 0' EXEC /bin/sh -c 'http_proxy='"'"''"'"' https_proxy='"'"''"'"' /usr/libexec/platform-python /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/AnsiballZ_power_system.py && sleep 0' EXEC /bin/sh -c 'rm -f -r /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/ > /dev/null 2>&1 && sleep 0' ok: [hmc-hodc1] => { "changed": false, "invocation": { "module_args": { "action": null, "hmc_auth": { "password": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER", "username": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER" }, "hmc_host": "hmc-hodc1", "mem_mirroring_mode": null, "new_name": null, "pend_mem_region_size": null, "power_off_policy": null, "power_on_lpar_start_policy": null, "requested_num_sys_huge_pages": null, "state": "facts", "system_name": "SAPPRD" } }, "system_info": { "ActivatedLevel": "243", "ActivatedServicePackNameAndLevel": "FW860.B1 (243)", "BMCVersion": null, "CapacityOnDemandMemoryCapable": "true", "CapacityOnDemandProcessorCapable": "true", "ConfigurableSystemMemory": 524288, "ConfigurableSystemProcessorUnits": 24, "CurrentAvailableSystemMemory": 484096, "CurrentAvailableSystemProcessorUnits": 18.6, "DeferredLevel": null, "DeferredServicePackNameAndLevel": null, "Description": null, "IPAddress": "10.128.128.8", "InstalledSystemMemory": 524288, "InstalledSystemProcessorUnits": 24, "IsClassicHMCManagement": "true", "IsNotPowerVMManagementMaster": "false", "IsPowerVMManagementMaster": "false", "MTMS": "8286-42A*21DCA7W", "ManufacturingDefaultConfigurationEnabled": "false", "MaximumPartitions": 480, "MemoryDefragmentationState": "Not_In_Progress", "MergedReferenceCode": " ", "MeteredPoolID": null, "PNORVersion": null, "PermanentSystemMemory": 524288, "PermanentSystemProcessors": 24, "PhysicalSystemAttentionLEDState": "false", "ProcessorThrottling": "false", "ReferenceCode": " ", "ServiceProcessorVersion": "0008000C", "State": "operating", "SystemFirmware": "SV860_FW860.B1 (243)", "SystemLocation": null, "SystemName": "ansible-playbook [core 2.13.3] config file = /home/ansibleaix/.ansible.cfg configured module search path = ['/usr/share/ansible/fos/library'] ansible python module location = /usr/lib/python3.9/site-packages/ansible ansible collection location = /home/ansibleaix/.ansible/collections:/usr/share/ansible/collections executable location = /usr/bin/ansible-playbook python version = 3.9.13 (main, Nov 9 2022, 13:16:24) [GCC 8.5.0 20210514 (Red Hat 8.5.0-15)] jinja version = 3.1.2 libyaml = True Using /home/ansibleaix/.ansible.cfg as config file Vault password: host_list declined parsing /home/ansibleaix/etc/hosts as it did not pass its verify_file() method script declined parsing /home/ansibleaix/etc/hosts as it did not pass its verify_file() method auto declined parsing /home/ansibleaix/etc/hosts as it did not pass its verify_file() method Parsed /home/ansibleaix/etc/hosts inventory source with ini plugin Skipping callback 'default', as we already have a stdout callback. Skipping callback 'minimal', as we already have a stdout callback. Skipping callback 'oneline', as we already have a stdout callback. PLAYBOOK: testoff.yml ************************************************************************************************************************************************************************ 1 plays in testoff.yml PLAY [HMC poweroff] ************************************************************************************************************************************************************************** TASK [Gathering Facts] *********************************************************************************************************************************************************************** task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:2 ESTABLISH LOCAL CONNECTION FOR USER: ansibleaix EXEC /bin/sh -c 'echo ~ansibleaix && sleep 0' EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/ansibleaix/.ansible/tmp `"&& mkdir "` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201 `" && echo ansible-tmp-1681896125.1607473-1410988-279106458273201="` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201 `" ) && sleep 0' Attempting python interpreter discovery EXEC /bin/sh -c 'echo PLATFORM; uname; echo FOUND; command -v '"'"'python3.10'"'"'; command -v '"'"'python3.9'"'"'; command -v '"'"'python3.8'"'"'; command -v '"'"'python3.7'"'"'; command -v '"'"'python3.6'"'"'; command -v '"'"'python3.5'"'"'; command -v '"'"'/usr/bin/python3'"'"'; command -v '"'"'/usr/libexec/platform-python'"'"'; command -v '"'"'python2.7'"'"'; command -v '"'"'/usr/bin/python'"'"'; command -v '"'"'python'"'"'; echo ENDFOUND && sleep 0' EXEC /bin/sh -c '/usr/bin/python3.9 && sleep 0' Using module file /usr/lib/python3.9/site-packages/ansible/modules/setup.py PUT /home/ansibleaix/.ansible/tmp/ansible-local-1410953e0mq67ia/tmp047lclkk TO /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/AnsiballZ_setup.py EXEC /bin/sh -c 'chmod u+x /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/ /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/AnsiballZ_setup.py && sleep 0' EXEC /bin/sh -c 'http_proxy='"'"''"'"' https_proxy='"'"''"'"' /usr/libexec/platform-python /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/AnsiballZ_setup.py && sleep 0' EXEC /bin/sh -c 'rm -f -r /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/ > /dev/null 2>&1 && sleep 0' ok: [hmc-hodc1] META: ran handlers TASK [list managed system details] *********************************************************************************************************************************************************** task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:23 ESTABLISH LOCAL CONNECTION FOR USER: ansibleaix EXEC /bin/sh -c 'echo ~ansibleaix && sleep 0' EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/ansibleaix/.ansible/tmp `"&& mkdir "` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751 `" && echo ansible-tmp-1681896126.2477672-1411102-100846569923751="` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751 `" ) && sleep 0' Using module file /home/ansibleaix/.ansible/collections/ansible_collections/ibm/power_hmc/plugins/modules/power_system.py PUT /home/ansibleaix/.ansible/tmp/ansible-local-1410953e0mq67ia/tmp51dvmydf TO /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/AnsiballZ_power_system.py EXEC /bin/sh -c 'chmod u+x /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/ /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/AnsiballZ_power_system.py && sleep 0' EXEC /bin/sh -c 'http_proxy='"'"''"'"' https_proxy='"'"''"'"' /usr/libexec/platform-python /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/AnsiballZ_power_system.py && sleep 0' EXEC /bin/sh -c 'rm -f -r /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/ > /dev/null 2>&1 && sleep 0' ok: [hmc-hodc1] => { "changed": false, "invocation": { "module_args": { "action": null, "hmc_auth": { "password": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER", "username": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER" }, "hmc_host": "hmc-hodc1", "mem_mirroring_mode": null, "new_name": null, "pend_mem_region_size": null, "power_off_policy": null, "power_on_lpar_start_policy": null, "requested_num_sys_huge_pages": null, "state": "facts", "system_name": "SAPR3PRD2-8286-42A-SN21DCA7W" } }, "system_info": { "ActivatedLevel": "243", "ActivatedServicePackNameAndLevel": "FW860.B1 (243)", "BMCVersion": null, "CapacityOnDemandMemoryCapable": "true", "CapacityOnDemandProcessorCapable": "true", "ConfigurableSystemMemory": 524288, "ConfigurableSystemProcessorUnits": 24, "CurrentAvailableSystemMemory": 484096, "CurrentAvailableSystemProcessorUnits": 18.6, "DeferredLevel": null, "DeferredServicePackNameAndLevel": null, "Description": null, "IPAddress": "10.128.128.8", "InstalledSystemMemory": 524288, "InstalledSystemProcessorUnits": 24, "IsClassicHMCManagement": "true", "IsNotPowerVMManagementMaster": "false", "IsPowerVMManagementMaster": "false", "MTMS": "8286-42A*21DCA7W", "ManufacturingDefaultConfigurationEnabled": "false", "MaximumPartitions": 480, "MemoryDefragmentationState": "Not_In_Progress", "MergedReferenceCode": " ", "MeteredPoolID": null, "PNORVersion": null, "PermanentSystemMemory": 524288, "PermanentSystemProcessors": 24, "PhysicalSystemAttentionLEDState": "false", "ProcessorThrottling": "false", "ReferenceCode": " ", "ServiceProcessorVersion": "0008000C", "State": "operating", "SystemFirmware": "SV860_FW860.B1 (243)", "SystemLocation": null, "SystemName": "SAPR3PRD2-8286-42A-SN21DCA7W", "SystemType": "fsp" } } TASK [Stdout the managed system details] ***************************************************************************************************************************************************** task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:31 ok: [hmc-hodc1] => { "msg": { "changed": false, "failed": false, "system_info": { "ActivatedLevel": "243", "ActivatedServicePackNameAndLevel": "FW860.B1 (243)", "BMCVersion": null, "CapacityOnDemandMemoryCapable": "true", "CapacityOnDemandProcessorCapable": "true", "ConfigurableSystemMemory": 524288, "ConfigurableSystemProcessorUnits": 24, "CurrentAvailableSystemMemory": 484096, "CurrentAvailableSystemProcessorUnits": 18.6, "DeferredLevel": null, "DeferredServicePackNameAndLevel": null, "Description": null, "IPAddress": "10.128.128.8", "InstalledSystemMemory": 524288, "InstalledSystemProcessorUnits": 24, "IsClassicHMCManagement": "true", "IsNotPowerVMManagementMaster": "false", "IsPowerVMManagementMaster": "false", "MTMS": "8286-42A*21DCA7W", "ManufacturingDefaultConfigurationEnabled": "false", "MaximumPartitions": 480, "MemoryDefragmentationState": "Not_In_Progress", "MergedReferenceCode": " ", "MeteredPoolID": null, "PNORVersion": null, "PermanentSystemMemory": 524288, "PermanentSystemProcessors": 24, "PhysicalSystemAttentionLEDState": "false", "ProcessorThrottling": "false", "ReferenceCode": " ", "ServiceProcessorVersion": "0008000C", "State": "operating", "SystemFirmware": "SV860_FW860.B1 (243)", "SystemLocation": null, "SystemName": "SAPPRD", "SystemType": "fsp" } } } TASK [Shutdown a logical partition.] ********************************************************************************************************************************************************* task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:36 ESTABLISH LOCAL CONNECTION FOR USER: ansibleaix EXEC /bin/sh -c 'echo ~ansibleaix && sleep 0' EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/ansibleaix/.ansible/tmp `"&& mkdir "` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879 `" && echo ansible-tmp-1681896128.8775172-1411121-60842275623879="` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879 `" ) && sleep 0' Using module file /home/ansibleaix/.ansible/collections/ansible_collections/ibm/power_hmc/plugins/modules/powervm_lpar_instance.py PUT /home/ansibleaix/.ansible/tmp/ansible-local-1410953e0mq67ia/tmpvp15qeun TO /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/AnsiballZ_powervm_lpar_instance.py EXEC /bin/sh -c 'chmod u+x /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/ /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/AnsiballZ_powervm_lpar_instance.py && sleep 0' EXEC /bin/sh -c 'http_proxy='"'"''"'"' https_proxy='"'"''"'"' /usr/libexec/platform-python /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/AnsiballZ_powervm_lpar_instance.py && sleep 0' EXEC /bin/sh -c 'rm -f -r /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/ > /dev/null 2>&1 && sleep 0' The full traceback is: File "/tmp/ansible_powervm_lpar_instance_payload_l83vtwl4/ansible_powervm_lpar_instance_payload.zip/ansible_collections/ibm/power_hmc/plugins/modules/powervm_lpar_instance.py", line 1357, in poweroff_partition File "/tmp/ansible_powervm_lpar_instance_payload_l83vtwl4/ansible_powervm_lpar_instance_payload.zip/ansible_collections/ibm/power_hmc/plugins/module_utils/hmc_rest_client.py", line 870, in poweroffPartition return self.fetchJobStatus(jobID, timeout_in_min=10) File "/tmp/ansible_powervm_lpar_instance_payload_l83vtwl4/ansible_powervm_lpar_instance_payload.zip/ansible_collections/ibm/power_hmc/plugins/module_utils/hmc_rest_client.py", line 335, in fetchJobStatus raise HmcError("Job: {0} timed out!!".format(job_name)) fatal: [hmc-hodc1]: FAILED! => { "changed": false, "invocation": { "module_args": { "action": "shutdown", "advanced_info": null, "all_resources": null, "delete_vdisks": null, "hmc_auth": { "password": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER", "username": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER" }, "hmc_host": "hmc-hodc1", "iIPLsource": null, "install_settings": null, "keylock": null, "max_mem": null, "max_proc": null, "max_proc_unit": null, "max_virtual_slots": null, "mem": null, "min_mem": null, "min_proc": null, "min_proc_unit": null, "npiv_config": null, "os_type": null, "physical_io": null, "proc": null, "proc_compatibility_mode": null, "proc_mode": null, "proc_unit": null, "prof_name": null, "restart_option": null, "retain_vios_cfg": null, "shared_proc_pool": null, "shutdown_option": null, "state": null, "system_name": "SAPPRD", "virt_network_config": null, "vm_id": null, "vm_name": "goldaix72", "vnic_config": null, "volume_config": null, "weight": null } }, "msg": "HmcError: b'Job: PowerOff timed out!!'" } ", "SystemType": "fsp" } } TASK [Stdout the managed system details] ***************************************************************************************************************************************************** task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:31 ok: [hmc-hodc1] => { "msg": { "changed": false, "failed": false, "system_info": { "ActivatedLevel": "243", "ActivatedServicePackNameAndLevel": "FW860.B1 (243)", "BMCVersion": null, "CapacityOnDemandMemoryCapable": "true", "CapacityOnDemandProcessorCapable": "true", "ConfigurableSystemMemory": 524288, "ConfigurableSystemProcessorUnits": 24, "CurrentAvailableSystemMemory": 484096, "CurrentAvailableSystemProcessorUnits": 18.6, "DeferredLevel": null, "DeferredServicePackNameAndLevel": null, "Description": null, "IPAddress": "10.128.128.8", "InstalledSystemMemory": 524288, "InstalledSystemProcessorUnits": 24, "IsClassicHMCManagement": "true", "IsNotPowerVMManagementMaster": "false", "IsPowerVMManagementMaster": "false", "MTMS": "8286-42A*21DCA7W", "ManufacturingDefaultConfigurationEnabled": "false", "MaximumPartitions": 480, "MemoryDefragmentationState": "Not_In_Progress", "MergedReferenceCode": " ", "MeteredPoolID": null, "PNORVersion": null, "PermanentSystemMemory": 524288, "PermanentSystemProcessors": 24, "PhysicalSystemAttentionLEDState": "false", "ProcessorThrottling": "false", "ReferenceCode": " ", "ServiceProcessorVersion": "0008000C", "State": "operating", "SystemFirmware": "SV860_FW860.B1 (243)", "SystemLocation": null, "SystemName": "SAPPRD", "SystemType": "fsp" } } } TASK [Shutdown a logical partition.] ********************************************************************************************************************************************************* task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:36 ESTABLISH LOCAL CONNECTION FOR USER: ansibleaix EXEC /bin/sh -c 'echo ~ansibleaix && sleep 0' EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/ansibleaix/.ansible/tmp `"&& mkdir "` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879 `" && echo ansible-tmp-1681896128.8775172-1411121-60842275623879="` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879 `" ) && sleep 0' Using module file /home/ansibleaix/.ansible/collections/ansible_collections/ibm/power_hmc/plugins/modules/powervm_lpar_instance.py PUT /home/ansibleaix/.ansible/tmp/ansible-local-1410953e0mq67ia/tmpvp15qeun TO /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/AnsiballZ_powervm_lpar_instance.py EXEC /bin/sh -c 'chmod u+x /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/ /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/AnsiballZ_powervm_lpar_instance.py && sleep 0' EXEC /bin/sh -c 'http_proxy='"'"''"'"' https_proxy='"'"''"'"' /usr/libexec/platform-python /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/AnsiballZ_powervm_lpar_instance.py && sleep 0' EXEC /bin/sh -c 'rm -f -r /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/ > /dev/null 2>&1 && sleep 0' The full traceback is: File "/tmp/ansible_powervm_lpar_instance_payload_l83vtwl4/ansible_powervm_lpar_instance_payload.zip/ansible_collections/ibm/power_hmc/plugins/modules/powervm_lpar_instance.py", line 1357, in poweroff_partition File "/tmp/ansible_powervm_lpar_instance_payload_l83vtwl4/ansible_powervm_lpar_instance_payload.zip/ansible_collections/ibm/power_hmc/plugins/module_utils/hmc_rest_client.py", line 870, in poweroffPartition return self.fetchJobStatus(jobID, timeout_in_min=10) File "/tmp/ansible_powervm_lpar_instance_payload_l83vtwl4/ansible_powervm_lpar_instance_payload.zip/ansible_collections/ibm/power_hmc/plugins/module_utils/hmc_rest_client.py", line 335, in fetchJobStatus raise HmcError("Job: {0} timed out!!".format(job_name)) fatal: [hmc-hodc1]: FAILED! => { "changed": false, "invocation": { "module_args": { "action": "shutdown", "advanced_info": null, "all_resources": null, "delete_vdisks": null, "hmc_auth": { "password": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER", "username": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER" }, "hmc_host": "hmc-hodc1", "iIPLsource": null, "install_settings": null, "keylock": null, "max_mem": null, "max_proc": null, "max_proc_unit": null, "max_virtual_slots": null, "mem": null, "min_mem": null, "min_proc": null, "min_proc_unit": null, "npiv_config": null, "os_type": null, "physical_io": null, "proc": null, "proc_compatibility_mode": null, "proc_mode": null, "proc_unit": null, "prof_name": null, "restart_option": null, "retain_vios_cfg": null, "shared_proc_pool": null, "shutdown_option": null, "state": null, "system_name": "Sansible-playbook [core 2.13.3] config file = /home/ansibleaix/.ansible.cfg configured module search path = ['/usr/share/ansible/fos/library'] ansible python module location = /usr/lib/python3.9/site-packages/ansible ansible collection location = /home/ansibleaix/.ansible/collections:/usr/share/ansible/collections executable location = /usr/bin/ansible-playbook python version = 3.9.13 (main, Nov 9 2022, 13:16:24) [GCC 8.5.0 20210514 (Red Hat 8.5.0-15)] jinja version = 3.1.2 libyaml = True Using /home/ansibleaix/.ansible.cfg as config file Vault password: host_list declined parsing /home/ansibleaix/etc/hosts as it did not pass its verify_file() method script declined parsing /home/ansibleaix/etc/hosts as it did not pass its verify_file() method auto declined parsing /home/ansibleaix/etc/hosts as it did not pass its verify_file() method Parsed /home/ansibleaix/etc/hosts inventory source with ini plugin Skipping callback 'default', as we already have a stdout callback. Skipping callback 'minimal', as we already have a stdout callback. Skipping callback 'oneline', as we already have a stdout callback. PLAYBOOK: testoff.yml ************************************************************************************************************************************************************************ 1 plays in testoff.yml PLAY [HMC poweroff] ************************************************************************************************************************************************************************** TASK [Gathering Facts] *********************************************************************************************************************************************************************** task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:2 ESTABLISH LOCAL CONNECTION FOR USER: ansibleaix EXEC /bin/sh -c 'echo ~ansibleaix && sleep 0' EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/ansibleaix/.ansible/tmp `"&& mkdir "` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201 `" && echo ansible-tmp-1681896125.1607473-1410988-279106458273201="` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201 `" ) && sleep 0' Attempting python interpreter discovery EXEC /bin/sh -c 'echo PLATFORM; uname; echo FOUND; command -v '"'"'python3.10'"'"'; command -v '"'"'python3.9'"'"'; command -v '"'"'python3.8'"'"'; command -v '"'"'python3.7'"'"'; command -v '"'"'python3.6'"'"'; command -v '"'"'python3.5'"'"'; command -v '"'"'/usr/bin/python3'"'"'; command -v '"'"'/usr/libexec/platform-python'"'"'; command -v '"'"'python2.7'"'"'; command -v '"'"'/usr/bin/python'"'"'; command -v '"'"'python'"'"'; echo ENDFOUND && sleep 0' EXEC /bin/sh -c '/usr/bin/python3.9 && sleep 0' Using module file /usr/lib/python3.9/site-packages/ansible/modules/setup.py PUT /home/ansibleaix/.ansible/tmp/ansible-local-1410953e0mq67ia/tmp047lclkk TO /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/AnsiballZ_setup.py EXEC /bin/sh -c 'chmod u+x /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/ /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/AnsiballZ_setup.py && sleep 0' EXEC /bin/sh -c 'http_proxy='"'"''"'"' https_proxy='"'"''"'"' /usr/libexec/platform-python /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/AnsiballZ_setup.py && sleep 0' EXEC /bin/sh -c 'rm -f -r /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896125.1607473-1410988-279106458273201/ > /dev/null 2>&1 && sleep 0' ok: [hmc-hodc1] META: ran handlers TASK [list managed system details] *********************************************************************************************************************************************************** task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:23 ESTABLISH LOCAL CONNECTION FOR USER: ansibleaix EXEC /bin/sh -c 'echo ~ansibleaix && sleep 0' EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/ansibleaix/.ansible/tmp `"&& mkdir "` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751 `" && echo ansible-tmp-1681896126.2477672-1411102-100846569923751="` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751 `" ) && sleep 0' Using module file /home/ansibleaix/.ansible/collections/ansible_collections/ibm/power_hmc/plugins/modules/power_system.py PUT /home/ansibleaix/.ansible/tmp/ansible-local-1410953e0mq67ia/tmp51dvmydf TO /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/AnsiballZ_power_system.py EXEC /bin/sh -c 'chmod u+x /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/ /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/AnsiballZ_power_system.py && sleep 0' EXEC /bin/sh -c 'http_proxy='"'"''"'"' https_proxy='"'"''"'"' /usr/libexec/platform-python /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/AnsiballZ_power_system.py && sleep 0' EXEC /bin/sh -c 'rm -f -r /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896126.2477672-1411102-100846569923751/ > /dev/null 2>&1 && sleep 0' ok: [hmc-hodc1] => { "changed": false, "invocation": { "module_args": { "action": null, "hmc_auth": { "password": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER", "username": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER" }, "hmc_host": "hmc-hodc1", "mem_mirroring_mode": null, "new_name": null, "pend_mem_region_size": null, "power_off_policy": null, "power_on_lpar_start_policy": null, "requested_num_sys_huge_pages": null, "state": "facts", "system_name": "SAPPRD" } }, "system_info": { "ActivatedLevel": "243", "ActivatedServicePackNameAndLevel": "FW860.B1 (243)", "BMCVersion": null, "CapacityOnDemandMemoryCapable": "true", "CapacityOnDemandProcessorCapable": "true", "ConfigurableSystemMemory": 524288, "ConfigurableSystemProcessorUnits": 24, "CurrentAvailableSystemMemory": 484096, "CurrentAvailableSystemProcessorUnits": 18.6, "DeferredLevel": null, "DeferredServicePackNameAndLevel": null, "Description": null, "IPAddress": "10.128.128.8", "InstalledSystemMemory": 524288, "InstalledSystemProcessorUnits": 24, "IsClassicHMCManagement": "true", "IsNotPowerVMManagementMaster": "false", "IsPowerVMManagementMaster": "false", "MTMS": "8286-42A*21DCA7W", "ManufacturingDefaultConfigurationEnabled": "false", "MaximumPartitions": 480, "MemoryDefragmentationState": "Not_In_Progress", "MergedReferenceCode": " ", "MeteredPoolID": null, "PNORVersion": null, "PermanentSystemMemory": 524288, "PermanentSystemProcessors": 24, "PhysicalSystemAttentionLEDState": "false", "ProcessorThrottling": "false", "ReferenceCode": " ", "ServiceProcessorVersion": "0008000C", "State": "operating", "SystemFirmware": "SV860_FW860.B1 (243)", "SystemLocation": null, "SystemName": "SAPPRD", "SystemType": "fsp" } } TASK [Stdout the managed system details] ***************************************************************************************************************************************************** task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:31 ok: [hmc-hodc1] => { "msg": { "changed": false, "failed": false, "system_info": { "ActivatedLevel": "243", "ActivatedServicePackNameAndLevel": "FW860.B1 (243)", "BMCVersion": null, "CapacityOnDemandMemoryCapable": "true", "CapacityOnDemandProcessorCapable": "true", "ConfigurableSystemMemory": 524288, "ConfigurableSystemProcessorUnits": 24, "CurrentAvailableSystemMemory": 484096, "CurrentAvailableSystemProcessorUnits": 18.6, "DeferredLevel": null, "DeferredServicePackNameAndLevel": null, "Description": null, "IPAddress": "10.128.128.8", "InstalledSystemMemory": 524288, "InstalledSystemProcessorUnits": 24, "IsClassicHMCManagement": "true", "IsNotPowerVMManagementMaster": "false", "IsPowerVMManagementMaster": "false", "MTMS": "8286-42A*21DCA7W", "ManufacturingDefaultConfigurationEnabled": "false", "MaximumPartitions": 480, "MemoryDefragmentationState": "Not_In_Progress", "MergedReferenceCode": " ", "MeteredPoolID": null, "PNORVersion": null, "PermanentSystemMemory": 524288, "PermanentSystemProcessors": 24, "PhysicalSystemAttentionLEDState": "false", "ProcessorThrottling": "false", "ReferenceCode": " ", "ServiceProcessorVersion": "0008000C", "State": "operating", "SystemFirmware": "SV860_FW860.B1 (243)", "SystemLocation": null, "SystemName": "SAPPRD", "SystemType": "fsp" } } } TASK [Shutdown a logical partition.] ********************************************************************************************************************************************************* task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:36 ESTABLISH LOCAL CONNECTION FOR USER: ansibleaix EXEC /bin/sh -c 'echo ~ansibleaix && sleep 0' EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/ansibleaix/.ansible/tmp `"&& mkdir "` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879 `" && echo ansible-tmp-1681896128.8775172-1411121-60842275623879="` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879 `" ) && sleep 0' Using module file /home/ansibleaix/.ansible/collections/ansible_collections/ibm/power_hmc/plugins/modules/powervm_lpar_instance.py PUT /home/ansibleaix/.ansible/tmp/ansible-local-1410953e0mq67ia/tmpvp15qeun TO /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/AnsiballZ_powervm_lpar_instance.py EXEC /bin/sh -c 'chmod u+x /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/ /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/AnsiballZ_powervm_lpar_instance.py && sleep 0' EXEC /bin/sh -c 'http_proxy='"'"''"'"' https_proxy='"'"''"'"' /usr/libexec/platform-python /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/AnsiballZ_powervm_lpar_instance.py && sleep 0' EXEC /bin/sh -c 'rm -f -r /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/ > /dev/null 2>&1 && sleep 0' The full traceback is: File "/tmp/ansible_powervm_lpar_instance_payload_l83vtwl4/ansible_powervm_lpar_instance_payload.zip/ansible_collections/ibm/power_hmc/plugins/modules/powervm_lpar_instance.py", line 1357, in poweroff_partition File "/tmp/ansible_powervm_lpar_instance_payload_l83vtwl4/ansible_powervm_lpar_instance_payload.zip/ansible_collections/ibm/power_hmc/plugins/module_utils/hmc_rest_client.py", line 870, in poweroffPartition return self.fetchJobStatus(jobID, timeout_in_min=10) File "/tmp/ansible_powervm_lpar_instance_payload_l83vtwl4/ansible_powervm_lpar_instance_payload.zip/ansible_collections/ibm/power_hmc/plugins/module_utils/hmc_rest_client.py", line 335, in fetchJobStatus raise HmcError("Job: {0} timed out!!".format(job_name)) fatal: [hmc-hodc1]: FAILED! => { "changed": false, "invocation": { "module_args": { "action": "shutdown", "advanced_info": null, "all_resources": null, "delete_vdisks": null, "hmc_auth": { "password": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER", "username": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER" }, "hmc_host": "hmc-hodc1", "iIPLsource": null, "install_settings": null, "keylock": null, "max_mem": null, "max_proc": null, "max_proc_unit": null, "max_virtual_slots": null, "mem": null, "min_mem": null, "min_proc": null, "min_proc_unit": null, "npiv_config": null, "os_type": null, "physical_io": null, "proc": null, "proc_compatibility_mode": null, "proc_mode": null, "proc_unit": null, "prof_name": null, "restart_option": null, "retain_vios_cfg": null, "shared_proc_pool": null, "shutdown_option": null, "state": null, "system_name": "SAPPRD", "virt_network_config": null, "vm_id": null, "vm_name": "goldaix72", "vnic_config": null, "volume_config": null, "weight": null } }, "msg": "HmcError: b'Job: PowerOff timed out!!'" } ", "virt_network_config": null, "vm_id": null, "vm_name": "goldaix72", "vnic_config": null, "volume_config": null, "weight": null } }, "msg": "HmcError: b'Job: PowerOff timed out!!'" } ", "SystemType": "fsp" } } } TASK [Shutdown a logical partition.] ********************************************************************************************************************************************************* task path: /home/ansibleaix/Power/AIX/HOHAFAIL/roles/testoff.yml:36 ESTABLISH LOCAL CONNECTION FOR USER: ansibleaix EXEC /bin/sh -c 'echo ~ansibleaix && sleep 0' EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/ansibleaix/.ansible/tmp `"&& mkdir "` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879 `" && echo ansible-tmp-1681896128.8775172-1411121-60842275623879="` echo /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879 `" ) && sleep 0' Using module file /home/ansibleaix/.ansible/collections/ansible_collections/ibm/power_hmc/plugins/modules/powervm_lpar_instance.py PUT /home/ansibleaix/.ansible/tmp/ansible-local-1410953e0mq67ia/tmpvp15qeun TO /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/AnsiballZ_powervm_lpar_instance.py EXEC /bin/sh -c 'chmod u+x /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/ /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/AnsiballZ_powervm_lpar_instance.py && sleep 0' EXEC /bin/sh -c 'http_proxy='"'"''"'"' https_proxy='"'"''"'"' /usr/libexec/platform-python /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/AnsiballZ_powervm_lpar_instance.py && sleep 0' EXEC /bin/sh -c 'rm -f -r /home/ansibleaix/.ansible/tmp/ansible-tmp-1681896128.8775172-1411121-60842275623879/ > /dev/null 2>&1 && sleep 0' The full traceback is: File "/tmp/ansible_powervm_lpar_instance_payload_l83vtwl4/ansible_powervm_lpar_instance_payload.zip/ansible_collections/ibm/power_hmc/plugins/modules/powervm_lpar_instance.py", line 1357, in poweroff_partition File "/tmp/ansible_powervm_lpar_instance_payload_l83vtwl4/ansible_powervm_lpar_instance_payload.zip/ansible_collections/ibm/power_hmc/plugins/module_utils/hmc_rest_client.py", line 870, in poweroffPartition return self.fetchJobStatus(jobID, timeout_in_min=10) File "/tmp/ansible_powervm_lpar_instance_payload_l83vtwl4/ansible_powervm_lpar_instance_payload.zip/ansible_collections/ibm/power_hmc/plugins/module_utils/hmc_rest_client.py", line 335, in fetchJobStatus raise HmcError("Job: {0} timed out!!".format(job_name)) fatal: [hmc-hodc1]: FAILED! => { "changed": false, "invocation": { "module_args": { "action": "shutdown", "advanced_info": null, "all_resources": null, "delete_vdisks": null, "hmc_auth": { "password": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER", "username": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER" }, "hmc_host": "hmc-hodc1", "iIPLsource": null, "install_settings": null, "keylock": null, "max_mem": null, "max_proc": null, "max_proc_unit": null, "max_virtual_slots": null, "mem": null, "min_mem": null, "min_proc": null, "min_proc_unit": null, "npiv_config": null, "os_type": null, "physical_io": null, "proc": null, "proc_compatibility_mode": null, "proc_mode": null, "proc_unit": null, "prof_name": null, "restart_option": null, "retain_vios_cfg": null, "shared_proc_pool": null, "shutdown_option": null, "state": null, "system_name": "SAPPRD "virt_network_config": null, "vm_id": null, "vm_name": "goldaix72", "vnic_config": null, "volume_config": null, "weight": null } }, "msg": "HmcError: b'Job: PowerOff timed out!!'" } ` **HMC Release** `"version= Version: 9 Release: 2 Service Pack: 953 HMC Build level 2301130234 MH01874 - HMC V9R2 M951 MH01893 - iFix for HMC V9R2 M951 MH01905 - HMC V9R2 M952 MH01913 - iFix for HMC V9R2 M952 MH01925 - iFix for HMC V9R2 M952 MH01934 - HMC V9R2 M953 MH01949 - iFix for HMC V9R2 M953 ","base_version=V9R2 " ` **Ansible 2.13.3** **Python 3.6.8** Steps to reproduce the behavior: 1. Go to '...' 2. Click on '....' 3. Scroll down to '....' 4. See error **Expected behavior** A clear and concise description of what you expected to happen. **Screenshots** If applicable, add screenshots to help explain your problem. **Environment (please complete the following information):** - HMC: [e.g. V8R870 V9R1M910] - Python Version [e.g. 3.6 3.7] - OpenSSH Version [e.g. 1.0.2] **Additional context** Add any other context about the problem here.
naveenkandakur commented 1 year ago

I Would like to know which shutdown option you are choosing from HMC UI when it's working, because in powervm_lpar_instance module by default we use 'Delayed' shutdown option. In ansible_power_hmc-1.8 we have introduced new parameter called shutdown_option which allows user to choose different options(Delayed, Immediate, OperatingSystem, OSImmediate) If you are not using Delayed option from HMC UI, could you try to run the playbook with same option as UI.

saffer58 commented 1 year ago

Hi

We are doing an immediate shutdown that is specifically required for this project and forms part of a disaster fail over test. Delayed shutdown has never been used.

Regards

Get Outlook for Androidhttps://aka.ms/AAb9ysg

From: Navinakumar Kandakur @.> Sent: Thursday, April 20, 2023 8:03:09 AM To: IBM/ansible-power-hmc @.> Cc: Paul Clayton @.>; Author @.> Subject: Re: [IBM/ansible-power-hmc] powervm_lpar_instance generates a "EPOW_SUS_CHRP" environmental error in the error log and fails to shut the LPAR down (Issue #99)

I Would like to know which shutdown option you are choosing from HMC UI when it's working, because in powervm_lpar_instance module by default we use 'Delayed' shutdown option. In ansible_power_hmc-1.8 we have introduced new parameter called shutdown_option which allows user to choose different options(Delayed, Immediate, OperatingSystem, OSImmediate) If you are not using Delayed option from HMC UI, could you try to run the playbook with same option as UI.

— Reply to this email directly, view it on GitHubhttps://github.com/IBM/ansible-power-hmc/issues/99#issuecomment-1515760137, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A7AJSXV3IRJG64A6EVH62ATXCDGR3ANCNFSM6AAAAAAXDZWN5U. You are receiving this because you authored the thread.Message ID: @.***>

Disclaimer: https://www.shopriteholdings.co.za/email-disclaimer.html

Disclaimer: https://www.shopriteholdings.co.za/email-disclaimer.html

naveenkandakur commented 1 year ago

Looking at the playbook mentioned in the issue, you are not specifying shutdown_option so by default its taking shutdown_option:Delayed, Can you use the ansible_power_hmc-1.8 content and run your playbook by adding shutdown_option in it as below.

name: Shutdown a logical partition.
powervm_lpar_instance:
hmc_host: '{{ inventory_hostname }}'
hmc_auth: "{{ curr_hmc_auth }}"
system_name: SAPPRD
vm_name: goldaix72
shutdown_option: Immediate
action: shutdown
naveenkandakur commented 6 months ago

Since there is no response, Assuming issue is resolved, hence closing the issues, if you encounter the issue again feel free to reopen the issue.