search

CCI-MOC / esi

Elastic Secure Infrastructure project
6 stars 12 forks source link

Investigate large number of IPMI errors in Ironic conductor log #569

Open tzumainn opened 6 days ago

tzumainn commented 6 days ago

There are frequent errors as follows:

2024-07-01 13:04:48.768 7 WARNING ironic.drivers.modules.ipmitool [req-b20f2fc1-3324-4eda-83f1-2bbbbbdbefbd - - - - -] IPMI Error encountered, retrying "ipmitool -I lanplus -H ... -R 1 -N 5 -f /tmp/tmpv3nt66ba power status" for node 6e584c65-4245-4a7d-bdb7-e893738e85e2. Error: Unexpected error while running command.
Command: ipmitool -I lanplus -H ...t -R 1 -N 5 -f /tmp/tmpv3nt66ba power status
Exit code: 1
Stdout: ''
Stderr: 'Error: Unable to establish IPMI v2 / RMCP+ session\n': oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.

Cursory examination shows that this node is in maintenance mode, so it's maybe not unexpected; however this creates a TON of log noise. Is there a way to turn this check off?