ManageIQ / manageiq

ManageIQ Open-Source Management Platform
https://manageiq.org
Apache License 2.0
1.35k stars 900 forks source link

Observing Errors in Logs - Systemd Worker Monitoring Issue in ManageIQ #23284

Open rabah-beldi opened 4 days ago

rabah-beldi commented 4 days ago

We encountered an error during the monitoring of systemd workers in our ManageIQ environment. The error occurs when the application attempts to access an array element that is nil. This issue appears every 15 seconds in the logs.

Detailed error message in Logs:

The error appears every 15 seconds in the logs: evm[2511]: ERROR -- evm: MIQ(MiqServer#monitor) undefined method[]' for nil:NilClass Nov 27 11:12:31 XXXX evm[2511]: ERROR -- evm: [NoMethodError]: undefined method []' for nil:NilClass Method:[block (2 levels) in <class:LogProxy>] Nov 27 11:12:31 XXXX evm[2511]: ERROR -- evm: /var/www/miq/vmdb/app/models/miq_server/worker_management/systemd.rb:14:inblock in sync_starting_workers'#012/var/www/miq/vmdb/app/models/miq_server/worker_management/systemd.rb:10:in each'#012/var/www/miq/vmdb/app/models/miq_server/worker_management/systemd.rb:10:insync_starting_workers'#012/var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:26:in monitor_workers'#012/var/www/miq/vmdb/app/models/miq_server.rb:214:inblock in monitor'#012/opt/manageiq/manageiq-gemset/gems/more_core_extensions-4.4.0/lib/more_core_extensions/core_ext/benchmark/realtime_store.rb:20:in realtime_store'#012/opt/manageiq/manageiq-gemset/gems/more_core_extensions-4.4.0/lib/more_core_extensions/core_ext/benchmark/realtime_store.rb:56:inrealtime_block'#012/var/www/miq/vmdb/app/models/miq_server.rb:214:in monitor'#012/var/www/miq/vmdb/lib/workers/evm_server.rb:142:inblock in monitor'#012/opt/manageiq/manageiq-gemset/gems/more_core_extensions-4.4.0/lib/more_core_extensions/core_ext/benchmark/realtime_store.rb:20:in realtime_store'#012/opt/manageiq/manageiq-gemset/gems/more_core_extensions-4.4.0/lib/more_core_extensions/core_ext/benchmark/realtime_store.rb:62:inrealtime_block'#012/var/www/miq/vmdb/lib/workers/evm_server.rb:142:in monitor'#012/var/www/miq/vmdb/lib/workers/evm_server.rb:51:inblock (2 levels) in monitor_servers'#012/var/www/miq/vmdb/lib/workers/evm_server.rb:273:in block in as_each_server'#012/var/www/miq/vmdb/lib/workers/evm_server.rb:271:ineach'#012/var/www/miq/vmdb/lib/workers/evm_server.rb:271:in as_each_server'#012/var/www/miq/vmdb/lib/workers/evm_server.rb:51:inblock in monitor_servers'#012/var/www/miq/vmdb/lib/workers/evm_server.rb:49:in loop'#012/var/www/miq/vmdb/lib/workers/evm_server.rb:49:inmonitor_servers'#012/var/www/miq/vmdb/lib/workers/evm_server.rb:31:in start'#012/var/www/miq/vmdb/lib/workers/evm_server.rb:84:instart'#012lib/workers/bin/evm_server.rb:4:in <main>'

  1. Describe of the environment:
    • Version : quinteros-2.2.20241113183051_fc4741c
    • Environment
      • For ManageIQ: EC2 appliance
      • For gems: `RubyGems Environment:
    • RUBYGEMS VERSION: 3.2.33
    • RUBY VERSION: 3.0.4 (2022-04-12 patchlevel 208) [x86_64-linux]
    • INSTALLATION DIRECTORY: /opt/manageiq/manageiq-gemset
    • USER INSTALLATION DIRECTORY: /root/.gem/ruby
    • RUBY EXECUTABLE: /usr/bin/ruby
    • GIT EXECUTABLE: /usr/bin/git
    • EXECUTABLE DIRECTORY: /opt/manageiq/manageiq-gemset/bin
    • SPEC CACHE DIRECTORY: /root/.gem/specs
    • SYSTEM CONFIGURATION DIRECTORY: /etc
    • RUBYGEMS PLATFORMS:
      • ruby
      • x86_64-linux
    • GEM PATHS:
      • /opt/manageiq/manageiq-gemset
      • /usr/share/gems
      • /usr/local/share/gems
    • GEM CONFIGURATION:
      • :update_sources => true
      • :verbose => true
      • :backtrace => false
      • :bulk_threshold => 1000
      • "gem" => "--install-dir=/usr/local/share/gems --bindir /usr/local/bin"
    • REMOTE SOURCES:
    • SHELL PATH:
      • /opt/manageiq/manageiq-gemset/bin
      • /usr/local/sbin
      • /usr/local/bin
      • /usr/sbin
      • /usr/bin
      • /root/bin

        ruby -v

        ruby 3.0.4p208 (2022-04-12 revision 3fa771dded) [x86_64-linux]`