Icinga / icinga2

The core of our monitoring platform with a powerful configuration language and REST API.
https://icinga.com/docs/icinga2/latest
GNU General Public License v2.0
2.03k stars 578 forks source link

check_disk on CentOS 7 reports a value of 0.00 #7720

Closed Spaghetti-Noodle-Kitty closed 4 years ago

Spaghetti-Noodle-Kitty commented 4 years ago

Describe the bug

All CentOS7-Clients in our network (productive & test) report a value of 0.00 on a check_disk. Issues appear as the critical-/warning-threshold gets triggered. On our reference-machines (Ubuntu Server 19.04, Archlinux), the value appears correctly.

To Reproduce

Provide a link to a live example, or an unambiguous set of steps to reproduce this bug. Include configuration, logs, etc. to reproduce, if relevant.

  1. Install CentOS7-minimal on VM with 4GB RAM
  2. Install all nagios-plugins and add nrpe on your client
  3. Connect to nrpe of the client and add a check_disk-Check
  4. (Install graphite, nrpe and icingaweb on your master)

Expected behavior

Values should be coherent with Plugin-Output

Your Environment

Include as many relevant details about the environment you experienced the problem in

Al2Klimov commented 4 years ago

Hello @Sudo-Means-Please and thank you for reporting!

Please figure out the exact command Icinga 2 / NRPE / whatever executed...

➜  icinga2 git:(master) prefix/sbin/icinga2 daemon -x notice
[2019-12-17 15:05:25 +0100] information/cli: Icinga application loader (version: v2.11.0-442-gcd44c5371; debug)
[2019-12-17 15:05:25 +0100] notice/cli: Spawning seemless worker process doing the actual work
[2019-12-17 15:05:25 +0100] notice/cli: Spawned worker process (PID 25581), waiting for it to load its config
[2019-12-17 15:05:25 +0100] information/cli: Loading configuration file(s).
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/icinga2.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/constants.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/zones.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/itl
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/command-icinga.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/command-plugins.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/big-data.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/databases.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/hardware.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/icingacli.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/ipmi.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/logmanagement.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/metrics.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/network-components.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/network-services.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/operating-system.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/raid-controller.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/smart-attributes.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/storage.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/virtualization.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/vmware.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/plugins-contrib.d/web.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/manubulon
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/command-plugins-manubulon.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/windows-plugins
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/command-plugins-windows.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/nscp
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/share/icinga2/include/command-nscp-local.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/features-enabled/checker.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/features-enabled/mainlog.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/features-enabled/notification.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/conf.d/app.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/conf.d/commands.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/conf.d/downtimes.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/conf.d/groups.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/conf.d/hosts.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/conf.d/notifications.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/conf.d/services.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/conf.d/templates.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/conf.d/timeperiods.conf
[2019-12-17 15:05:25 +0100] notice/ConfigCompiler: Compiling config file: /Users/aklimov/NET/WS/icinga2/prefix/etc/icinga2/conf.d/users.conf
[2019-12-17 15:05:25 +0100] information/ConfigItem: Committing config item(s).
[2019-12-17 15:05:25 +0100] notice/WorkQueue: Spawning WorkQueue threads for 'DaemonUtility::LoadConfigFiles'
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 1 UserGroup.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 3 TimePeriods.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 1 ScheduledDowntime.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 1 CheckerComponent.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 235 CheckCommands.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 1 FileLogger.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 1 Host.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 2 HostGroups.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 1 Endpoint.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 1 IcingaApplication.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 12 Notifications.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 2 NotificationCommands.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 11 Services.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 3 ServiceGroups.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 3 Zones.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 1 User.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Instantiated 1 NotificationComponent.
[2019-12-17 15:05:25 +0100] information/ScriptGlobal: Dumping variables to file '/Users/aklimov/NET/WS/icinga2/prefix/var/cache/icinga2/icinga2.vars'
[2019-12-17 15:05:25 +0100] notice/WorkQueue: Stopped WorkQueue threads for 'DaemonUtility::LoadConfigFiles'
[2019-12-17 15:05:25 +0100] notice/cli: Notifying umbrella process (PID 25566) about the config loading success
[2019-12-17 15:05:25 +0100] notice/cli: Worker process successfully loaded its config
[2019-12-17 15:05:25 +0100] notice/cli: Waiting for the umbrella process to let us doing the actual work
[2019-12-17 15:05:25 +0100] notice/cli: The umbrella process let us continuing
[2019-12-17 15:05:25 +0100] information/ConfigItem: Triggering Start signal for config items
[2019-12-17 15:05:25 +0100] information/FileLogger: 'main-log' started.
[2019-12-17 15:05:25 +0100] information/NotificationComponent: 'notification' started.
[2019-12-17 15:05:25 +0100] information/CheckerComponent: 'checker' started.
[2019-12-17 15:05:25 +0100] information/ConfigItem: Activated all objects.
[2019-12-17 15:05:25 +0100] notice/WorkQueue: Stopped WorkQueue threads for 'DaemonCommand::Run'
[2019-12-17 15:05:25 +0100] notice/ConfigObjectUtility: Package _api doesn't exist yet, creating it.
[2019-12-17 15:05:25 +0100] notice/ApiListener: Updating object authority for local objects.
[2019-12-17 15:05:25 +0100] notice/Process: Running command '/Users/aklimov/NET/WS/icinga2/prefix/usr/lib/nagios/plugins/check_ping' '-H' '127.0.0.1' '-c' '5000,100%' '-w' '3000,80%': PID 25583
[2019-12-17 15:05:25 +0100] notice/Process: PID 25583 ('/Users/aklimov/NET/WS/icinga2/prefix/usr/lib/nagios/plugins/check_ping' '-H' '127.0.0.1' '-c' '5000,100%' '-w' '3000,80%') terminated with exit code 3
[2019-12-17 15:05:25 +0100] notice/Checkable: State Change: Checkable 'alexandersmbp2.int.netways.de' soft state change from DOWN to DOWN detected.
[2019-12-17 15:05:28 +0100] notice/Process: Running command '/Users/aklimov/NET/WS/icinga2/prefix/usr/lib/nagios/plugins/check_http' '-I' '127.0.0.1' '-u' '/': PID 25592
[2019-12-17 15:05:28 +0100] notice/Process: PID 25592 ('/Users/aklimov/NET/WS/icinga2/prefix/usr/lib/nagios/plugins/check_http' '-I' '127.0.0.1' '-u' '/') terminated with exit code 2
[2019-12-17 15:05:28 +0100] notice/Checkable: State Change: Checkable 'alexandersmbp2.int.netways.de!http' soft state change from UNKNOWN to CRITICAL detected.
[2019-12-17 15:05:30 +0100] notice/CheckerComponent: Pending checkables: 0; Idle checkables: 12; Checks/s: 0.0333333
^C[2019-12-17 15:05:32 +0100] notice/cli: Got signal 2, forwarding to seemless worker (PID 25581)
[2019-12-17 15:05:32 +0100] information/Application: Received request to shut down.
[2019-12-17 15:05:33 +0100] information/Application: Shutting down...
[2019-12-17 15:05:33 +0100] information/CheckerComponent: 'checker' stopped.
[2019-12-17 15:05:33 +0100] information/NotificationComponent: 'notification' stopped.
[2019-12-17 15:05:33 +0100] information/ConfigObject: Dumping program state to file '/Users/aklimov/NET/WS/icinga2/prefix/var/lib/icinga2/icinga2.state'
[2019-12-17 15:05:33 +0100] information/IcingaApplication: Icinga has shut down.
[2019-12-17 15:05:33 +0100] notice/cli: Seemless worker (PID 25581) stopped, stopping as well
➜  icinga2 git:(master)

... and run it by yourself on the shell.

Do you still get the same result?

If yes, please share the command.

Best, AK

dnsmichi commented 4 years ago

check_disk is part of the nagios/monitoring plugins project, please report an issue with them.