Icinga / icinga2

The core of our monitoring platform with a powerful configuration language and REST API.
https://icinga.com/docs/icinga2/latest
GNU General Public License v2.0
2.03k stars 579 forks source link

[dev.icinga.com #10643] Icinga 2 crashes when ScheduledDowntime objects are used #3671

Closed icinga-migration closed 9 years ago

icinga-migration commented 9 years ago

This issue has been migrated from Redmine: https://dev.icinga.com/issues/10643

Created by smtalk on 2015-11-16 13:05:23 +00:00

Assignee: gbeutner Status: Resolved (closed on 2015-11-25 12:24:18 +00:00) Target Version: 2.4.1 Last Update: 2015-11-25 12:24:18 +00:00 (in Redmine)

Icinga Version: 2.4.0
Backport?: Not yet backported
Include in Changelog: 1

A simple ScheduledDowntime like the following causes icinga2 to segfault on start-up:

apply ScheduledDowntime "backup-downtime" to Service {
  author = "name"
  comment = "Scheduled downtime for backups"

  ranges = {
    monday = "01:30-05:00"
    tuesday = "01:30-05:00"
    wednesday = "01:30-05:00"
    thursday = "01:30-05:00"
    friday = "01:30-05:00"
    saturday = "01:30-05:00"
    sunday = "01:30-05:00"
  }

  assign where host.vars.hostgroup == "servergroup"
}

Attaching gdb output.

Attachments

Changesets

2015-11-19 18:38:49 +00:00 by (unknown) 3505ca3c165bfb6102565a02747a2cb1be0792c8

Fix race condition in the ConfigItem class

fixes #10643

2015-11-19 19:25:10 +00:00 by (unknown) c9f175790f7dcb3299a6d23158e287f33dfef558

Fix unit tests for livestatus

refs #10643

2015-11-23 13:02:33 +00:00 by mfriedrich d0545c4ea2fdc83978dc2ca29f6fffcd107ab05f

Fix crash in ConfigItem::ActivateItems

refs #10643

2015-11-23 16:25:35 +00:00 by (unknown) 4ab6f2a9855b8269367082e84b5437a42cf84890

Fix crash in ConfigItem::ActivateItems

refs #10643

2015-11-25 12:22:32 +00:00 by (unknown) 33fbd6c877ddfc967832726727afb1f74a0dafbf

Fix race condition in the ConfigItem class

fixes #10643

2015-11-25 12:22:42 +00:00 by (unknown) efe014aa7ef665f76488053b321ba98db847b774

Fix unit tests for livestatus

refs #10643

2015-11-25 12:22:55 +00:00 by mfriedrich d3aae8132330e831d882b36982ee43cf8f19a383

Fix crash in ConfigItem::ActivateItems

refs #10643

2015-11-25 12:23:04 +00:00 by (unknown) 21cb5690f5b2d53aad4698af8f9366c62574eb85

Fix crash in ConfigItem::ActivateItems

refs #10643

Relations:

icinga-migration commented 9 years ago

Updated by gbeutner on 2015-11-16 13:08:16 +00:00

icinga-migration commented 9 years ago

Updated by gbeutner on 2015-11-16 13:19:54 +00:00

icinga-migration commented 9 years ago

Updated by smtalk on 2015-11-16 13:39:50 +00:00

Attached additional output from gdb.

icinga-migration commented 9 years ago

Updated by gbeutner on 2015-11-16 19:30:08 +00:00

I managed to find a reliable way to reproduce this: Basically you just need a ScheduledDowntime which applies to lots of services. Oops.

icinga-migration commented 9 years ago

Updated by gbeutner on 2015-11-16 19:30:20 +00:00

icinga-migration commented 9 years ago

Updated by mfriedrich on 2015-11-16 23:03:05 +00:00

Hm, I tried with 10000 Hosts/Services and 10000 ScheduledDowntimes, it happens occasionally. bt all attached.

for (i in range(10000)) {
  object Host "downtime-test-" + i {
    check_command = "dummy"
  }
}

apply Service "downtime-test" {
  import "generic-service"

  check_command = "load"

  /* Used by the ScheduledDowntime apply rule in `downtimes.conf`. */
  vars.backup_downtime = "02:00-03:00"

  assign where match("downtime-test*", host.name)
}
(lldb) r
There is a running process, kill it and restart?: \[Y/n\] y
Process 36996 exited with status = 9 (0x00000009)
Process 37048 launched: '/usr/local/icinga2/lib/icinga2/sbin/icinga2' (x86\_64)
\[2015-11-16 23:57:39 +0100\] information/cli: Icinga application loader (version: v2.3.11-854-ge9db4bc; debug)
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/icinga2.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/constants.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/zones.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/itl
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/command.conf
\[2015-11-16 23:57:39 +0100\] information/Utility: Loading library 'libmethods.dylib'
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/command-icinga.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/timeperiod.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/plugins
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/command-plugins.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/plugins-contrib
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/plugins-contrib.d/databases.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/plugins-contrib.d/hardware.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/plugins-contrib.d/ipmi.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/plugins-contrib.d/network-components.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/plugins-contrib.d/operating-system.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/plugins-contrib.d/virtualization.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/plugins-contrib.d/vmware.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/share/icinga2/include/plugins-contrib.d/web.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/features-enabled/api.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/features-enabled/checker.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/features-enabled/command.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/features-enabled/ido-mysql.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/features-enabled/livestatus.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/features-enabled/mainlog.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/features-enabled/notification.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/features-enabled/perfdata.conf
\[2015-11-16 23:57:39 +0100\] information/Utility: Loading library 'libchecker.dylib'
\[2015-11-16 23:57:39 +0100\] information/Utility: Loading library 'libcompat.dylib'
\[2015-11-16 23:57:39 +0100\] information/Utility: Loading library 'libdb\_ido\_mysql.dylib'
\[2015-11-16 23:57:39 +0100\] information/Utility: Loading library 'liblivestatus.dylib'
\[2015-11-16 23:57:39 +0100\] information/Utility: Loading library 'libnotification.dylib'
\[2015-11-16 23:57:39 +0100\] information/Utility: Loading library 'libperfdata.dylib'
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/api-users.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/app.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/aws.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/commands.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/comments.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/downtimes.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/groups.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/hosts.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/notifications.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/satellite.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/services.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/templates.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/test.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/timeperiods.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/conf.d/users.conf
\[2015-11-16 23:57:39 +0100\] information/config: \[\]
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/tests/10237.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/tests/8183.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/tests/dep.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/tests/downtime.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/tests/groups.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/tests/mw.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/etc/icinga2/tests/random.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/include.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/include.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/../active.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/comments/mbmif.int.netways.de!bla.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/mbmif.int.netways.de![](load)mbmif.int.netways.de-1447680161-0.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/hosts/bumsti1.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/hosts/google.com.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/hosts/google.com1.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/hosts/google.com2.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/hosts/google.com3.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/hosts/google.com4.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/hosts/i-42866686.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/hosts/i-43866687.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/hosts/michiathome1.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/services/bumsti1!ping7.conf
\[2015-11-16 23:57:39 +0100\] information/ConfigItem: Committing config items
\[2015-11-16 23:57:39 +0100\] information/ApiListener: My API identity: mbmif.int.netways.de
\[2015-11-16 23:57:50 +0100\] warning/ConfigObject: Ignoring config object 'foo' of type 'Comment' due to errors: Error: Comment 'mbmif.int.netways.de![](abc)foo' references a host/service which doesn't exist.
Location: in /usr/local/icinga2/etc/icinga2/conf.d/comments.conf: 1:0-1:35
/usr/local/icinga2/etc/icinga2/conf.d/comments.conf(1): object Comment "foo" ignore\_on\_error {

/usr/local/icinga2/etc/icinga2/conf.d/comments.conf(2): host\_name = NodeName
/usr/local/icinga2/etc/icinga2/conf.d/comments.conf(3): service\_name = "abc"

\[2015-11-16 23:57:53 +0100\] warning/ApplyRule: Apply rule 'satellite-host' (in /usr/local/icinga2/etc/icinga2/conf.d/satellite.conf: 29:1-29:41) for type 'Dependency' does not match anywhere!
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 1 PerfdataWriter.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 1 Endpoint.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 1 Zone.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 1 ApiListener.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 1 FileLogger.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 1 ApiUser.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 1 CheckerComponent.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 20068 Dependencies.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 1 Downtime.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 10001 ScheduledDowntimes.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 10044 Services.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 3 ServiceGroups.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 3 TimePeriods.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 14 Users.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 3 UserGroups.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 10024 Hosts.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 6 HostGroups.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 1 IcingaApplication.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 154 CheckCommands.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 2 NotificationCommands.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 11 Notifications.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 2 Comments.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 1 LivestatusListener.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 1 ExternalCommandListener.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 1 IdoMysqlConnection.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Instantiated 1 NotificationComponent.
\[2015-11-16 23:57:53 +0100\] information/ScriptGlobal: Dumping variables to file '/usr/local/icinga2/var/cache/icinga2/icinga2.vars'
\[2015-11-16 23:57:53 +0100\] information/ConfigObject: Restoring program state from file '/usr/local/icinga2/var/lib/icinga2/icinga2.state'
\[2015-11-16 23:57:53 +0100\] information/ConfigObject: Restored 347 objects. Loaded 50000 new objects without state.
\[2015-11-16 23:57:53 +0100\] information/ConfigItem: Triggering Start signal for config items
\[2015-11-16 23:57:53 +0100\] information/ApiListener: Adding new listener on port '5665'
\[2015-11-16 23:57:53 +0100\] information/DbConnection: Resuming IDO connection: ido-mysql
\[2015-11-16 23:57:53 +0100\] information/LivestatusListener: Created UNIX socket in '/usr/local/icinga2/var/run/icinga2/cmd/livestatus'.
\[2015-11-16 23:57:53 +0100\] information/IdoMysqlConnection: MySQL IDO instance id: 1 (schema version: '1.14.0')
\[2015-11-16 23:58:02 +0100\] warning/ThreadPool: Event call took 1.01628s
\[2015-11-16 23:58:02 +0100\] warning/ThreadPool: Event call took 1.08741s
\[2015-11-16 23:58:02 +0100\] warning/ThreadPool: Event call took 1.04936s
\[2015-11-16 23:58:02 +0100\] warning/ThreadPool: Event call took 1.11633s
\[2015-11-16 23:58:11 +0100\] warning/ThreadPool: Event call took 1.36492s
\[2015-11-16 23:58:11 +0100\] warning/ThreadPool: Event call took 1.34559s
\[2015-11-16 23:58:11 +0100\] warning/ThreadPool: Event call took 1.32312s
\[2015-11-16 23:58:11 +0100\] warning/ThreadPool: Event call took 1.20628s
\[2015-11-16 23:58:11 +0100\] warning/ThreadPool: Event call took 1.16845s
\[2015-11-16 23:58:11 +0100\] warning/ThreadPool: Event call took 1.15273s
\[2015-11-16 23:58:11 +0100\] warning/ThreadPool: Event call took 1.14954s
\[2015-11-16 23:58:11 +0100\] warning/ThreadPool: Event call took 0.995731s
\[2015-11-16 23:58:11 +0100\] warning/ThreadPool: Event call took 0.961489s
\[2015-11-16 23:58:11 +0100\] warning/ThreadPool: Event call took 0.884725s
\[2015-11-16 23:58:11 +0100\] warning/ThreadPool: Event call took 0.90953s
\[2015-11-16 23:58:11 +0100\] warning/ThreadPool: Event call took 1.46962s
\[2015-11-16 23:58:12 +0100\] information/ConfigItem: Activated all objects.
\[2015-11-16 23:58:12 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/modified-attributes.conf
\[2015-11-16 23:58:12 +0100\] warning/ThreadPool: Event call took 0.789942s
\[2015-11-16 23:58:12 +0100\] warning/ThreadPool: Event call took 0.788701s
\[2015-11-16 23:58:12 +0100\] warning/ThreadPool: Event call took 0.730965s
\[2015-11-16 23:58:12 +0100\] warning/ThreadPool: Event call took 0.727265s
\[2015-11-16 23:58:12 +0100\] warning/ThreadPool: Event call took 0.693313s
\[2015-11-16 23:58:12 +0100\] warning/ThreadPool: Event call took 0.698681s
\[2015-11-16 23:58:12 +0100\] warning/ThreadPool: Event call took 0.675778s
\[2015-11-16 23:58:12 +0100\] warning/ThreadPool: Event call took 0.656079s
\[2015-11-16 23:58:12 +0100\] warning/ThreadPool: Event call took 0.656884s
\[2015-11-16 23:58:12 +0100\] warning/ThreadPool: Event call took 0.613226s
\[2015-11-16 23:58:12 +0100\] warning/ThreadPool: Event call took 0.587006s
\[2015-11-16 23:58:12 +0100\] warning/ThreadPool: Event call took 1.12535s
\[2015-11-16 23:58:15 +0100\] warning/ThreadPool: Event call took 1.71333s
\[2015-11-16 23:58:16 +0100\] warning/ThreadPool: Event call took 1.32616s
\[2015-11-16 23:58:19 +0100\] information/Notification: Sending notification 'mbmif.int.netways.de![](ssh)mail-icingaadmin' for user 'icingaadmin'
\[2015-11-16 23:58:19 +0100\] information/Notification: Sending notification 'mbmif.int.netways.de![](ssh)mail-icingaadmin' for user 'icingaadmin2'
\[2015-11-16 23:58:19 +0100\] information/Notification: Sending notification 'mbmif.int.netways.de![](disk)mail-icingaadmin' for user 'icingaadmin'
\[2015-11-16 23:58:19 +0100\] information/Notification: Sending notification 'mbmif.int.netways.de![](disk)mail-icingaadmin' for user 'icingaadmin2'
\[2015-11-16 23:58:19 +0100\] information/Notification: Sending notification 'mbmif.int.netways.de![](procs)mail-icingaadmin' for user 'icingaadmin'
\[2015-11-16 23:58:19 +0100\] information/Notification: Sending notification 'mbmif.int.netways.de![](procs)mail-icingaadmin' for user 'icingaadmin2'
\[2015-11-16 23:58:19 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/downtime-test-100![](downtime-test)mbmif.local-1447714699-0.conf
\[2015-11-16 23:58:19 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/downtime-test-0![](downtime-test)mbmif.local-1447714699-1.conf
\[2015-11-16 23:58:19 +0100\] information/ConfigItem: Committing config items
\[2015-11-16 23:58:19 +0100\] information/ConfigItem: Committing config items
\[2015-11-16 23:58:19 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/downtime-test-10![](downtime-test)mbmif.local-1447714699-2.conf
\[2015-11-16 23:58:19 +0100\] information/ConfigItem: Committing config items
\[2015-11-16 23:58:19 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/downtime-test-1005![](downtime-test)mbmif.local-1447714699-4.conf
\[2015-11-16 23:58:19 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/downtime-test-1![](downtime-test)mbmif.local-1447714699-3.conf
\[2015-11-16 23:58:19 +0100\] information/ConfigItem: Committing config items
\[2015-11-16 23:58:19 +0100\] warning/ApplyRule: Apply rule 'satellite-host' (in /usr/local/icinga2/etc/icinga2/conf.d/satellite.conf: 29:1-29:41) for type 'Dependency' does not match anywhere!
\[2015-11-16 23:58:19 +0100\] information/ConfigItem: Triggering Start signal for config items
\[2015-11-16 23:58:19 +0100\] information/ConfigItem: Committing config items
\[2015-11-16 23:58:19 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/downtime-test-1007![](downtime-test)mbmif.local-1447714699-5.conf
\[2015-11-16 23:58:19 +0100\] warning/ApplyRule: Apply rule 'satellite-host' (in /usr/local/icinga2/etc/icinga2/conf.d/satellite.conf: 29:1-29:41) for type 'Dependency' does not match anywhere!
\[2015-11-16 23:58:19 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/downtime-test-1006![](downtime-test)mbmif.local-1447714699-6.conf
\[2015-11-16 23:58:19 +0100\] information/ConfigItem: Committing config items
\[2015-11-16 23:58:19 +0100\] information/ConfigItem: Committing config items
\[2015-11-16 23:58:19 +0100\] warning/ApplyRule: Apply rule 'satellite-host' (in /usr/local/icinga2/etc/icinga2/conf.d/satellite.conf: 29:1-29:41) for type 'Dependency' does not match anywhere!
\[2015-11-16 23:58:19 +0100\] warning/ApplyRule: Apply rule 'satellite-host' (in /usr/local/icinga2/etc/icinga2/conf.d/satellite.conf: 29:1-29:41) for type 'Dependency' does not match anywhere!
\[2015-11-16 23:58:20 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/downtime-test-1035![](downtime-test)mbmif.local-1447714700-8.conf
\[2015-11-16 23:58:20 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/downtime-test-1034![](downtime-test)mbmif.local-1447714700-7.conf
\[2015-11-16 23:58:20 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/downtime-test-1036![](downtime-test)mbmif.local-1447714700-9.conf
\[2015-11-16 23:58:20 +0100\] information/ConfigItem: Committing config items
\[2015-11-16 23:58:20 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/downtime-test-1058![](downtime-test)mbmif.local-1447714700-11.conf
\[2015-11-16 23:58:20 +0100\] information/ConfigItem: Committing config items
\[2015-11-16 23:58:20 +0100\] information/ConfigCompiler: Compiling config file: /usr/local/icinga2/var/lib/icinga2/api/packages/\_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/downtime-test-1033![](downtime-test)mbmif.local-1447714700-10.conf
\[2015-11-16 23:58:20 +0100\] information/ConfigItem: Committing config items
\[2015-11-16 23:58:20 +0100\] warning/ApplyRule: Apply rule 'satellite-host' (in /usr/local/icinga2/etc/icinga2/conf.d/satellite.conf: 29:1-29:41) for type 'Dependency' does not match anywhere!
\[2015-11-16 23:58:20 +0100\] warning/ApplyRule: Apply rule 'satellite-host' (in /usr/local/icinga2/etc/icinga2/conf.d/satellite.conf: 29:1-29:41) for type 'Dependency' does not match anywhere!
\[2015-11-16 23:58:20 +0100\] information/ConfigItem: Committing config items
\[2015-11-16 23:58:20 +0100\] warning/ApplyRule: Apply rule 'satellite-host' (in /usr/local/icinga2/etc/icinga2/conf.d/satellite.conf: 29:1-29:41) for type 'Dependency' does not match anywhere!
\[2015-11-16 23:58:20 +0100\] information/ConfigItem: Committing config items
Assertion failed: (px != 0), function operator->, file /usr/local/include/boost/smart\_ptr/intrusive\_ptr.hpp, line 174.
Process 37048 stopped

-   thread \#49: tid = 0x4a328c, 0x00007fff8db260ae libsystem\_kernel.dylib\`\_\_pthread\_kill + 10, stop reason = signal SIGABRT
    frame \#0: 0x00007fff8db260ae libsystem\_kernel.dylib\`\_\_pthread\_kill + 10
    libsystem\_kernel.dylib\`\_\_pthread\_kill:
    -> 0x7fff8db260ae <+10>: jae 0x7fff8db260b8 ; <+20>
    0x7fff8db260b0 <+12>: movq %rax, %rdi
    0x7fff8db260b3 <+15>: jmp 0x7fff8db213ef ; cerror\_nocancel
    0x7fff8db260b8 <+20>: retq
    (lldb) thread apply all full
    invalid command 'thread apply'.
    (lldb) bt thread apply all full
    error: bt \[|all\]
    (lldb) bt all thread apply all
    error: bt \[|all\]
    (lldb) bt all
    error: bt \[|all\]
    (lldb) bt all
    warning: could not load any Objective-C class information. This will significantly reduce the quality of type information available.
    thread \#1: tid = 0x4a0a22, 0x00007fff8db262b2 libsystem\_kernel.dylib\`\_\_semwait\_signal + 10, queue = 'com.apple.main-thread'
    frame \#0: 0x00007fff8db262b2 libsystem\_kernel.dylib\`\_\_semwait\_signal + 10
    frame \#1: 0x00007fff85c38a75 libsystem\_c.dylib\`nanosleep + 199
    frame \#2: 0x00007fff85c38968 libsystem\_c.dylib\`usleep + 54
    frame \#3: 0x000000010114293b libbase.dylib\`icinga::Utility::Sleep(timeout=2.5) + 43 at utility.cpp:384
    frame \#4: 0x0000000100f36983 libbase.dylib\`icinga::Application::RunEventLoop(this=0x00000001076852f0) + 115 at application.cpp:283
    frame \#5: 0x0000000103a9bbbf libicinga.dylib\`icinga::IcingaApplication::Main(this=0x00000001076852f0) + 1391 at icingaapplication.cpp:119
    frame \#6: 0x0000000100f3db62 libbase.dylib\`icinga::Application::Run(this=0x00000001076852f0) + 674 at application.cpp:973
    frame \#7: 0x000000010032a03c libcli.dylib\`icinga::DaemonCommand::Run(this=0x0000000101c084c0, vm=0x00007fff5fbfe8c0, ap=size=0) const + 7804 at daemoncommand.cpp:287
    frame \#8: 0x000000010000c7a3 icinga2\`Main() + 26819 at icinga.cpp:495
    frame \#9: 0x000000010000cbbb icinga2\`main(argc=2, argv=0x00007fff5fbff7d0) + 267 at icinga.cpp:761
    frame \#10: 0x00007fff92b8d5ad libdyld.dylib\`start + 1

thread [\#2:](https://dev.icinga.com/issues/2) tid = 0x4a0a2d, 0x00007fff8db25f8e libsystem\_kernel.dylib\`\_\_psynch\_mutexwait + 10
frame [\#0:](https://dev.icinga.com/issues/0) 0x00007fff8db25f8e libsystem\_kernel.dylib\`\_\_psynch\_mutexwait + 10
frame [\#1:](https://dev.icinga.com/issues/1) 0x00007fff899f8e5f libsystem\_pthread.dylib\`\_pthread\_mutex\_lock\_wait + 89
frame [\#2:](https://dev.icinga.com/issues/2) 0x000000010459955d libchecker.dylib\`boost::mutex::lock() \[inlined\] boost::posix::pthread\_mutex\_lock(m=0x0000000107473be0) + 9 at mutex.hpp:62
frame [\#3:](https://dev.icinga.com/issues/3) 0x0000000104599554 libchecker.dylib\`boost::mutex::lock(this=0x0000000107473be0) + 20 at mutex.hpp:116
frame [\#4:](https://dev.icinga.com/issues/4) 0x0000000104573d23 libchecker.dylib\`boost::unique\_lock::lock(this=0x000070000007ef30) + 227 at lock\_types.hpp:346
frame [\#5:](https://dev.icinga.com/issues/5) 0x000000010459d407 libchecker.dylib\`boost::unique\_lock::unique\_lock(this=0x000070000007ef30, m\_=0x0000000107473be0) + 39 at lock\_types.hpp:124
frame [\#6:](https://dev.icinga.com/issues/6) 0x0000000104572ead libchecker.dylib\`boost::unique\_lock::unique\_lock(this=0x000070000007ef30, m\_=0x0000000107473be0) + 29 at lock\_types.hpp:123
frame [\#7:](https://dev.icinga.com/issues/7) 0x000000010456e48c libchecker.dylib\`icinga::CheckerComponent::NextCheckChangedHandler(this=0x0000000107473ad0, checkable=0x000070000007f810) + 60 at checkercomponent.cpp:284
frame [\#8:](https://dev.icinga.com/issues/8) 0x00000001045bd95a libchecker.dylib\`boost::\_mfi::mf1 const&>::operator(this=0x0000000107459640, p=0x0000000107473ad0, a1=0x000070000007f810)(icinga::CheckerComponent\*, boost::intrusive\_ptr const&) const + 122 at mem\_fn\_template.hpp:165
frame [\#9:](https://dev.icinga.com/issues/9) 0x00000001045bd7fb libchecker.dylib\`void boost::\_bi::list2, boost::arg<1> >::operator(this=0x0000000107459650, (null)=type @ 0x000070000007efd8, f=0x0000000107459640, a=0x000070000007f008, (null)=0) const&>, boost::\_bi::list2 const&, icinga::Value const&> >(boost::\_bi::type, boost::\_mfi::mf1 const&>&, boost::\_bi::list2 const&, icinga::Value const&>&, int) + 107 at bind.hpp:313
frame [\#10:](https://dev.icinga.com/issues/10) 0x00000001045bd747 libchecker.dylib\`void boost::\_bi::bind\_t const&>, boost::\_bi::list2, boost::arg<1> > >::operator(this=0x0000000107459640, a1=0x000070000007f810, a2=0x00000001011c0a40) const&, icinga::Value const&>(boost::intrusive\_ptr const&&&, icinga::Value const&&&) + 87 at bind.hpp:917
frame [\#11:](https://dev.icinga.com/issues/11) 0x00000001045bd4ed libchecker.dylib\`boost::detail::function::void\_function\_obj\_invoker2 const&>, boost::\_bi::list2, boost::arg<1> > >, void, boost::intrusive\_ptr const&, icinga::Value const&>::invoke(function\_obj\_ptr=0x0000000107459640, a0=0x000070000007f810, a1=0x00000001011c0a40) + 77 at function\_template.hpp:159
frame [\#12:](https://dev.icinga.com/issues/12) 0x00000001038e8b93 libicinga.dylib\`boost::function2 const&, icinga::Value const&>::operator(this=0x0000000107459638, a0=0x000070000007f810, a1=0x00000001011c0a40)(boost::intrusive\_ptr const&, icinga::Value const&) const + 179 at function\_template.hpp:772
frame [\#13:](https://dev.icinga.com/issues/13) 0x00000001038e8ad8 libicinga.dylib\`boost::signals2::detail::void\_type boost::signals2::detail::call\_with\_tuple\_args::m\_invoke @ 0x000070000007f120, args=tuple &, const icinga::Value &> @ 0x000070000007f110)>, 0u, 1u, boost::intrusive\_ptr const&, icinga::Value const&>(void\*, boost::function const&, icinga::Value const&)>&, boost::signals2::detail::unsigned\_meta\_array<0u, 1u>, std::\_\_1::tuple const&, icinga::Value const&>) const + 88 at variadic\_slot\_invoker.hpp:92
frame [\#14:](https://dev.icinga.com/issues/14) 0x00000001038e8a4e libicinga.dylib\`boost::signals2::detail::void\_type boost::signals2::detail::call\_with\_tuple\_args::operator(this=0x000070000007f298, func=0x0000000107459638, args=tuple &, const icinga::Value &> @ 0x000070000007f1a0, (null)=size\_t<2> @ 0x000070000007f198) const&, icinga::Value const&)>, boost::intrusive\_ptr const&, icinga::Value const&, 2ul>(boost::function const&, icinga::Value const&)>&, std::\_*1::tuple const&, icinga::Value const&>, mpl*::size\_t<2ul>) const + 334 at variadic\_slot\_invoker.hpp:81
frame [\#15:](https://dev.icinga.com/issues/15) 0x00000001038e88fa libicinga.dylib\`boost::signals2::detail::void\_type boost::signals2::detail::variadic\_slot\_invoker const&, icinga::Value const&>::m\_invoke >, boost::signals2::slot const&, icinga::Value const&)> >, boost::signals2::mutex> > >(boost::shared\_ptr >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> > const&, boost::signals2::detail::void\_type const\*) const + 90 at variadic\_slot\_invoker.hpp:127
frame [\#16:](https://dev.icinga.com/issues/16) 0x00000001038e8899 libicinga.dylib\`boost::signals2::detail::void\_type boost::signals2::detail::variadic\_slot\_invoker const&, icinga::Value const&>::operator(this=0x000070000007f790, connectionBody=0x0000000107463a90) >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> > >(boost::shared\_ptr >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> > const&) const + 41 at variadic\_slot\_invoker.hpp:119
frame [\#17:](https://dev.icinga.com/issues/17) 0x00000001038e879b libicinga.dylib\`boost::signals2::detail::slot\_call\_iterator\_t const&, icinga::Value const&>, std::\_*1::*\_list\_iterator >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >, void\*>, boost::signals2::detail::connection\_body >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >::dereference(this=0x000070000007f420) const + 107 at slot\_call\_iterator.hpp:82
frame [\#18:](https://dev.icinga.com/issues/18) 0x00000001038e8705 libicinga.dylib\`boost::signals2::detail::slot\_call\_iterator\_t const&, icinga::Value const&>, std::\_*1::list\_iterator >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >, void**, boost::signals2::detail::connection\_body >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >::reference boost::iterators::iterator\_core\_access::dereference const&, icinga::Value const&>, std::\_*1::*\_list\_iterator >, boost::signals2::slot const&, icinga::Value const&)> >, boost::signals2::mutex> >, void**>, boost::signals2::detail::connection\_body >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> > >(boost::signals2::detail::slot\_call\_iterator\_t const&, icinga::Value const&>, std::1::*\_list\_iterator >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >, void\*>, boost::signals2::detail::connection\_body >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> > const&) + 21 at iterator\_facade.hpp:540
frame [\#19:](https://dev.icinga.com/issues/19) 0x00000001038e863d libicinga.dylib\`boost::iterators::detail::iterator\_facade\_base const&, icinga::Value const&>, std::\_*1::*\_list\_iterator >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >, void**, boost::signals2::detail::connection\_body >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >, boost::signals2::detail::void\_type, boost::iterators::single\_pass\_traversal\_tag, boost::signals2::detail::void\_type const&, long, false, false>::operator**(this=0x000070000007f420) const + 29 at iterator\_facade.hpp:646
frame [\#20:](https://dev.icinga.com/issues/20) 0x00000001038e8575 libicinga.dylib\`void boost::signals2::optional\_last\_value::operator(this=0x00000001019053e0, first=slot\_call\_iterator\_t &, const icinga::Value &>, std::\_*1::list\_iterator >, boost::signals2::slot &, const icinga::Value &), boost::function &, const icinga::Value &)> >, boost::signals2::mutex> >, void **, boost::signals2::detail::connection\_body >, boost::signals2::slot &, const icinga::Value &), boost::function &, const icinga::Value &)> >, boost::signals2::mutex> > @ 0x000070000007f420, last=slot\_call\_iterator\_t &, const icinga::Value &>, std::\_*1::*\_list\_iterator >, boost::signals2::slot &, const icinga::Value &), boost::function &, const icinga::Value &)> >, boost::signals2::mutex> >, void**>, boost::signals2::detail::connection\_body >, boost::signals2::slot &, const icinga::Value &), boost::function &, const icinga::Value &)> >, boost::signals2::mutex> > @ 0x000070000007f440) const&, icinga::Value const&>, std::1::list\_iterator >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >, void**, boost::signals2::detail::connection\_body >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> > >(boost::signals2::detail::slot\_call\_iterator\_t const&, icinga::Value const&>, std::\_*1::*\_list\_iterator >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >, void**>, boost::signals2::detail::connection\_body >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >, boost::signals2::detail::slot\_call\_iterator\_t const&, icinga::Value const&>, std::1::*\_list\_iterator >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >, void\*>, boost::signals2::detail::connection\_body >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >) const + 69 at optional\_last\_value.hpp:55
frame [\#21:](https://dev.icinga.com/issues/21) 0x00000001038e81af libicinga.dylib\`void boost::signals2::detail::combiner\_invoker::operator(this=0x000070000007f5f8, combiner=0x00000001019053e0, first=slot\_call\_iterator\_t &, const icinga::Value &>, std::\_*1::list\_iterator >, boost::signals2::slot &, const icinga::Value &), boost::function &, const icinga::Value &)> >, boost::signals2::mutex> >, void **, boost::signals2::detail::connection\_body >, boost::signals2::slot &, const icinga::Value &), boost::function &, const icinga::Value &)> >, boost::signals2::mutex> > @ 0x000070000007f4c0, last=slot\_call\_iterator\_t &, const icinga::Value &>, std::\_*1::*\_list\_iterator >, boost::signals2::slot &, const icinga::Value &), boost::function &, const icinga::Value &)> >, boost::signals2::mutex> >, void**>, boost::signals2::detail::connection\_body >, boost::signals2::slot &, const icinga::Value &), boost::function &, const icinga::Value &)> >, boost::signals2::mutex> > @ 0x000070000007f4e0), boost::signals2::detail::slot\_call\_iterator\_t const&, icinga::Value const&>, std::1::list\_iterator >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >, void**, boost::signals2::detail::connection\_body >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> > >(boost::signals2::optional\_last\_value&, boost::signals2::detail::slot\_call\_iterator\_t const&, icinga::Value const&>, std::\_*1::*\_list\_iterator >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >, void**>, boost::signals2::detail::connection\_body >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >, boost::signals2::detail::slot\_call\_iterator\_t const&, icinga::Value const&>, std::1::*\_list\_iterator >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >, void\*>, boost::signals2::detail::connection\_body >, boost::signals2::slot const&, icinga::Value const&), boost::function const&, icinga::Value const&)> >, boost::signals2::mutex> >) const + 175 at result\_type\_wrapper.hpp:64
frame [\#22:](https://dev.icinga.com/issues/22) 0x00000001038e7f2d libicinga.dylib\`boost::signals2::detail::signal\_impl const&, icinga::Value const&), boost::signals2::optional\_last\_value, int, std::\_\_1::less, boost::function const&, icinga::Value const&)>, boost::function const&, icinga::Value const&)>, boost::signals2::mutex>::operator(this=0x0000000101905300, args=0x000070000007f810, args=0x00000001011c0a40)(boost::intrusive\_ptr const&, icinga::Value const&) + 989 at signal\_template.hpp:241
frame [\#23:](https://dev.icinga.com/issues/23) 0x00000001038dac97 libicinga.dylib\`boost::signals2::signal const&, icinga::Value const&), boost::signals2::optional\_last\_value, int, std::\_\_1::less, boost::function const&, icinga::Value const&)>, boost::function const&, icinga::Value const&)>, boost::signals2::mutex>::operator(this=0x0000000103ca76c0, args=0x000070000007f810, args=0x00000001011c0a40)(boost::intrusive\_ptr const&, icinga::Value const&) + 55 at signal\_template.hpp:718
frame [\#24:](https://dev.icinga.com/issues/24) 0x00000001038d6220 libicinga.dylib\`icinga::ObjectImpl::NotifyNextCheck(this=0x00000001035b1200, cookie=0x00000001011c0a40) + 112 at checkable.tcpp:2015
frame [\#25:](https://dev.icinga.com/issues/25) 0x00000001038d3e93 libicinga.dylib\`icinga::ObjectImpl::SetNextCheck(this=0x00000001035b1200, value=1447714751.5, suppress\_events=false, cookie=0x00000001011c0a40) + 83 at checkable.tcpp:1640
frame [\#26:](https://dev.icinga.com/issues/26) 0x0000000103b74ea7 libicinga.dylib\`icinga::Checkable::UpdateNextCheck(this=0x00000001035b1200) + 391 at checkable-check.cpp:78
frame [\#27:](https://dev.icinga.com/issues/27) 0x0000000103b7988b libicinga.dylib\`icinga::Checkable::ExecuteCheck(this=0x00000001035b1200) + 219 at checkable-check.cpp:389
frame [\#28:](https://dev.icinga.com/issues/28) 0x000000010457026e libchecker.dylib\`icinga::CheckerComponent::ExecuteCheckHelper(this=0x0000000107473ad0, checkable=0x0000000122741b28) + 62 at checkercomponent.cpp:200
frame [\#29:](https://dev.icinga.com/issues/29) 0x00000001045d4b9c libchecker.dylib\`void boost::\_mfi::mf1 const&>::call, boost::intrusive\_ptr const>(this=0x0000000122741b10, u=0x0000000122741b20, (null)=0x0000000000000000, b1=0x0000000122741b28) const + 140 at mem\_fn\_template.hpp:156
frame [\#30:](https://dev.icinga.com/issues/30) 0x00000001045d4ac1 libchecker.dylib\`void boost::\_mfi::mf1 const&>::operator(this=0x0000000122741b10, u=0x0000000122741b20, a1=0x0000000122741b28) >(boost::intrusive\_ptr&, boost::intrusive\_ptr const&) const + 49 at mem\_fn\_template.hpp:171
frame [\#31:](https://dev.icinga.com/issues/31) 0x00000001045d4a7f libchecker.dylib\`void boost::\_bi::list2 >, boost::\_bi::value > >::operator(this=0x0000000122741b20, (null)=type @ 0x0000700000080498, f=0x0000000122741b10, a=0x00007000000804c0, (null)=0) const&>, boost::\_bi::list0>(boost::\_bi::type, boost::\_mfi::mf1 const&>&, boost::\_bi::list0&, int) + 111 at bind.hpp:313
frame [\#32:](https://dev.icinga.com/issues/32) 0x00000001045d49fc libchecker.dylib\`boost::\_bi::bind\_t const&>, boost::\_bi::list2 >, boost::\_bi::value > > >::operator(this=0x0000000122741b10)() + 60 at bind.hpp:893
frame [\#33:](https://dev.icinga.com/issues/33) 0x00000001045d4750 libchecker.dylib\`boost::detail::function::void\_function\_obj\_invoker0 const&>, boost::\_bi::list2 >, boost::\_bi::value > > >, void>::invoke(function\_obj\_ptr=0x0000700000080a90) + 32 at function\_template.hpp:159
frame [\#34:](https://dev.icinga.com/issues/34) 0x0000000100f61fbb libbase.dylib\`boost::function0::operator(this=0x0000700000080a88)() const + 123 at function\_template.hpp:772
frame [\#35:](https://dev.icinga.com/issues/35) 0x000000010111abd7 libbase.dylib\`icinga::ThreadPool::WorkerThread::ThreadProc(this=0x00000001011c0e88, queue=0x00000001011c0d20) + 2311 at threadpool.cpp:138
frame [\#36:](https://dev.icinga.com/issues/36) 0x00000001011243da libbase.dylib\`boost::\_mfi::mf1::operator(this=0x0000000101c10f30, t=0x00000001011c0e88, a1=0x00000001011c0d20)(icinga::ThreadPool::WorkerThread&, icinga::ThreadPool::Queue&) const + 122 at mem\_fn\_template.hpp:186
frame [\#37:](https://dev.icinga.com/issues/37) 0x000000010112432f libbase.dylib\`void boost::\_bi::list2, boost::reference\_wrapper >::operator(this=0x0000000101c10f40, (null)=type @ 0x0000700000080e58, f=0x0000000101c10f30, a=0x0000700000080e80, (null)=0), boost::\_bi::list0>(boost::\_bi::type, boost::\_mfi::mf1&, boost::\_bi::list0&, int) + 111 at bind.hpp:313
frame [\#38:](https://dev.icinga.com/issues/38) 0x00000001011242ac libbase.dylib\`boost::\_bi::bind\_t, boost::\_bi::list2, boost::reference\_wrapper > >::operator(this=0x0000000101c10f30)() + 60 at bind.hpp:893
frame [\#39:](https://dev.icinga.com/issues/39) 0x000000010112423c libbase.dylib\`boost::detail::thread\_data, boost::\_bi::list2, boost::reference\_wrapper > > >::run(this=0x0000000101c10d30) + 28 at thread.hpp:116
frame [\#40:](https://dev.icinga.com/issues/40) 0x0000000100081715 libboost\_thread-mt.dylib\`boost::(anonymous namespace)::thread\_proxy(void\*) + 53
frame [\#41:](https://dev.icinga.com/issues/41) 0x00007fff899f89b1 libsystem\_pthread.dylib\`\_pthread\_body + 131
frame [\#42:](https://dev.icinga.com/issues/42) 0x00007fff899f892e libsystem\_pthread.dylib\`\_pthread\_start + 168
frame [\#43:](https://dev.icinga.com/issues/43) 0x00007fff899f6385 libsystem\_pthread.dylib\`thread\_start + 13

thread [\#3:](https://dev.icinga.com/issues/3) tid = 0x4a0a2e, 0x00007fff8db25f8e libsystem\_kernel.dylib\`\_\_psynch\_mutexwait + 10
frame [\#0:](https://dev.icinga.com/issues/0) 0x00007fff8db25f8e libsystem\_kernel.dylib\`\_\_psynch\_mutexwait + 10
frame [\#1:](https://dev.icinga.com/issues/1) 0x00007fff899f8e5f libsystem\_pthread.dylib\`\_pthread\_mutex\_lock\_wait + 89
frame [\#2:](https://dev.icinga.com/issues/2) 0x0000000100fe9afd libbase.dylib\`boost::mutex::lock() \[inlined\] boost::posix::pthread\_mutex\_lock(m=0x00000001011c21a0) + 9 at mutex.hpp:62
frame [\#3:](https://dev.icinga.com/issues/3) 0x0000000100fe9af4 libbase.dylib\`boost::mutex::lock(this=0x00000001011c21a0) + 20 at mutex.hpp:116
frame [\#4:](https://dev.icinga.com/issues/4) 0x0000000100fe9983 libbase.dylib\`boost::unique\_lock::lock(this=0x0000700000100910) + 227 at lock\_types.hpp:346
frame [\#5:](https://dev.icinga.com/issues/5) 0x0000000100fe9897 libbase.dylib\`boost::unique\_lock::unique\_lock(this=0x0000700000100910, m\_=0x00000001011c21a0) + 39 at lock\_types.hpp:124
frame [\#6:](https://dev.icinga.com/issues/6) 0x0000000100fe7e8d libbase.dylib\`boost::unique\_lock::unique\_lock(this=0x0000700000100910, m\_=0x00000001011c21a0) + 29 at lock\_types.hpp:123
frame [\#7:](https://dev.icinga.com/issues/7) 0x00000001010b84c9 libbase.dylib\`icinga::Process::Run(this=0x00000001223e1610, callback=0x0000700000101210)> const&) + 5145 at process.cpp:661
frame [\#8:](https://dev.icinga.com/issues/8) 0x0000000103b4e41c libicinga.dylib\`icinga::PluginUtility::ExecuteCommand(commandObj=0x0000700000101878, checkable=0x0000700000102168, cr=0x0000700000101868, macroResolvers=size=4, resolvedMacros=0x0000700000102158, useResolvedMacros=false, callback=0x0000700000101848)> const&) + 3484 at pluginutility.cpp:92
frame [\#9:](https://dev.icinga.com/issues/9) 0x0000000101f2a305 libmethods.dylib\`icinga::PluginCheckTask::ScriptFunc(checkable=0x0000700000102168, cr=0x0000700000102160, resolvedMacros=0x0000700000102158, useResolvedMacros=false) + 4757 at pluginchecktask.cpp:55
frame [\#10:](https://dev.icinga.com/issues/10) 0x0000000101f08f17 libmethods.dylib\`icinga::Value icinga::FunctionWrapperV const&, boost::intrusive\_ptr const&, boost::intrusive\_ptr const&, bool>(function=(libmethods.dylib\`icinga::PluginCheckTask::ScriptFunc(boost::intrusive\_ptr const&, boost::intrusive\_ptr const&, boost::intrusive\_ptr const&, bool) at pluginchecktask.cpp:41), arguments=size=4)(boost::intrusive\_ptr const&, boost::intrusive\_ptr const&, boost::intrusive\_ptr const&, bool), std::\_\_1::vector > const&) + 759 at functionwrapper.hpp:171
frame [\#11:](https://dev.icinga.com/issues/11) 0x0000000101f0fb6f libmethods.dylib\`icinga::Value boost::*bi::list2 const&, boost::intrusive\_ptr const&, boost::intrusive\_ptr const&, bool)>, boost::arg<1> >::operator(this=0x0000000101d035b8, (null)=type @ 0x0000700000102298, f=0x0000000101d035b0, a=0x00007000001022d8, (null)=0) const&, boost::intrusive\_ptr const&, boost::intrusive\_ptr const&, bool), std::*\_1::vector > const&), boost::\_bi::list1 > const&> >(boost::*bi::type, icinga::Value (**&)(void (**)(boost::intrusive\_ptr const&, boost::intrusive\_ptr const&, boost::intrusive\_ptr const&, bool), std::*\_1::vector > const&), boost::\_bi::list1 > const&>&, long) + 127 at bind.hpp:303
frame [\#12:](https://dev.icinga.com/issues/12) 0x0000000101f0faa4 libmethods.dylib\`icinga::Value boost::*bi::bind\_t const&, boost::intrusive\_ptr const&, boost::intrusive\_ptr const&, bool), std::*\_1::vector > const&), boost::*bi::list2 const&, boost::intrusive\_ptr const&, boost::intrusive\_ptr const&, bool)>, boost::arg<1> > >::operator(this=0x0000000101d035b0, a1=size=4) > const&>(std::*\_1::vector > const&&&) + 84 at bind.hpp:905
frame [\#13:](https://dev.icinga.com/issues/13) 0x0000000101f0f867 libmethods.dylib\`boost::detail::function::function\_obj\_invoker1 const&, boost::intrusive\_ptr const&, boost::intrusive\_ptr const&, bool), std::\_\_1::vector > const&), boost::*bi::list2 const&, boost::intrusive\_ptr const&, boost::intrusive\_ptr const&, bool)>, boost::arg<1> > >, icinga::Value, std::*\_1::vector > const&>::invoke(function\_obj\_ptr=0x0000000101d035b0, a0=size=4) + 71 at function\_template.hpp:138
frame [\#14:](https://dev.icinga.com/issues/14) 0x00000001010c7aad libbase.dylib\`boost::function1 > const&>::operator(this=0x0000000101d035a8, a0=size=4)(std::\_\_1::vector > const&) const + 173 at function\_template.hpp:772
frame [\#15:](https://dev.icinga.com/issues/15) 0x00000001010c7746 libbase.dylib\`icinga::Function::Invoke(this=0x0000000101d03550, arguments=size=4) + 54 at function.cpp:34
frame [\#16:](https://dev.icinga.com/issues/16) 0x000000010390a48f libicinga.dylib\`icinga::CheckCommand::Execute(this=0x000000010741de60, checkable=0x0000700000102d38, cr=0x0000700000102d68, resolvedMacros=0x0000700000102d30, useResolvedMacros=false) + 2127 at checkcommand.cpp:36
frame [\#17:](https://dev.icinga.com/issues/17) 0x0000000103b79d88 libicinga.dylib\`icinga::Checkable::ExecuteCheck(this=0x00000001025a7800) + 1496 at checkable-check.cpp:420
frame [\#18:](https://dev.icinga.com/issues/18) 0x000000010457026e libchecker.dylib\`icinga::CheckerComponent::ExecuteCheckHelper(this=0x0000000107473ad0, checkable=0x000000012297a5c8) + 62 at checkercomponent.cpp:200
frame [\#19:](https://dev.icinga.com/issues/19) 0x00000001045d4b9c libchecker.dylib\`void boost::\_mfi::mf1 const&>::call, boost::intrusive\_ptr const>(this=0x000000012297a5b0, u=0x000000012297a5c0, (null)=0x0000000000000000, b1=0x000000012297a5c8) const + 140 at mem\_fn\_template.hpp:156
frame [\#20:](https://dev.icinga.com/issues/20) 0x00000001045d4ac1 libchecker.dylib\`void boost::\_mfi::mf1 const&>::operator(this=0x000000012297a5b0, u=0x000000012297a5c0, a1=0x000000012297a5c8) >(boost::intrusive\_ptr&, boost::intrusive\_ptr const&) const + 49 at mem\_fn\_template.hpp:171
frame [\#21:](https://dev.icinga.com/issues/21) 0x00000001045d4a7f libchecker.dylib\`void boost::\_bi::list2 >, boost::\_bi::value > >::operator(this=0x000000012297a5c0, (null)=type @ 0x0000700000103498, f=0x000000012297a5b0, a=0x00007000001034c0, (null)=0) const&>, boost::\_bi::list0>(boost::\_bi::type, boost::\_mfi::mf1 const&>&, boost::\_bi::list0&, int) + 111 at bind.hpp:313
frame [\#22:](https://dev.icinga.com/issues/22) 0x00000001045d49fc libchecker.dylib\`boost::\_bi::bind\_t const&>, boost::\_bi::list2 >, boost::\_bi::value > > >::operator(this=0x000000012297a5b0)() + 60 at bind.hpp:893
frame [\#23:](https://dev.icinga.com/issues/23) 0x00000001045d4750 libchecker.dylib\`boost::detail::function::void\_function\_obj\_invoker0 const&>, boost::\_bi::list2 >, boost::\_bi::value > > >, void>::invoke(function\_obj\_ptr=0x0000700000103a90) + 32 at function\_template.hpp:159
frame [\#24:](https://dev.icinga.com/issues/24) 0x0000000100f61fbb libbase.dylib\`boost::function0::operator(this=0x0000700000103a88)() const + 123 at function\_template.hpp:772
frame [\#25:](https://dev.icinga.com/issues/25) 0x000000010111abd7 libbase.dylib\`icinga::ThreadPool::WorkerThread::ThreadProc(this=0x00000001011c11f0, queue=0x00000001011c1088) + 2311 at threadpool.cpp:138
frame [\#26:](https://dev.icinga.com/issues/26) 0x00000001011243da libbase.dylib\`boost::\_mfi::mf1::operator(this=0x0000000101c111a0, t=0x00000001011c11f0, a1=0x00000001011c1088)(icinga::ThreadPool::WorkerThread&, icinga::ThreadPool::Queue&) const + 122 at mem\_fn\_template.hpp:186
frame [\#27:](https://dev.icinga.com/issues/27) 0x000000010112432f libbase.dylib\`void boost::\_bi::list2, boost::reference\_wrapper >::operator(this=0x0000000101c111b0, (null)=type @ 0x0000700000103e58, f=0x0000000101c111a0, a=0x0000700000103e80, (null)=0), boost::\_bi::list0>(boost::\_bi::type, boost::\_mfi::mf1&, boost::\_bi::list0&, int) + 111 at bind.hpp:313
frame [\#28:](https://dev.icinga.com/issues/28) 0x00000001011242ac libbase.dylib\`boost::\_bi::bind\_t, boost::\_bi::list2, boost::reference\_wrapper > >::operator(this=0x0000000101c111a0)() + 60 at bind.hpp:893
frame [\#29:](https://dev.icinga.com/issues/29) 0x000000010112423c libbase.dylib\`boost::detail::thread\_data<boost::\_bi::bind\_t<void, boost::\_mfi::m            
icinga-migration commented 9 years ago

Updated by mfriedrich on 2015-11-16 23:05:08 +00:00

Ok, did not let me post the entire backtrace, attached.

icinga-migration commented 9 years ago

Updated by mfriedrich on 2015-11-16 23:06:14 +00:00

(lldb) up
frame #1: 0x00007fff899fb500 libsystem_pthread.dylib`pthread_kill + 90
libsystem_pthread.dylib`pthread_kill:
    0x7fff899fb500 <+90>:  cmpl   $-0x1, %eax
    0x7fff899fb503 <+93>:  jne    0x7fff899fb50c            ; <+102>
    0x7fff899fb505 <+95>:  callq  0x7fff899fc60e            ; symbol stub for: __error
    0x7fff899fb50a <+100>: movl   (%rax), %eax
(lldb)
frame #2: 0x00007fff85c1737b libsystem_c.dylib`abort + 129
libsystem_c.dylib`abort:
    0x7fff85c1737b <+129>: movl   $0x2710, %edi
    0x7fff85c17380 <+134>: callq  0x7fff85c3ea4c            ; symbol stub for: usleep$NOCANCEL
    0x7fff85c17385 <+139>: callq  0x7fff85c1738a            ; __abort

libsystem_c.dylib`__abort:
    0x7fff85c1738a <+0>:   pushq  %rbp
(lldb)
frame #3: 0x00007fff85bde9c4 libsystem_c.dylib`__assert_rtn + 321
libsystem_c.dylib`basename:
    0x7fff85bde9c4 <+0>: pushq  %rbp
    0x7fff85bde9c5 <+1>: movq   %rsp, %rbp
    0x7fff85bde9c8 <+4>: pushq  %r15
    0x7fff85bde9ca <+6>: pushq  %r14
(lldb)
frame #4: 0x000000010380ff8c libicinga.dylib`boost::intrusive_ptr::operator->(this=0x00007000016815d0) const + 76 at intrusive_ptr.hpp:174
   171
   172      T * operator->() const
   173      {
-> 174          BOOST_ASSERT( px != 0 );
   175          return px;
   176      }
   177
(lldb)
frame #5: 0x00000001039fec3b libicinga.dylib`icinga::Downtime::Start(this=0x0000000122651a40, runtimeCreated=true) + 283 at downtime.cpp:121
   118
   119      Checkable::Ptr checkable = GetCheckable();
   120
-> 121      checkable->RegisterDowntime(this);
   122
   123      if (runtimeCreated)
   124          OnDowntimeAdded(this);
(lldb) p checkable
(icinga::Checkable::Ptr) $0 = {
  px = 0x0000000000000000
}
icinga-migration commented 9 years ago

Updated by mfriedrich on 2015-11-16 23:10:12 +00:00

It seems that Downtime::Start() is invoked before Downtime::OnAllConfigLoaded() happens where the checkable is properly set.

icinga-migration commented 9 years ago

Updated by mfriedrich on 2015-11-16 23:26:03 +00:00

(lldb) p *this
(icinga::Downtime) $2 = {
  icinga::ObjectImpl = {
    icinga::ConfigObject = {
      icinga::ObjectImpl = {
        icinga::ConfigObjectBase = {
          icinga::ObjectImpl = {
            icinga::Object = {
              m_References = 4
              m_Mutex = {
                m = (__sig = 1297437784, __opaque = "")
              }
              m_LockOwner = 0x0000000000000000
            }
          }
          m_DebugInfo = {
            Path = (m_Data = "/usr/local/icinga2/var/lib/icinga2/api/packages/_api/mbmif.int.netways.de-1442309540-1/conf.d/downtimes/downtime-test-100!downtime-test!mbmif.local-1447714699-0.conf")
            FirstLine = 1
            FirstColumn = 0
            LastLine = 1
            LastColumn = 57
          }
        }
        m_Package = (m_Data = "_api")
        m_ZoneName = (m_Data = "")
        m_ShortName = (m_Data = "mbmif.local-1447714699-0")
        m_Name = (m_Data = "downtime-test-100!downtime-test!mbmif.local-1447714699-0")
        m_Version = 1447714699.4609351
        m_Templates = {
          px = 0x00000001226b8010
        }
        m_Extensions = {
          px = 0x0000000000000000
        }
        m_OriginalAttributes = {
          px = 0x0000000000000000
        }
        m_HAMode = HARunOnce
        m_StopCalled = false
        m_PauseCalled = false
        m_ResumeCalled = false
        m_StartCalled = true
        m_Paused = true
        m_StateLoaded = false
        m_Active = false
      }
    }
    m_ServiceName = (m_Data = "downtime-test")
    m_HostName = (m_Data = "downtime-test-100")
    m_Author = (m_Data = "icingaadmin")
    m_Comment = (m_Data = "Scheduled downtime for backup")
    m_ConfigOwner = (m_Data = "downtime-test-100!downtime-test!backup-downtime")
    m_TriggeredBy = (m_Data = "")
    m_ScheduledBy = (m_Data = "downtime-test-100!downtime-test!backup-downtime")
    m_EntryTime = 1447714699.539516
    m_TriggerTime = 0
    m_EndTime = 1447725600
    m_StartTime = 1447722000
    m_Duration = 0
    m_Triggers = {
      px = 0x0000000122650740
    }
    m_LegacyId = 2
    m_WasCancelled = false
    m_Fixed = true
  }
  m_Checkable = {
    px = 0x0000000000000000
  }
}
icinga-migration commented 9 years ago

Updated by Anonymous on 2015-11-19 18:40:03 +00:00

Applied in changeset 3505ca3c165bfb6102565a02747a2cb1be0792c8.

icinga-migration commented 9 years ago

Updated by gbeutner on 2015-11-19 18:40:41 +00:00

Please test whether the snapshot build fixes this.

icinga-migration commented 9 years ago

Updated by gbeutner on 2015-11-20 09:40:52 +00:00

icinga-migration commented 9 years ago

Updated by gbeutner on 2015-11-20 14:58:01 +00:00

icinga-migration commented 9 years ago

Updated by mfriedrich on 2015-11-23 14:08:49 +00:00

Unregister() does not properly remove the config item from items/newItems when ignore_on_error is used.

icinga-migration commented 9 years ago

Updated by mfriedrich on 2015-11-25 12:24:18 +00:00

icinga-migration commented 8 years ago

Updated by gbeutner on 2016-01-21 08:15:15 +00:00