statusengine / worker

PHP worker process that writes all event data to a storage backend
https://statusengine.org/worker/#overview
GNU General Public License v3.0
9 stars 8 forks source link

Query for availability report? #16

Closed raghav8888 closed 5 years ago

raghav8888 commented 5 years ago

I'm working on trying to get availability report for a given period of time out of the DB for the services being monitored. We have a huge infra in place and thus querying hard state entries in statusengine_service_statehistory and calculating state durations is a big overhead. Is there a predefined function or a known SQL query or anything in statusengine UI that can help me get the data?

JFYI. I'm using MySQL as the DB for statusengine.

nook24 commented 5 years ago

Hi @raghav8888, to calculate service availability the table statusengine_service_statehistory is the best option. The statehistory tables only contain state change events. (Ok to Critical, Warning to Unknown, etc) for hard and soft state events.

I don't think a plain SQL solution is the best option to calculate availability. So I created an example PHP script which will generate a report: Example Report Source: https://github.com/nook24/statusengine_availability

I used the database of the Statusengine Demo system for this. (~100MB at 610,000 records)

How much hosts and services are you monitoring? Normally the database should not cause an performance issue for this kind of usage.

raghav8888 commented 5 years ago

Hi @nook24

Apologies for the late reply. I take back my comment about too many hosts as upon actually performing the query, I found that it hardly takes any time.

The script that you gave helped me confirm the logic that it was indeed the value of is_hardstate that I need to be looking at for Availability report. Thank you for that.

Meanwhile, I've built a script of my own, but in python, which takes care of below things:

The data is dumped into an excel book with different sheets. I am happy to close this, but if you think it would be helpful for anyone else looking for similar data, I can create a merge request to place the script along side the one that you have provided and give the link here.

Again, thanks a ton for your help.

nook24 commented 5 years ago

Would be awesome, if you share your script with others :) I will add a 3rd party extensions section the the official documentation tomorrow. Than you can add the link to your repository.

I will come back to you, if this is online.

Again, thanks a ton for your help.

You are welcome

nook24 commented 5 years ago

@raghav8888 I added the 3rd party extensions section: https://statusengine.org/misc/#3rd-party-extensions Source: https://github.com/statusengine/docs/blob/master/src/content/misc.html#L7

Feel free to send your PR.

raghav8888 commented 5 years ago

@nook24 : I'm fixing some of the issues in my reporting script. I had a question which kind of defies the base logic that I had. The data from service_statehistory table is below (queried against a hostname, service and is_hardstate =1).

+------------+------------------------------+------------+--------------+-------+--------------+-----------------------+------------+-----------------+
| hostname   | service_description          | state_time | state_change | state | is_hardstate | current_check_attempt | last_state | last_hard_state |
+------------+------------------------------+------------+--------------+-------+--------------+-----------------------+------------+-----------------+
|      Host1 |                     Service1 | 1543276898 |            1 |     2 |            1 |                     5 |          2 |               0 |
|      Host1 |                     Service1 | 1543277496 |            1 |     0 |            1 |                     5 |          2 |               2 |
|      Host1 |                     Service1 | 1544307479 |            1 |     0 |            1 |                     5 |          2 |               2 |
|      Host1 |                     Service1 | 1544308337 |            1 |     2 |            1 |                     5 |          2 |               0 |
|      Host1 |                     Service1 | 1544313735 |            1 |     0 |            1 |                     5 |          2 |               2 |
+------------+------------------------------+------------+--------------+-------+--------------+-----------------------+------------+-----------------+

What I'm confused about is Record 3 (state_time is 1544307479), where the state is 0 and the last_hard_state is 2. If I look at the previous (second) record, it has the exact same statistics (except for the state time). What could be the reason behind this? The problem is causes is that when I process the data for a hostname-service combination from the service_statehistory table, it calculates the time difference between consecutive records and adds the difference to the repective state duration variable, where the state duration variable to which the duration gets added is the value of state from previous record (start time of the duration).

If you take a look at the data below from the service_checks table, there was a time between the state times of the confusing records above where the state changed to critcial but no relevant entry is present in the statehistory table. had the record been there in the statehistory table, it would have made sense. Please let me know if I'm missing something here.

+------------+------------------------------+-------+--------------+------------+------------+-----------------------+
| hostname   | service_description          | state | is_hardstate | start_time | end_time   | current_check_attempt |
+------------+------------------------------+-------+--------------+------------+------------+-----------------------+
|      Host1 |                     Service1 |     0 |            1 | 1544306022 | 1544306023 |                     1 |
|      Host1 |                     Service1 |     2 |            0 | 1544306622 | 1544306626 |                     1 |
|      Host1 |                     Service1 |     2 |            0 | 1544306686 | 1544306690 |                     2 |
|      Host1 |                     Service1 |     2 |            0 | 1544306750 | 1544306753 |                     3 |
|      Host1 |                     Service1 |     2 |            0 | 1544306813 | 1544306817 |                     4 |
|      Host1 |                     Service1 |     2 |            1 | 1544306877 | 1544306881 |                     5 |
|      Host1 |                     Service1 |     0 |            1 | 1544307477 | 1544307479 |                     1 |
+------------+------------------------------+-------+--------------+------------+------------+-----------------------+

A correct statehistory table would have looked like (adding record with the timestamp 1544306881)

+------------+------------------------------+------------+--------------+-------+--------------+-----------------------+------------+-----------------+
| hostname   | service_description          | state_time | state_change | state | is_hardstate | current_check_attempt | last_state | last_hard_state |
+------------+------------------------------+------------+--------------+-------+--------------+-----------------------+------------+-----------------+
|      Host1 |                     Service1 | 1543276898 |            1 |     2 |            1 |                     5 |          2 |               0 |
|      Host1 |                     Service1 | 1543277496 |            1 |     0 |            1 |                     5 |          2 |               2 |
|      Host1 |                     Service1 | 1544306881 |            1 |     2 |            1 |                     5 |          2 |               0 |
|      Host1 |                     Service1 | 1544307479 |            1 |     0 |            1 |                     5 |          2 |               2 |
|      Host1 |                     Service1 | 1544308337 |            1 |     2 |            1 |                     5 |          2 |               0 |
|      Host1 |                     Service1 | 1544313735 |            1 |     0 |            1 |                     5 |          2 |               2 |
+------------+------------------------------+------------+--------------+-------+--------------+-----------------------+------------+-----------------+
nook24 commented 5 years ago

Hi @raghav8888, could you please post the result of this query

SELECT
   hostname,
   service_description,
   state_time,
   FROM_UNIXTIME(state_time) as 'time',
   state_change,
   state,
   is_hardstate,
   current_check_attempt,
   max_check_attempts,
   last_state,
   last_hard_state
FROM statusengine_service_statehistory
WHERE state_time >= 1543276898
AND state_time <= 1544313735
AND hostname = 'Host1'
AND service_description = 'Service1'
ORDER BY state_time DESC;

I guess there was a soft-state between 1543277496 and 1544307479.

raghav8888 commented 5 years ago

@nook24 Here you go

+------------+------------------------------+------------+---------------------+--------------+-------+--------------+-----------------------+--------------------+------------+-----------------+
| hostname | service_description | state_time | time                | state_change | state | is_hardstate | current_check_attempt | max_check_attempts | last_state | last_hard_state |
+------------+------------------------------+------------+---------------------+--------------+-------+--------------+-----------------------+--------------------+------------+-----------------+
|   Host1  |       Service1      | 1544313735 | 2018-12-09 00:02:15 |            1 |     0 |            1 |                     5 |                  5 |          2 |               2 |
|   Host1  |       Service1      | 1544308337 | 2018-12-08 22:32:17 |            1 |     2 |            1 |                     5 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544308273 | 2018-12-08 22:31:13 |            1 |     2 |            0 |                     4 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544308209 | 2018-12-08 22:30:09 |            1 |     2 |            0 |                     3 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544308145 | 2018-12-08 22:29:05 |            1 |     2 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544308081 | 2018-12-08 22:28:01 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544307479 | 2018-12-08 22:17:59 |            1 |     0 |            1 |                     5 |                  5 |          2 |               2 |
|   Host1  |       Service1      | 1544306817 | 2018-12-08 22:06:57 |            1 |     2 |            0 |                     4 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544306753 | 2018-12-08 22:05:53 |            1 |     2 |            0 |                     3 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544306690 | 2018-12-08 22:04:50 |            1 |     2 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544306626 | 2018-12-08 22:03:46 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544301223 | 2018-12-08 20:33:43 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544301162 | 2018-12-08 20:32:42 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544268089 | 2018-12-08 11:21:29 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544268027 | 2018-12-08 11:20:27 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544245226 | 2018-12-08 05:00:26 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544245164 | 2018-12-08 04:59:24 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544203764 | 2018-12-07 17:29:24 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544203702 | 2018-12-07 17:28:22 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544184088 | 2018-12-07 12:01:28 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544184026 | 2018-12-07 12:00:26 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544070354 | 2018-12-06 04:25:54 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544070292 | 2018-12-06 04:24:52 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543896635 | 2018-12-04 04:10:35 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543896573 | 2018-12-04 04:09:33 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543812089 | 2018-12-03 04:41:29 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543812027 | 2018-12-03 04:40:27 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543790427 | 2018-12-02 22:40:27 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543790365 | 2018-12-02 22:39:25 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543749182 | 2018-12-02 11:13:02 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543749120 | 2018-12-02 11:12:00 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543637521 | 2018-12-01 04:12:01 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543637459 | 2018-12-01 04:10:59 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543620658 | 2018-11-30 23:30:58 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543620597 | 2018-11-30 23:29:57 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543619397 | 2018-11-30 23:09:57 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543619335 | 2018-11-30 23:08:55 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543460173 | 2018-11-29 02:56:13 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543460112 | 2018-11-29 02:55:12 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543331293 | 2018-11-27 15:08:13 |            1 |     0 |            0 |                     2 |                  5 |          3 |               0 |
|   Host1  |       Service1      | 1543331231 | 2018-11-27 15:07:11 |            1 |     3 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543289670 | 2018-11-27 03:34:30 |            1 |     0 |            0 |                     2 |                  5 |          3 |               0 |
|   Host1  |       Service1      | 1543289609 | 2018-11-27 03:33:29 |            1 |     3 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543277496 | 2018-11-27 00:11:36 |            1 |     0 |            1 |                     5 |                  5 |          2 |               2 |
|   Host1  |       Service1      | 1543276898 | 2018-11-27 00:01:38 |            1 |     2 |            1 |                     5 |                  5 |          2 |               0 |
+------------+------------------------------+------------+---------------------+--------------+-------+--------------+-----------------------+--------------------+------------+-----------------+
45 rows in set (0.00 sec)
nook24 commented 5 years ago

Well... Ok... It's definitely not the first time i ran into this. The issue is, that not all Ok states are automatically hard. If a service hits SOFT Critical, it will recover with SOFT Ok. That's exactly what happened in your case.

I (and others) don't really like this behavior of Naemon/Nagios. https://github.com/naemon/naemon-core/issues/205

The Naemon Docs also has an good example, on how Naemon-Core will handle HARD and SOFT states: http://www.naemon.org/documentation/usersguide/statetypes.html#example

I created an new issue #17 for this. I play with the thought to force fix this in Statusengine.


Here's what's happened (using your data to explain):

Attention! You need to read all listings from bottom to top because of ORDER BY state_time DESC

Service1 is changing from HARD Ok (state=0) to SOFT unknown (state=3)

+------------+------------------------------+------------+---------------------+--------------+-------+--------------+-----------------------+--------------------+------------+-----------------+
| hostname | service_description | state_time | time                | state_change | state | is_hardstate | current_check_attempt | max_check_attempts | last_state | last_hard_state |
+------------+------------------------------+------------+---------------------+--------------+-------+--------------+-----------------------+--------------------+------------+-----------------+
|   Host1  |       Service1      | 1543289609 | 2018-11-27 03:33:29 |            1 |     3 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543277496 | 2018-11-27 00:11:36 |            1 |     0 |            1 |                     5 |                  5 |          2 |               2 |

Until 1544307479 the service is jumping around from SOFT critical/unknown to SOFT Ok all the time:

+------------+------------------------------+------------+---------------------+--------------+-------+--------------+-----------------------+--------------------+------------+-----------------+
| hostname | service_description | state_time | time                | state_change | state | is_hardstate | current_check_attempt | max_check_attempts | last_state | last_hard_state |
+------------+------------------------------+------------+---------------------+--------------+-------+--------------+-----------------------+--------------------+------------+-----------------+
|   Host1  |       Service1      | 1544306817 | 2018-12-08 22:06:57 |            1 |     2 |            0 |                     4 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544306753 | 2018-12-08 22:05:53 |            1 |     2 |            0 |                     3 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544306690 | 2018-12-08 22:04:50 |            1 |     2 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544306626 | 2018-12-08 22:03:46 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544301223 | 2018-12-08 20:33:43 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544301162 | 2018-12-08 20:32:42 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544268089 | 2018-12-08 11:21:29 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544268027 | 2018-12-08 11:20:27 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544245226 | 2018-12-08 05:00:26 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544245164 | 2018-12-08 04:59:24 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544203764 | 2018-12-07 17:29:24 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544203702 | 2018-12-07 17:28:22 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544184088 | 2018-12-07 12:01:28 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544184026 | 2018-12-07 12:00:26 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544070354 | 2018-12-06 04:25:54 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544070292 | 2018-12-06 04:24:52 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543896635 | 2018-12-04 04:10:35 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543896573 | 2018-12-04 04:09:33 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543812089 | 2018-12-03 04:41:29 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543812027 | 2018-12-03 04:40:27 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543790427 | 2018-12-02 22:40:27 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543790365 | 2018-12-02 22:39:25 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543749182 | 2018-12-02 11:13:02 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543749120 | 2018-12-02 11:12:00 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543637521 | 2018-12-01 04:12:01 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543637459 | 2018-12-01 04:10:59 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543620658 | 2018-11-30 23:30:58 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543620597 | 2018-11-30 23:29:57 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543619397 | 2018-11-30 23:09:57 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543619335 | 2018-11-30 23:08:55 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543460173 | 2018-11-29 02:56:13 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543460112 | 2018-11-29 02:55:12 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543331293 | 2018-11-27 15:08:13 |            1 |     0 |            0 |                     2 |                  5 |          3 |               0 |
|   Host1  |       Service1      | 1543331231 | 2018-11-27 15:07:11 |            1 |     3 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543289670 | 2018-11-27 03:34:30 |            1 |     0 |            0 |                     2 |                  5 |          3 |               0 |
|   Host1  |       Service1      | 1543289609 | 2018-11-27 03:33:29 |            1 |     3 |            0 |                     1 |                  5 |          0 |               0 |

Last HARD state is down HERE at 1543277496 

At 1544307479 the service finally reaches Ok HARD:

+------------+------------------------------+------------+---------------------+--------------+-------+--------------+-----------------------+--------------------+------------+-----------------+
| hostname | service_description | state_time | time                | state_change | state | is_hardstate | current_check_attempt | max_check_attempts | last_state | last_hard_state |
+------------+------------------------------+------------+---------------------+--------------+-------+--------------+-----------------------+--------------------+------------+-----------------+
|   Host1  |       Service1      | 1544313735 | 2018-12-09 00:02:15 |            1 |     0 |            1 |                     5 |                  5 |          2 |               2 |
|   Host1  |       Service1      | 1544308337 | 2018-12-08 22:32:17 |            1 |     2 |            1 |                     5 |                  5 |          2 |               0 |

# Some soft state critical AFTER it was in HARD Ok again at 1544307479
|   Host1  |       Service1      | 1544308273 | 2018-12-08 22:31:13 |            1 |     2 |            0 |                     4 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544308209 | 2018-12-08 22:30:09 |            1 |     2 |            0 |                     3 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544308145 | 2018-12-08 22:29:05 |            1 |     2 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544308081 | 2018-12-08 22:28:01 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |

-- Hit Hard state Ok again
|   Host1  |       Service1      | 1544307479 | 2018-12-08 22:17:59 |            1 |     0 |            1 |                     5 |                  5 |          2 |               2 |

This is the full list you posted. I added some comments. (Unfortunately ORDER BY state_time DESC is a bit confusing to read for this i guess)

+------------+------------------------------+------------+---------------------+--------------+-------+--------------+-----------------------+--------------------+------------+-----------------+
| hostname | service_description | state_time | time                | state_change | state | is_hardstate | current_check_attempt | max_check_attempts | last_state | last_hard_state |
+------------+------------------------------+------------+---------------------+--------------+-------+--------------+-----------------------+--------------------+------------+-----------------+
|   Host1  |       Service1      | 1544313735 | 2018-12-09 00:02:15 |            1 |     0 |            1 |                     5 |                  5 |          2 |               2 |
|   Host1  |       Service1      | 1544308337 | 2018-12-08 22:32:17 |            1 |     2 |            1 |                     5 |                  5 |          2 |               0 |

# Some soft state critical AFTER it was in HARD Ok again at 1544307479
|   Host1  |       Service1      | 1544308273 | 2018-12-08 22:31:13 |            1 |     2 |            0 |                     4 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544308209 | 2018-12-08 22:30:09 |            1 |     2 |            0 |                     3 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544308145 | 2018-12-08 22:29:05 |            1 |     2 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544308081 | 2018-12-08 22:28:01 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |

-- Hit Hard state Ok again
|   Host1  |       Service1      | 1544307479 | 2018-12-08 22:17:59 |            1 |     0 |            1 |                     5 |                  5 |          2 |               2 |

# Lot of SOFT states of Ok and Critical
|   Host1  |       Service1      | 1544306817 | 2018-12-08 22:06:57 |            1 |     2 |            0 |                     4 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544306753 | 2018-12-08 22:05:53 |            1 |     2 |            0 |                     3 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544306690 | 2018-12-08 22:04:50 |            1 |     2 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544306626 | 2018-12-08 22:03:46 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544301223 | 2018-12-08 20:33:43 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544301162 | 2018-12-08 20:32:42 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544268089 | 2018-12-08 11:21:29 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544268027 | 2018-12-08 11:20:27 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544245226 | 2018-12-08 05:00:26 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544245164 | 2018-12-08 04:59:24 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544203764 | 2018-12-07 17:29:24 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544203702 | 2018-12-07 17:28:22 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544184088 | 2018-12-07 12:01:28 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544184026 | 2018-12-07 12:00:26 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1544070354 | 2018-12-06 04:25:54 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1544070292 | 2018-12-06 04:24:52 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543896635 | 2018-12-04 04:10:35 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543896573 | 2018-12-04 04:09:33 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543812089 | 2018-12-03 04:41:29 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543812027 | 2018-12-03 04:40:27 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543790427 | 2018-12-02 22:40:27 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543790365 | 2018-12-02 22:39:25 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543749182 | 2018-12-02 11:13:02 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543749120 | 2018-12-02 11:12:00 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543637521 | 2018-12-01 04:12:01 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543637459 | 2018-12-01 04:10:59 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543620658 | 2018-11-30 23:30:58 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543620597 | 2018-11-30 23:29:57 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543619397 | 2018-11-30 23:09:57 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543619335 | 2018-11-30 23:08:55 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543460173 | 2018-11-29 02:56:13 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|   Host1  |       Service1      | 1543460112 | 2018-11-29 02:55:12 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543331293 | 2018-11-27 15:08:13 |            1 |     0 |            0 |                     2 |                  5 |          3 |               0 |
|   Host1  |       Service1      | 1543331231 | 2018-11-27 15:07:11 |            1 |     3 |            0 |                     1 |                  5 |          0 |               0 |
|   Host1  |       Service1      | 1543289670 | 2018-11-27 03:34:30 |            1 |     0 |            0 |                     2 |                  5 |          3 |               0 |
|   Host1  |       Service1      | 1543289609 | 2018-11-27 03:33:29 |            1 |     3 |            0 |                     1 |                  5 |          0 |               0 |

-- Last HARD OK state
|   Host1  |       Service1      | 1543277496 | 2018-11-27 00:11:36 |            1 |     0 |            1 |                     5 |                  5 |          2 |               2 |
|   Host1  |       Service1      | 1543276898 | 2018-11-27 00:01:38 |            1 |     2 |            1 |                     5 |                  5 |          2 |               0 |
+------------+------------------------------+------------+---------------------+--------------+-------+--------------+-----------------------+--------------------+------------+-----------------+
raghav8888 commented 5 years ago

A little confused when you said it had hit critical soft and recovered in my case. The below entry from statusengine_servicechecks table signifies that the hard state was achieved. It is just that the entry is missing from statusengine_service_statehistory table for some reason unknown to me

+------------+------------------------------+-------+--------------+------------+------------+-----------------------+
| hostname   | service_description          | state | is_hardstate | start_time | end_time   | current_check_attempt |
+------------+------------------------------+-------+--------------+------------+------------+-----------------------+
|      Host1 |                     Service1 |     2 |            1 | 1544306877 | 1544306881 |                     5 |

The entries from statusengine_service_statehistory table between which this should have been present are:

+------------+------------------------------+------------+--------------+-------+--------------+-----------------------+------------+-----------------+
| hostname   | service_description          | state_time | state_change | state | is_hardstate | current_check_attempt | last_state | last_hard_state |
+------------+------------------------------+------------+--------------+-------+--------------+-----------------------+------------+-----------------+
|      Host1 |                     Service1 | 1543277496 |            1 |     0 |            1 |                     5 |          2 |               2 |
|      Host1 |                     Service1 | 1544307479 |            1 |     0 |            1 |                     5 |          2 |               2 |

Please let me know if I'm missing something. I know the statehistory table doesn't have data but the servicechecks table does and that is what I'm not sure why it wont if the the critical was hit 5/5.

nook24 commented 5 years ago

Is it possibe for you, to upload your database tables some where? Interesting would be the tables: statehistory, servicechecks and logentries.

raghav8888 commented 5 years ago

That would not be possible. However, I can provide you relevant data from these tables for the time period we're looking at. Will do that and report back here.

raghav8888 commented 5 years ago

statusengine_logentries

mysql> select * from statusengine_logentries
             where logentry_data LIKE '%Host1;Service1%'
             and entry_time > 1543276000 and entry_time < 1544309000
             ORDER BY entry_time;
+------------+---------------+------------------------------------------------------------------------+-----------+
| entry_time | logentry_type | logentry_data                                                          | node_name |
+------------+---------------+------------------------------------------------------------------------+-----------+
| 1544306881 |         65536 | SERVICE ALERT: Host1;Service1;CRITICAL;HARD;5;CRITICAL - <Hidden data> |   Node1   |
| 1544307479 |          8192 | SERVICE ALERT: Host1;Service1;OK;HARD;5;OK - Elapsed: 258ms            |   Node1   |
| 1544308337 |         65536 | SERVICE ALERT: Host1;Service1;CRITICAL;HARD;5;CRITICAL - <Hidden data> |   Node1   |
+------------+---------------+------------------------------------------------------------------------+-----------+
2 rows in set (0.06 sec)

statusengine_service_statehistory

mysql> select hostname, service_description, state_time ,state_change, state, is_hardstate, 
             current_check_attempt, max_check_attempts, last_state, last_hard_state
             from statusengine_service_statehistory
             where hostname = 'Host1' AND service_description = 'Service1'
             and state_time > 1543276000 and state_time < 1544309000;
+------------+------------------------------+------------+--------------+-------+--------------+-----------------------+--------------------+------------+--------+
| hostname   | service_description | state_time | state_change | state | is_hardstate | current_check_attempt | max_check_attempts | last_state | last_hard_state |
+------------+------------------------------+------------+--------------+-------+--------------+-----------------------+--------------------+------------+--------+
|    Host1   |        Service1     | 1543276644 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1543276707 |            1 |     2 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1543276771 |            1 |     2 |            0 |                     3 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1543276835 |            1 |     2 |            0 |                     4 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1543276898 |            1 |     2 |            1 |                     5 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1543277496 |            1 |     0 |            1 |                     5 |                  5 |          2 |               2 |
|    Host1   |        Service1     | 1543289609 |            1 |     3 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1543289670 |            1 |     0 |            0 |                     2 |                  5 |          3 |               0 |
|    Host1   |        Service1     | 1543331231 |            1 |     3 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1543331293 |            1 |     0 |            0 |                     2 |                  5 |          3 |               0 |
|    Host1   |        Service1     | 1543460112 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1543460173 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1543619335 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1543619397 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1543620597 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1543620658 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1543637459 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1543637521 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1543749120 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1543749182 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1543790365 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1543790427 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1543812027 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1543812089 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1543896573 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1543896635 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1544070292 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1544070354 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1544184026 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1544184088 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1544203702 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1544203764 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1544245164 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1544245226 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1544268027 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1544268089 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1544301162 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1544301223 |            1 |     0 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1544306626 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1544306690 |            1 |     2 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1544306753 |            1 |     2 |            0 |                     3 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1544306817 |            1 |     2 |            0 |                     4 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1544307479 |            1 |     0 |            1 |                     5 |                  5 |          2 |               2 |
|    Host1   |        Service1     | 1544308081 |            1 |     2 |            0 |                     1 |                  5 |          0 |               0 |
|    Host1   |        Service1     | 1544308145 |            1 |     2 |            0 |                     2 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1544308209 |            1 |     2 |            0 |                     3 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1544308273 |            1 |     2 |            0 |                     4 |                  5 |          2 |               0 |
|    Host1   |        Service1     | 1544308337 |            1 |     2 |            1 |                     5 |                  5 |          2 |               0 |
+------------+------------------------------+------------+--------------+-------+--------------+-----------------------+--------------------+------------+--------+
48 rows in set (0.00 sec)

statusengine_servicechecks

mysql> select hostname, service_description, state, is_hardstate, start_time, end_time, 
             current_check_attempt, max_check_attempts
             from statusengine_servicechecks
             where hostname = 'Host1' AND service_description = 'Service1'
             and start_time > 1543276000 and start_time < 1544309000;
+------------+------------------------------+-------+--------------+------------+------------+-----------------------+-----------+
| hostname   | service_description | state | is_hardstate | start_time | end_time   | current_check_attempt | max_check_attempts |
+------------+------------------------------+-------+--------------+------------+------------+-----------------------+-----------+
|    Host1   |        Service1     |     2 |            0 | 1543619333 | 1543619335 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543619395 | 1543619397 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543619995 | 1543619997 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1543620595 | 1543620597 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543620657 | 1543620658 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543621257 | 1543621258 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543621857 | 1543621858 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543622457 | 1543622458 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543623057 | 1543623058 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543623657 | 1543623659 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543624257 | 1543624258 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543624857 | 1543624858 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543625457 | 1543625458 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543626057 | 1543626057 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543626657 | 1543626658 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543627257 | 1543627258 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543627857 | 1543627858 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543628457 | 1543628458 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543629057 | 1543629058 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543629657 | 1543629658 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543630257 | 1543630258 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543630857 | 1543630859 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543631457 | 1543631457 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543632057 | 1543632058 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543632657 | 1543632659 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543633257 | 1543633258 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543633857 | 1543633858 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543634457 | 1543634459 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543635057 | 1543635058 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543635657 | 1543635658 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543636257 | 1543636259 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543636857 | 1543636859 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1543637457 | 1543637459 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543637519 | 1543637521 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543638119 | 1543638121 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543638719 | 1543638720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543639319 | 1543639321 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543639919 | 1543639920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543640519 | 1543640520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543641119 | 1543641121 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543641719 | 1543641721 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543642319 | 1543642320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543642919 | 1543642920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543643519 | 1543643521 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543644119 | 1543644121 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543644719 | 1543644720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543645319 | 1543645320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543645919 | 1543645921 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543646519 | 1543646520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543647119 | 1543647120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543647719 | 1543647720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543648319 | 1543648320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543648919 | 1543648920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543649519 | 1543649520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543650119 | 1543650120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543650719 | 1543650720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543651319 | 1543651320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543651919 | 1543651920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543652519 | 1543652520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543653119 | 1543653120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543653719 | 1543653720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543654319 | 1543654320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543654919 | 1543654920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543655519 | 1543655520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543656119 | 1543656120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543656719 | 1543656720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543657319 | 1543657320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543657919 | 1543657920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543658519 | 1543658520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543659119 | 1543659120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543659719 | 1543659720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543660319 | 1543660320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543660919 | 1543660920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543661519 | 1543661521 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543662119 | 1543662120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543662719 | 1543662720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543663319 | 1543663320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543663919 | 1543663920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543664519 | 1543664520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543665119 | 1543665120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543665719 | 1543665720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543666319 | 1543666320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543666919 | 1543666920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543667519 | 1543667520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543668119 | 1543668120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543668719 | 1543668720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543669319 | 1543669320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543669919 | 1543669920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543670519 | 1543670520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543671119 | 1543671120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543671719 | 1543671720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543672319 | 1543672320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543672919 | 1543672920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543673519 | 1543673520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543674119 | 1543674120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543674719 | 1543674721 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543675319 | 1543675320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543675919 | 1543675920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543676519 | 1543676520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543677119 | 1543677120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543677719 | 1543677720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543678319 | 1543678320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543678919 | 1543678920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543679519 | 1543679520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543680119 | 1543680120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543680719 | 1543680720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543681319 | 1543681320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543681919 | 1543681920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543682519 | 1543682520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543683119 | 1543683120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543683719 | 1543683720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543684319 | 1543684320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543684919 | 1543684920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543685519 | 1543685520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543686119 | 1543686120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543686719 | 1543686720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543687319 | 1543687320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543687919 | 1543687920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543688519 | 1543688520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543689119 | 1543689121 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543689719 | 1543689720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543690319 | 1543690320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543690919 | 1543690920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543691519 | 1543691520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543692119 | 1543692120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543692719 | 1543692720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543693319 | 1543693320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543693919 | 1543693920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543694519 | 1543694520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543695119 | 1543695120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543695719 | 1543695720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543696319 | 1543696320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543696919 | 1543696920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543697519 | 1543697520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543698119 | 1543698120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543698719 | 1543698720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543699319 | 1543699320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543699919 | 1543699920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543700519 | 1543700520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543701119 | 1543701120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543701719 | 1543701720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543702319 | 1543702320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543702919 | 1543702920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543703519 | 1543703521 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543704119 | 1543704120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543704719 | 1543704720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543705319 | 1543705320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543705919 | 1543705920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543706519 | 1543706520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543707119 | 1543707120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543707719 | 1543707720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543708319 | 1543708320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543708919 | 1543708920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543709519 | 1543709520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543710119 | 1543710120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543710719 | 1543710720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543711319 | 1543711320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543711919 | 1543711920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543712519 | 1543712521 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543713119 | 1543713120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543713719 | 1543713720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543714319 | 1543714320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543714919 | 1543714920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543715519 | 1543715520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543716119 | 1543716120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543716719 | 1543716720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543717319 | 1543717320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543717919 | 1543717920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543718519 | 1543718520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543719119 | 1543719120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543719719 | 1543719720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543720319 | 1543720320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543720919 | 1543720920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543721519 | 1543721520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543722119 | 1543722120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543722719 | 1543722720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543723319 | 1543723320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543723919 | 1543723920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543724519 | 1543724520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543725119 | 1543725120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543725719 | 1543725720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543726319 | 1543726320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543726919 | 1543726920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543727519 | 1543727520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543728119 | 1543728120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543728719 | 1543728720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543729319 | 1543729320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543729919 | 1543729920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543730519 | 1543730520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543731119 | 1543731120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543731719 | 1543731720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543732319 | 1543732321 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543732919 | 1543732920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543733519 | 1543733520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543734119 | 1543734121 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543734719 | 1543734720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543735319 | 1543735320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543735919 | 1543735920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543736519 | 1543736520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543737119 | 1543737120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543737719 | 1543737720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543738319 | 1543738320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543738919 | 1543738920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543739519 | 1543739520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543740119 | 1543740120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543740719 | 1543740720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543741319 | 1543741320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543741919 | 1543741920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543742519 | 1543742520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543743119 | 1543743120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543743719 | 1543743720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543744319 | 1543744320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543744919 | 1543744920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543745519 | 1543745520 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543746119 | 1543746120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543746719 | 1543746720 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543747319 | 1543747320 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543747919 | 1543747920 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543748519 | 1543748520 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1543749119 | 1543749120 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543749180 | 1543749182 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543749446 | 1543749448 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543750046 | 1543750048 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543750646 | 1543750648 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543751246 | 1543751248 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543751363 | 1543751365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543751963 | 1543751965 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543752563 | 1543752565 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543753163 | 1543753165 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543753763 | 1543753765 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543754363 | 1543754365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543754963 | 1543754965 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543755563 | 1543755565 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543756163 | 1543756165 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543756763 | 1543756765 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543757363 | 1543757365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543757963 | 1543757965 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543758563 | 1543758565 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543759163 | 1543759165 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543759763 | 1543759765 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543760363 | 1543760365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543760963 | 1543760965 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543761563 | 1543761565 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543762163 | 1543762165 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543762763 | 1543762765 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543763363 | 1543763365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543763963 | 1543763965 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543764563 | 1543764565 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543765163 | 1543765165 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543765763 | 1543765765 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543766363 | 1543766365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543766963 | 1543766965 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543767563 | 1543767565 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543768163 | 1543768165 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543768763 | 1543768765 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543769363 | 1543769365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543769963 | 1543769965 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543770563 | 1543770565 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543771163 | 1543771165 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543771763 | 1543771765 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543772363 | 1543772365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543772963 | 1543772965 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543773563 | 1543773565 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543774163 | 1543774165 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543774763 | 1543774765 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543775363 | 1543775365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543775963 | 1543775965 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543776563 | 1543776565 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543777163 | 1543777165 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543777763 | 1543777765 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543778363 | 1543778365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543778963 | 1543778965 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543779563 | 1543779565 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543780163 | 1543780165 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543780763 | 1543780765 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543781363 | 1543781365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543781963 | 1543781965 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543782563 | 1543782565 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543783163 | 1543783165 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543783763 | 1543783765 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543784363 | 1543784365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543784963 | 1543784965 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543785563 | 1543785565 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543786163 | 1543786165 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543786763 | 1543786765 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543787363 | 1543787365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543787963 | 1543787965 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543788563 | 1543788565 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543789163 | 1543789165 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543789763 | 1543789765 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1543790363 | 1543790365 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543790425 | 1543790427 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543791025 | 1543791027 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543791625 | 1543791627 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543792225 | 1543792227 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543792825 | 1543792827 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543793425 | 1543793427 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543794025 | 1543794027 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543794625 | 1543794627 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543795225 | 1543795227 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543795825 | 1543795827 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543796425 | 1543796427 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543797025 | 1543797027 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543797625 | 1543797627 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543798225 | 1543798227 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543798825 | 1543798828 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543799425 | 1543799427 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543800025 | 1543800027 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543800625 | 1543800627 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543801225 | 1543801227 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543801825 | 1543801827 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543802425 | 1543802427 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543803025 | 1543803027 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543803625 | 1543803627 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543804225 | 1543804227 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543804825 | 1543804827 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543805425 | 1543805427 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543806025 | 1543806027 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543806625 | 1543806627 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543807225 | 1543807227 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543807825 | 1543807827 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543808425 | 1543808427 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543809025 | 1543809027 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543809625 | 1543809627 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543810225 | 1543810227 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543810825 | 1543810827 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543811425 | 1543811427 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1543812025 | 1543812027 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543812087 | 1543812089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543812687 | 1543812689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543813287 | 1543813289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543813887 | 1543813889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543814487 | 1543814489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543815087 | 1543815089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543815687 | 1543815689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543816287 | 1543816289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543816887 | 1543816889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543817487 | 1543817489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543818087 | 1543818089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543818687 | 1543818689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543819287 | 1543819289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543819887 | 1543819889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543820487 | 1543820489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543821087 | 1543821089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543821687 | 1543821689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543822287 | 1543822289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543822887 | 1543822889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543823487 | 1543823489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543824087 | 1543824089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543824687 | 1543824689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543825287 | 1543825289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543825887 | 1543825889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543826487 | 1543826489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543827087 | 1543827089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543827687 | 1543827689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543828287 | 1543828289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543828887 | 1543828889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543829487 | 1543829489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543830087 | 1543830089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543830687 | 1543830689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543831287 | 1543831289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543831887 | 1543831889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543832487 | 1543832489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543833087 | 1543833089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543833687 | 1543833689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543834287 | 1543834289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543834887 | 1543834889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543835487 | 1543835489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543836087 | 1543836089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543836687 | 1543836689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543837287 | 1543837289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543837887 | 1543837889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543838487 | 1543838489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543839087 | 1543839089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543839687 | 1543839689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543840287 | 1543840289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543840887 | 1543840889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543841487 | 1543841489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543842087 | 1543842089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543842687 | 1543842689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543843287 | 1543843289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543843887 | 1543843889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543844487 | 1543844489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543845087 | 1543845089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543845687 | 1543845689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543846287 | 1543846289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543846887 | 1543846889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543847487 | 1543847489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543848087 | 1543848089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543848687 | 1543848689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543849287 | 1543849289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543849887 | 1543849889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543850487 | 1543850489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543851087 | 1543851089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543851687 | 1543851689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543852287 | 1543852289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543852887 | 1543852889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543853487 | 1543853489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543854087 | 1543854089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543854687 | 1543854689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543855287 | 1543855289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543855887 | 1543855889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543856487 | 1543856489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543857087 | 1543857089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543857264 | 1543857266 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543857864 | 1543857866 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543858464 | 1543858466 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543859064 | 1543859066 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543859664 | 1543859666 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543860264 | 1543860266 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543860864 | 1543860866 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543861464 | 1543861466 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543862064 | 1543862066 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543862664 | 1543862666 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543863264 | 1543863266 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543863864 | 1543863866 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543864464 | 1543864466 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543865064 | 1543865066 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543865664 | 1543865666 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543866264 | 1543866266 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543866864 | 1543866866 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543867464 | 1543867466 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543868064 | 1543868066 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543868664 | 1543868666 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543869264 | 1543869266 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543869864 | 1543869866 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543870464 | 1543870466 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543871064 | 1543871066 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543871664 | 1543871666 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543872264 | 1543872266 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543872864 | 1543872866 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543873464 | 1543873466 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543874064 | 1543874066 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543874664 | 1543874666 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543875264 | 1543875266 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543875864 | 1543875866 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543876464 | 1543876466 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543877064 | 1543877066 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543877664 | 1543877666 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543878264 | 1543878266 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543878864 | 1543878866 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543879464 | 1543879466 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543880064 | 1543880066 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543880664 | 1543880666 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543881264 | 1543881266 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543881864 | 1543881866 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543882464 | 1543882466 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543883064 | 1543883066 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543883664 | 1543883666 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543884264 | 1543884266 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543884864 | 1543884866 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543885464 | 1543885466 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543886064 | 1543886066 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543886664 | 1543886666 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543887264 | 1543887266 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543887864 | 1543887866 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543888464 | 1543888466 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543889064 | 1543889066 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543889664 | 1543889666 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543890264 | 1543890266 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543890864 | 1543890866 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543891464 | 1543891466 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543892064 | 1543892066 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543892664 | 1543892666 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543893264 | 1543893266 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543894170 | 1543894173 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543894770 | 1543894773 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543895370 | 1543895373 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543895970 | 1543895973 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1543896570 | 1543896573 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543896633 | 1543896635 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543897233 | 1543897235 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543897833 | 1543897835 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543898270 | 1543898273 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543898870 | 1543898873 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543899470 | 1543899473 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543900070 | 1543900073 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543900670 | 1543900673 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543901270 | 1543901272 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543901870 | 1543901872 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543902716 | 1543902718 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543903316 | 1543903318 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543903916 | 1543903918 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543904301 | 1543904303 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543904901 | 1543904903 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543905501 | 1543905503 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543906101 | 1543906103 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543906701 | 1543906703 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543906956 | 1543906958 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543907989 | 1543907991 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543908589 | 1543908591 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543909189 | 1543909191 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543909789 | 1543909791 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543910389 | 1543910391 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543910989 | 1543910991 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543911754 | 1543911756 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543912354 | 1543912356 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543912954 | 1543912956 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543913554 | 1543913556 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543914154 | 1543914156 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543914754 | 1543914756 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543915354 | 1543915356 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543915954 | 1543915956 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543916554 | 1543916556 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543917154 | 1543917156 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543917754 | 1543917756 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543918354 | 1543918356 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543918954 | 1543918956 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543919554 | 1543919556 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543920154 | 1543920156 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543920754 | 1543920756 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543921354 | 1543921356 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543921678 | 1543921680 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543922278 | 1543922280 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543922802 | 1543922804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543923402 | 1543923403 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543924002 | 1543924004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543924602 | 1543924604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543925202 | 1543925204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543925802 | 1543925804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543926402 | 1543926404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543927002 | 1543927003 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543927602 | 1543927605 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543928202 | 1543928204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543928802 | 1543928803 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543929402 | 1543929404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543930002 | 1543930004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543930602 | 1543930603 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543931202 | 1543931204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543931802 | 1543931804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543932402 | 1543932403 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543933002 | 1543933004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543933602 | 1543933604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543934202 | 1543934203 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543934802 | 1543934804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543935402 | 1543935404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543936002 | 1543936003 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543936602 | 1543936604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543937202 | 1543937204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543937802 | 1543937803 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543938402 | 1543938404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543939002 | 1543939004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543939602 | 1543939603 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543940202 | 1543940204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543940802 | 1543940804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543941402 | 1543941403 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543942002 | 1543942004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543942602 | 1543942604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543943202 | 1543943203 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543943802 | 1543943804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543944402 | 1543944404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543945002 | 1543945003 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543945602 | 1543945604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543946202 | 1543946204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543946802 | 1543946803 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543947402 | 1543947404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543948002 | 1543948004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543948602 | 1543948603 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543949202 | 1543949204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543949802 | 1543949804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543950402 | 1543950403 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543951002 | 1543951004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543951602 | 1543951604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543952202 | 1543952203 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543952802 | 1543952804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543953402 | 1543953404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543954002 | 1543954003 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543954602 | 1543954604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543955202 | 1543955204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543955802 | 1543955803 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543956402 | 1543956404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543957002 | 1543957004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543957602 | 1543957603 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543958202 | 1543958204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543958802 | 1543958804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543959402 | 1543959403 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543960002 | 1543960004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543960602 | 1543960604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543961202 | 1543961203 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543961802 | 1543961804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543962402 | 1543962404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543963002 | 1543963003 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543963602 | 1543963604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543964202 | 1543964204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543964802 | 1543964803 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543965402 | 1543965404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543966002 | 1543966004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543966602 | 1543966603 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543967202 | 1543967204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543967802 | 1543967804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543968402 | 1543968403 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543969002 | 1543969004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543969602 | 1543969604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543970202 | 1543970203 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543970802 | 1543970804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543971402 | 1543971404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543972002 | 1543972003 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543972602 | 1543972605 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543973202 | 1543973204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543973802 | 1543973803 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543974402 | 1543974404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543975002 | 1543975004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543975602 | 1543975603 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543976202 | 1543976204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543976802 | 1543976804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543977402 | 1543977403 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543978002 | 1543978004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543978602 | 1543978604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543979202 | 1543979203 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543979802 | 1543979804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543980402 | 1543980404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543981002 | 1543981003 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543981602 | 1543981604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543982202 | 1543982204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543982802 | 1543982803 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543983402 | 1543983404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543984002 | 1543984004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543984602 | 1543984603 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543985202 | 1543985204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543985802 | 1543985804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543986402 | 1543986403 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543987002 | 1543987004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543987602 | 1543987604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543988202 | 1543988203 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543988802 | 1543988804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543989402 | 1543989404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543990002 | 1543990003 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543990602 | 1543990604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543991202 | 1543991204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543991802 | 1543991803 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543992402 | 1543992404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543993002 | 1543993004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543993602 | 1543993603 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543994202 | 1543994204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543994802 | 1543994804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543995402 | 1543995403 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543996002 | 1543996004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543996602 | 1543996604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543997202 | 1543997203 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543997802 | 1543997804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543998402 | 1543998404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543999002 | 1543999003 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1543999602 | 1543999604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544000202 | 1544000204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544000802 | 1544000803 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544001402 | 1544001404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544002002 | 1544002004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544002602 | 1544002603 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544003202 | 1544003204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544003802 | 1544003805 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544004402 | 1544004403 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544005002 | 1544005004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544005602 | 1544005604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544006202 | 1544006203 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544006802 | 1544006804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544007402 | 1544007404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544008002 | 1544008003 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544008602 | 1544008604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544009202 | 1544009204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544009802 | 1544009803 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544010402 | 1544010404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544011002 | 1544011004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544011602 | 1544011603 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544012202 | 1544012204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544012802 | 1544012804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544013402 | 1544013403 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544014002 | 1544014004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544014602 | 1544014604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544015202 | 1544015203 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544015802 | 1544015804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544016402 | 1544016404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544017002 | 1544017003 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544017602 | 1544017604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544018202 | 1544018204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544018802 | 1544018803 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544019402 | 1544019404 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544020002 | 1544020004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544020602 | 1544020604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544021202 | 1544021204 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544021802 | 1544021804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544022402 | 1544022403 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544023002 | 1544023004 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544023602 | 1544023604 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544024202 | 1544024203 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544024802 | 1544024804 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544025766 | 1544025768 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544026366 | 1544026368 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544026966 | 1544026968 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544027605 | 1544027608 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544028205 | 1544028208 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544028805 | 1544028808 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544029405 | 1544029408 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544030005 | 1544030008 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544030605 | 1544030608 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544031205 | 1544031208 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544031805 | 1544031808 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544032405 | 1544032408 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544033005 | 1544033007 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544033308 | 1544033310 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544033908 | 1544033910 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544034508 | 1544034510 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544035108 | 1544035110 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544035708 | 1544035710 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544036308 | 1544036310 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544036908 | 1544036910 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544037814 | 1544037816 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544038414 | 1544038416 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544039014 | 1544039016 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544039614 | 1544039616 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544040214 | 1544040216 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544040814 | 1544040816 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544041414 | 1544041416 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544042014 | 1544042016 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544042614 | 1544042616 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544043214 | 1544043216 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544043814 | 1544043816 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544044414 | 1544044416 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544045014 | 1544045016 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544045614 | 1544045616 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544046214 | 1544046216 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544046814 | 1544046816 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544047414 | 1544047416 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544048014 | 1544048016 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544048614 | 1544048616 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544049214 | 1544049216 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544049814 | 1544049816 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544050414 | 1544050416 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544051014 | 1544051016 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544051614 | 1544051616 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544052214 | 1544052216 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544052814 | 1544052816 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544053414 | 1544053416 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544054014 | 1544054016 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544054614 | 1544054616 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544055214 | 1544055216 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544055814 | 1544055816 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544056414 | 1544056416 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544057014 | 1544057016 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544057614 | 1544057616 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544058214 | 1544058216 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544058814 | 1544058816 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544059414 | 1544059416 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544060014 | 1544060016 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544060614 | 1544060616 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544061214 | 1544061216 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544061814 | 1544061816 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544062414 | 1544062416 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544063014 | 1544063016 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544063614 | 1544063616 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544064214 | 1544064216 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544064814 | 1544064816 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544065414 | 1544065416 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544066014 | 1544066016 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544066690 | 1544066692 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544067290 | 1544067292 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544067890 | 1544067892 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544068490 | 1544068492 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544069090 | 1544069092 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544069690 | 1544069693 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544070290 | 1544070292 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544070352 | 1544070354 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544070952 | 1544070954 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544071552 | 1544071554 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544072152 | 1544072154 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544072752 | 1544072754 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544073352 | 1544073354 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544073952 | 1544073954 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544074552 | 1544074554 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544075152 | 1544075154 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544075752 | 1544075754 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544076352 | 1544076354 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544076952 | 1544076954 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544077552 | 1544077554 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544078152 | 1544078155 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544078752 | 1544078754 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544079352 | 1544079354 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544079952 | 1544079954 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544080552 | 1544080554 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544081152 | 1544081154 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544081752 | 1544081754 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544082352 | 1544082354 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544082952 | 1544082954 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544083552 | 1544083554 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544084152 | 1544084154 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544084752 | 1544084754 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544085352 | 1544085354 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544085952 | 1544085954 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544086552 | 1544086554 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544087152 | 1544087154 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544087752 | 1544087754 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544088352 | 1544088354 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544088952 | 1544088954 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544089552 | 1544089554 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544090152 | 1544090154 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544090752 | 1544090754 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544091352 | 1544091354 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544091952 | 1544091954 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544092552 | 1544092554 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544093152 | 1544093154 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544093752 | 1544093754 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544094352 | 1544094354 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544094952 | 1544094954 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544095552 | 1544095554 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544096152 | 1544096154 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544096752 | 1544096754 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544097352 | 1544097354 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544097952 | 1544097954 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544098552 | 1544098554 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544099152 | 1544099154 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544099752 | 1544099754 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544100352 | 1544100354 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544100952 | 1544100954 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544101449 | 1544101451 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544102049 | 1544102051 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544102649 | 1544102651 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544103585 | 1544103587 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544104186 | 1544104188 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544104786 | 1544104788 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544105386 | 1544105388 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544105986 | 1544105988 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544106586 | 1544106588 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544107521 | 1544107522 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544108121 | 1544108122 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544108721 | 1544108722 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544109498 | 1544109500 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544110098 | 1544110100 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544110698 | 1544110700 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544111298 | 1544111300 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544111898 | 1544111901 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544112498 | 1544112500 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544113098 | 1544113101 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544113586 | 1544113588 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544114186 | 1544114188 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544114786 | 1544114788 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544115386 | 1544115388 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544115986 | 1544115988 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544116586 | 1544116588 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544117186 | 1544117188 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544117786 | 1544117788 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544118386 | 1544118388 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544118986 | 1544118988 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544119586 | 1544119588 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544120186 | 1544120188 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544120786 | 1544120788 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544121386 | 1544121388 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544121986 | 1544121988 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544122586 | 1544122588 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544123186 | 1544123188 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544123786 | 1544123788 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544124386 | 1544124388 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544124986 | 1544124988 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544125586 | 1544125588 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544126186 | 1544126188 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544126787 | 1544126789 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544127387 | 1544127389 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544127987 | 1544127989 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544128587 | 1544128589 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544129187 | 1544129189 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544129787 | 1544129789 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544130387 | 1544130389 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544130987 | 1544130989 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544131587 | 1544131589 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544132187 | 1544132189 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544132787 | 1544132789 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544133387 | 1544133389 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544133987 | 1544133989 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544134587 | 1544134589 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544135187 | 1544135189 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544135787 | 1544135789 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544136387 | 1544136389 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544136987 | 1544136989 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544137587 | 1544137589 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544138187 | 1544138189 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544138787 | 1544138789 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544139387 | 1544139389 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544139987 | 1544139989 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544140587 | 1544140589 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544141187 | 1544141189 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544141787 | 1544141789 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544142387 | 1544142389 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544142987 | 1544142989 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544143587 | 1544143589 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544144187 | 1544144189 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544144787 | 1544144789 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544145387 | 1544145389 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544145987 | 1544145989 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544146587 | 1544146589 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544147187 | 1544147189 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544147787 | 1544147789 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544148387 | 1544148389 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544148987 | 1544148989 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544149587 | 1544149589 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544150187 | 1544150189 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544150787 | 1544150789 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544151387 | 1544151389 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544151987 | 1544151989 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544152587 | 1544152589 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544153187 | 1544153189 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544153787 | 1544153789 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544154387 | 1544154389 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544154987 | 1544154989 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544155587 | 1544155589 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544156187 | 1544156189 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544156787 | 1544156789 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544157387 | 1544157389 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544157987 | 1544157989 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544158593 | 1544158596 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544159193 | 1544159195 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544159793 | 1544159795 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544160393 | 1544160395 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544160993 | 1544160996 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544161593 | 1544161595 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544162193 | 1544162195 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544162793 | 1544162795 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544163393 | 1544163395 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544163993 | 1544163996 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544164593 | 1544164595 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544165193 | 1544165195 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544165793 | 1544165795 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544166393 | 1544166395 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544166993 | 1544166995 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544167593 | 1544167596 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544168193 | 1544168195 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544168793 | 1544168796 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544169393 | 1544169396 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544169993 | 1544169995 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544170593 | 1544170596 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544171193 | 1544171195 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544171793 | 1544171795 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544172393 | 1544172396 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544172993 | 1544172996 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544173593 | 1544173595 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544174193 | 1544174195 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544174793 | 1544174795 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544175393 | 1544175396 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544175993 | 1544175995 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544176593 | 1544176596 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544177193 | 1544177195 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544177793 | 1544177796 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544178393 | 1544178395 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544179223 | 1544179226 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544179823 | 1544179826 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544180423 | 1544180426 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544181023 | 1544181026 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544181623 | 1544181626 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544182223 | 1544182226 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544182823 | 1544182826 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544183423 | 1544183426 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544184023 | 1544184026 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544184086 | 1544184088 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544184686 | 1544184688 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544185286 | 1544185287 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544185886 | 1544185888 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544186486 | 1544186488 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544187085 | 1544187087 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544187638 | 1544187641 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544188238 | 1544188241 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544188838 | 1544188841 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544189438 | 1544189441 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544189899 | 1544189901 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544190499 | 1544190501 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544191099 | 1544191101 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544191699 | 1544191701 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544192299 | 1544192301 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544192899 | 1544192901 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544193499 | 1544193501 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544194099 | 1544194101 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544194699 | 1544194701 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544195299 | 1544195301 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544195899 | 1544195901 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544196499 | 1544196501 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544197099 | 1544197101 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544197699 | 1544197701 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544198299 | 1544198301 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544198899 | 1544198901 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544199499 | 1544199501 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544200099 | 1544200101 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544200699 | 1544200701 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544201299 | 1544201301 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544201899 | 1544201901 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544202499 | 1544202501 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544203099 | 1544203101 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544203699 | 1544203701 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544203762 | 1544203764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544204362 | 1544204364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544204962 | 1544204964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544205562 | 1544205564 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544206162 | 1544206164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544206762 | 1544206764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544207362 | 1544207364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544207962 | 1544207964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544208562 | 1544208564 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544209162 | 1544209164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544209762 | 1544209764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544210362 | 1544210364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544210962 | 1544210964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544211562 | 1544211564 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544212162 | 1544212164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544212762 | 1544212764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544213362 | 1544213364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544213962 | 1544213964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544214562 | 1544214564 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544215162 | 1544215164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544215762 | 1544215764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544216362 | 1544216364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544216962 | 1544216964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544217562 | 1544217564 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544218162 | 1544218164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544218762 | 1544218764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544219362 | 1544219364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544219962 | 1544219964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544220562 | 1544220564 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544221162 | 1544221164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544221762 | 1544221764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544222362 | 1544222364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544222962 | 1544222964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544223562 | 1544223564 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544224162 | 1544224164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544224762 | 1544224764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544225362 | 1544225364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544225962 | 1544225964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544226562 | 1544226564 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544227162 | 1544227164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544227762 | 1544227764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544228362 | 1544228364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544228962 | 1544228964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544229562 | 1544229564 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544230162 | 1544230164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544230762 | 1544230764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544231362 | 1544231364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544231962 | 1544231964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544232562 | 1544232564 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544233162 | 1544233164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544233762 | 1544233764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544234362 | 1544234364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544234962 | 1544234964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544235562 | 1544235564 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544236162 | 1544236164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544236762 | 1544236764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544237362 | 1544237364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544237962 | 1544237964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544238562 | 1544238564 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544239162 | 1544239164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544239762 | 1544239764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544240362 | 1544240364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544240962 | 1544240964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544241562 | 1544241564 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544242162 | 1544242164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544242762 | 1544242764 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544243362 | 1544243364 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544243962 | 1544243964 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544244562 | 1544244564 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544245162 | 1544245164 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544245224 | 1544245226 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544245824 | 1544245826 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544246424 | 1544246426 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544247024 | 1544247026 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544247624 | 1544247626 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544248224 | 1544248226 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544248824 | 1544248826 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544249424 | 1544249426 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544250024 | 1544250026 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544250624 | 1544250626 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544251224 | 1544251226 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544251824 | 1544251826 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544252424 | 1544252426 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544253024 | 1544253026 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544253624 | 1544253626 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544254224 | 1544254226 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544254825 | 1544254827 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544255425 | 1544255428 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544256025 | 1544256027 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544256625 | 1544256627 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544257225 | 1544257227 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544257825 | 1544257827 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544258425 | 1544258427 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544259025 | 1544259027 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544259625 | 1544259627 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544260225 | 1544260227 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544260825 | 1544260828 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544261425 | 1544261427 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544262025 | 1544262027 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544262625 | 1544262627 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544263225 | 1544263227 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544263825 | 1544263827 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544264425 | 1544264427 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544265025 | 1544265027 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544265625 | 1544265627 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544266225 | 1544266227 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544266825 | 1544266827 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544267425 | 1544267427 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544268025 | 1544268027 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544268087 | 1544268089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544268687 | 1544268689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544269287 | 1544269289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544269887 | 1544269889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544270487 | 1544270489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544271087 | 1544271089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544271687 | 1544271689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544272287 | 1544272307 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544272887 | 1544272889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544273487 | 1544273489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544274087 | 1544274089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544274687 | 1544274689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544275287 | 1544275289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544275887 | 1544275889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544276487 | 1544276489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544277087 | 1544277089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544277687 | 1544277689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544278287 | 1544278289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544278887 | 1544278889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544279487 | 1544279489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544280087 | 1544280089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544280687 | 1544280689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544281287 | 1544281289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544281887 | 1544281889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544282487 | 1544282489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544283087 | 1544283089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544283687 | 1544283689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544284287 | 1544284289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544284887 | 1544284889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544285487 | 1544285489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544286087 | 1544286089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544286687 | 1544286689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544287287 | 1544287289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544287887 | 1544287889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544288487 | 1544288489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544289087 | 1544289089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544289687 | 1544289689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544290287 | 1544290289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544290887 | 1544290889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544291487 | 1544291489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544292087 | 1544292089 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544292687 | 1544292689 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544293287 | 1544293289 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544293887 | 1544293889 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544294487 | 1544294489 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544295635 | 1544295635 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544296235 | 1544296235 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544296835 | 1544296835 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544297435 | 1544297435 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544298160 | 1544298162 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544298760 | 1544298762 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544299360 | 1544299362 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544299960 | 1544299962 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544300560 | 1544300562 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544301160 | 1544301162 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544301222 | 1544301223 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544301822 | 1544301823 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544302422 | 1544302423 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544303022 | 1544303023 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544303622 | 1544303623 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544304222 | 1544304223 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544304822 | 1544304823 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544305422 | 1544305423 |                     1 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544306022 | 1544306023 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544306622 | 1544306626 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544306686 | 1544306690 |                     2 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544306750 | 1544306753 |                     3 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544306813 | 1544306817 |                     4 |                  5 |
|    Host1   |        Service1     |     2 |            1 | 1544306877 | 1544306881 |                     5 |                  5 |
|    Host1   |        Service1     |     0 |            1 | 1544307477 | 1544307479 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544308077 | 1544308081 |                     1 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544308141 | 1544308145 |                     2 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544308205 | 1544308209 |                     3 |                  5 |
|    Host1   |        Service1     |     2 |            0 | 1544308269 | 1544308273 |                     4 |                  5 |
|    Host1   |        Service1     |     2 |            1 | 1544308333 | 1544308337 |                     5 |                  5 |
|    Host1   |        Service1     |     2 |            1 | 1544308933 | 1544308937 |                     5 |                  5 |
+------------+------------------------------+-------+--------------+------------+------------+-----------------------+-----------+
1168 rows in set (0.01 sec)
nook24 commented 5 years ago

Could you please create an sql dump like this mysqldump --databases statusengine --tables statusengine_servicechecks --where="hostname = 'Host1' AND service_description = 'Service1'and start_time > 1543276000 and start_time < 1544309000" > statusengine_servicechecks.sql :)

nook24 commented 5 years ago

A little confused when you said it had hit critical soft and recovered in my case. The below entry from statusengine_servicechecks table signifies that the hard state was achieved. It is just that the entry is missing from statusengine_service_statehistory table for some reason unknown to me

+------------+------------------------------+-------+--------------+------------+------------+-----------------------+
| hostname   | service_description          | state | is_hardstate | start_time | end_time   | current_check_attempt |
+------------+------------------------------+-------+--------------+------------+------------+-----------------------+
|      Host1 |                     Service1 |     2 |            1 | 1544306877 | 1544306881 |                     5 |

The entries from statusengine_service_statehistory table between which this should have been present are:

+------------+------------------------------+------------+--------------+-------+--------------+-----------------------+------------+-----------------+
| hostname   | service_description          | state_time | state_change | state | is_hardstate | current_check_attempt | last_state | last_hard_state |
+------------+------------------------------+------------+--------------+-------+--------------+-----------------------+------------+-----------------+
|      Host1 |                     Service1 | 1543277496 |            1 |     0 |            1 |                     5 |          2 |               2 |
|      Host1 |                     Service1 | 1544307479 |            1 |     0 |            1 |                     5 |          2 |               2 |

Please let me know if I'm missing something. I know the statehistory table doesn't have data but the servicechecks table does and that is what I'm not sure why it wont if the the critical was hit 5/5.

Yes - you are totally right! For some reason the critical hard state record is missing in the statehistory table. I didn't saw this yesterday evening, sorry :(

As you already mentioned, this record from service checks table is missing in the state history table:

|    Host1   |        Service1     |     2 |            1 | 1544306877 | 1544306881 |                     5 |                  5 |

That also matches exactly with the log you posted

mysql> select * from statusengine_logentries
             where logentry_data LIKE '%Host1;Service1%'
             and entry_time > 1543276000 and entry_time < 1544309000
             ORDER BY entry_time;
+------------+---------------+------------------------------------------------------------------------+-----------+
| entry_time | logentry_type | logentry_data                                                          | node_name |
+------------+---------------+------------------------------------------------------------------------+-----------+
| 1544306881 |         65536 | SERVICE ALERT: Host1;Service1;CRITICAL;HARD;5;CRITICAL - <Hidden data> |   Node1   |
| 1544307479 |          8192 | SERVICE ALERT: Host1;Service1;OK;HARD;5;OK - Elapsed: 258ms            |   Node1   |
| 1544308337 |         65536 | SERVICE ALERT: Host1;Service1;CRITICAL;HARD;5;CRITICAL - <Hidden data> |   Node1   |
+------------+---------------+------------------------------------------------------------------------+-----------+
2 rows in set (0.06 sec)

Do you know if this is the only service with this issue?

I guess there are only three reasons, why this record is missing:

  1. Nagios/Naemon did not send the event.
  2. Statusengine got an error from MySQL Database.
  3. Gearman-Job-Server was unavailable

I also checked the Statusengine code, but could not find a reason for this. That's all really straightforward code.

So maybe MySQL returned an error != MySQL server has gone away. In this case, Statusengine will drop the data and try process the next record.

raghav8888 commented 5 years ago

I checked and found that this was the only entry. There are error for MySQL server in the logs at points but there is none before and after many hours of the time when the record was created in service_checks. The gearman has been seen picking up and processing results at the same time.

I'll leave it upto you if you can find a potential cause... else I'm fine letting this one being sucked into the blackhole of unexplainable IT issues :)

nook24 commented 5 years ago

I guess it was eaten by an magic unicorn 😀

I will close this down for now. Feel free to create a new issue, if you are affected by data loss again.

PS: Statusengine will log any SQL errors to the syslog as LOG_ERR

Kumar888 commented 5 years ago

Hi Raghav/Nook,

Continue to this issue i'm going to explaining issue facing while generating availibility report.

Issue: example scenario: if create a report for each day getting 100 % and for 10 days it should be 100 % available, but while creating report for period of 10 days it's 98.50.

i'm getting differences(eg: -1,-2,-3 etc) in report while generating for perticuler period than generating and caluculating on daily basis.

Can you please suggest a way to solve this issue as it serious issue as per percentage differences.

Thanks Vijay

nook24 commented 5 years ago

Hi @Kumar888, could you please post the script you use for report generation?

Kumar888 commented 5 years ago

I believe @raghav8888 explained about the script above, i'm working on the same script which he developed.

nook24 commented 5 years ago

There was an issue In Naemon, where last_hard_state was not behaving like expected. (Or at least, as I always thought it would behave like)

In some conditions, last_hard_state was not the previous_hard_state. This was patched in Naemon: https://github.com/naemon/naemon-core/pull/291

This issue also exists (and was resolved but not released yet) in Nagios Core: https://github.com/NagiosEnterprises/nagioscore/issues/633

From the Issue description:

So what happens in detail

When a Service switches from state Ok Hard to Critical Soft(1/3),Critical Soft(2/3)/Critical Hard(3/3) while the Host is in state Up the field last_hard_state acts as previous_hard_state (in the state change event). This is quite nice. I use this to build up a state history and track state change events. I also think it makes total sense, that a state change event can provide me information about the current state, and the previous state.

How ever. If the Host is in a non Up state last_hard_state behaves as latest_hard_state. This issue is caused by the fact, that a Soft state change will get forced into a hard state change by the system, if the host is in a non Up state.

Would be good if last_hard_state would always behave independently from the host state of a service.

You should check your database how many records were affected by this issue. May be this is causing the issue.

If this is not the root cause, you should past your script to https://gist.github.com/.

Kumar888 commented 5 years ago

What could be the naemon version for this fix. As we are using naemon 8. For the latest version is the above query works or do we need any change in query. However in my case issue is percentage caluculation is not my matching for specific days duration with daily percentage for availability generated on specific service.

nook24 commented 5 years ago

This got fixed with Naemon 1.0.10. But I guess the issue is properly some inside your python script.

nook24 commented 5 years ago

Issue: example scenario: if create a report for each day getting 100 % and for 10 days it should be 100 % available, but while creating report for period of 10 days it's 98.50.

Especially if the percentage calculation works for all 10 days correctly if done day by day, but not if done 10 days at ones. Or am I missing something here?

Kumar888 commented 5 years ago

Yes. If we take day by day and some them for 10 days and divide by 10 manually is not getting same as report generated for 10 days through script. Getting differences 1,2,3 % for different host. Could it be python script issue or naemon 1.0.8 issue?

As we are caluculating availability by considering scheduled downtime, suspecting this might be issue for longer duration.

nook24 commented 5 years ago

Could it be python script issue or naemon 1.0.8 issue?

To make sure that the issue was not caused by Naemon 1.0.8 take a host that was UP for all the time and see what the availability report says. The issue fixed with Naemon 1.0.10 only effects records where the host was in a non UP state.

In the next step you need to calculate the report manually. I also needed to do this for my employer and i know this can be is a pain. Choose one service of a host where the report calculates wrong results. Than query all state change records (statusengine_service_statehistory) from the database of this service ordered by time.

Than the fun begins and you manually calculate the availability. Due to the fact that this table only contains state change records, the amount of data should not be that super big. Approximately not more than 50 records per service i think.

If you also considering scheduled downtime its event more fun :)

If the results are the same than the report claims something is fishy with your database otherwise your script is buggy.

Kumar888 commented 5 years ago

Hi @nook24 ,

I have taken one host which giving wrong percentage. for that i have triggered script for 1 day(eg:start time:2019.06.01 00:00:00 and end time:2019.06.02 00:00:00) got 100 % availability for perticuler service based on which we are caluculating availability and triggered seperatetly for one more day (eg: start time:2019.06.02 00:00:00 and end time:2019.06.03 00:00:00) and given 100 % availability. After that i triggered script for two days (eg:start time:2019.06.01 00:00:00 and end time:2019.06.03 00:00:00) for which i got 94.55 % availability. not able to understand why getting this difference for same time period. same way for three days it's giving different output while third day also has 100% by trigger script seperately for that day. Could you please give your thoughts on this.

Thanks Vijay

Kumar888 commented 5 years ago

Hi @nook24 ,

I just want to try with latest version naemon 1.0.10. do we need any query changes required? As we have used your above queries.

nook24 commented 5 years ago

naemon 1.0.10. do we need any query changes required?

Data that got written wrong into the database is still wrong, even if you upgrade to Naemon 1.0.10...

How ever. For me this sounds like a bug in your python script. Please go through the steps I described in https://github.com/statusengine/worker/issues/16#issuecomment-502375629

Edit Could also be a rounding issue in your script

raghav8888 commented 5 years ago

@Kumar888 All that I can suggest is there is no easy way out here. You have to debug the code line by line to determine why the difference is being observed. Once you find out the anomaly in the DB or the script, put the fix in the appropriate place. For eg: take a service for a period of 10 days and actually verify step by step where is it breaking. And compare of it with start and end time as each day.

Kumar888 commented 5 years ago

Hi @raghav8888/@nook24 thanks for help, I have find out small issue in script and fixed it, now it's able giving most of the hosts i have checked percentage matching correctly for 10,19 days etc with each day caluculation and sum & pecentage.

nook24 commented 5 years ago

Due to this is related to your script, do you also going to close down #20?

Kumar888 commented 5 years ago

@nook24 i have closed the issue.