search

sakuli / sakuli-enterprise-forwarder

Sakuli Enterprise result forwarders for various monitoring systems
https://sakuli.io
Apache License 2.0
0 stars 1 forks source link

CheckMk - test multiple spool files #22

Closed svettwer closed 4 years ago

svettwer commented 4 years ago

Due to customer reports, the format of the spool files might be a problem as the missing line ending, missing empty headline might confuse CheckMk when multiple spool files are read.

Acceptance criteria:

svettwer commented 4 years ago

Tests with multiple spool files have shown, that the missing new line at the end of the file confuses CheckMk.

Current output with three spool files (not working with checkmk)

<<<local>>>
0 integrationtest suite__state=0;;;;|suite__warning=0s;;;;|suite__critical=0s;;;;|suite_integrationtest=4.67s;0;0;;|c_001__state=0;;;;|c_001__warning=0s;;;;|c_001__critical=0s;;;;|c_001_Testcase=4.58s;0;0;;|s_001_001_Open_Landing_Page=1.23s;100;;;|s_001_002_Navigate_to_Getting_Started=1.13s;30;;;|s_001_003_Find_npm_init_code_sample=2.22s;;;; [OK] Sakuli suite "integrationtest" ok (4.67s). (Last suite run: 21.01.20 08:34:03)<<<<sakuli.io>>>>
<<<local>>>
2 integrationtest2 suite__state=2;;;;|suite__warning=0s;;;;|suite__critical=0s;;;;|suite_integrationtest2=U;0;0;;|c_001__state=2;;;;|c_001__warning=0s;;;;|c_001__critical=0s;;;;|c_001_Testcase=U;0;0;;|s_001_001_Open_Landing_Page=0.27s;100;;;|s_001_002_Navigate_to_Getting_Started=U;30;;; [CRIT] Sakuli suite "integrationtest2" (3.42s) EXCEPTION: CASE "Testcase": STEP "Navigate to Getting Started": A non StaleElementReferenceError is thrown during retrying; TimeoutError: Cannot find Element within 3000ms by query: Locator: By(css selector...
<<<<>>>><<<local>>>
2 integrationtest3 suite__state=2;;;;|suite__warning=0s;;;;|suite__critical=0s;;;;|suite_integrationtest3=U;0;0;;|c_001__state=2;;;;|c_001__warning=0s;;;;|c_001__critical=0s;;;;|c_001_Testcase=U;0;0;;|s_001_001_Open_Landing_Page=0.57s;100;;;|s_001_002_Navigate_to_Getting_Started=U;30;;; [CRIT] Sakuli suite "integrationtest3" (4.24s) EXCEPTION: CASE "Testcase": STEP "Navigate to Getting Started": A non StaleElementReferenceError is thrown during retrying; TimeoutError: Cannot find Element within 3000ms by query: Locator: By(css selector...

Output from E2E Test with manipulated spool files (working with checmk)

<<<local>>>
0 integrationtest suite__state=0;;;;|suite__warning=0s;;;;|suite__critical=0s;;;;|suite_integrationtest=5.44s;0;0;;|c_001__state=0;;;;|c_001__warning=0s;;;;|c_001__critical=0s;;;;|c_001_Testcase=5.37s;0;0;;|s_001_001_Open_Landing_Page=1.22s;100;;;|s_001_002_Navigate_to_Getting_Started=1.97s;30;;;|s_001_003_Find_npm_init_code_sample=2.18s;;;; [OK] Sakuli suite "integrationtest" ok (5.44s). (Last suite run: 21.01.20 08:35:17)
<<<<sakuli.io>>>>
<<<local>>>
2 integrationtest2 suite__state=2;;;;|suite__warning=0s;;;;|suite__critical=0s;;;;|suite_integrationtest2=U;0;0;;|c_001__state=2;;;;|c_001__warning=0s;;;;|c_001__critical=0s;;;;|c_001_Testcase=U;0;0;;|s_001_001_Open_Landing_Page=0.66s;100;;;|s_001_002_Navigate_to_Getting_Started=U;30;;; [CRIT] Sakuli suite "integrationtest2" (3.96s) EXCEPTION: CASE "Testcase": STEP "Navigate to Getting Started": A non StaleElementReferenceError is thrown during retrying; TimeoutError: Cannot find Element within 3000ms by query: Locator: By(css selector...
<<<<>>>>
<<<local>>>
2 integrationtest3 suite__state=2;;;;|suite__warning=0s;;;;|suite__critical=0s;;;;|suite_integrationtest3=U;0;0;;|c_001__state=2;;;;|c_001__warning=0s;;;;|c_001__critical=0s;;;;|c_001_Testcase=U;0;0;;|s_001_001_Open_Landing_Page=0.39s;100;;;|s_001_002_Navigate_to_Getting_Started=U;30;;; [CRIT] Sakuli suite "integrationtest3" (3.69s) EXCEPTION: CASE "Testcase": STEP "Navigate to Getting Started": A non StaleElementReferenceError is thrown during retrying; TimeoutError: Cannot find Element within 3000ms by query: Locator: By(css selector...