Closed svettwer closed 4 years ago
Tests with multiple spool files have shown, that the missing new line at the end of the file confuses CheckMk.
Current output with three spool files (not working with checkmk)
<<<local>>>
0 integrationtest suite__state=0;;;;|suite__warning=0s;;;;|suite__critical=0s;;;;|suite_integrationtest=4.67s;0;0;;|c_001__state=0;;;;|c_001__warning=0s;;;;|c_001__critical=0s;;;;|c_001_Testcase=4.58s;0;0;;|s_001_001_Open_Landing_Page=1.23s;100;;;|s_001_002_Navigate_to_Getting_Started=1.13s;30;;;|s_001_003_Find_npm_init_code_sample=2.22s;;;; [OK] Sakuli suite "integrationtest" ok (4.67s). (Last suite run: 21.01.20 08:34:03)<<<<sakuli.io>>>>
<<<local>>>
2 integrationtest2 suite__state=2;;;;|suite__warning=0s;;;;|suite__critical=0s;;;;|suite_integrationtest2=U;0;0;;|c_001__state=2;;;;|c_001__warning=0s;;;;|c_001__critical=0s;;;;|c_001_Testcase=U;0;0;;|s_001_001_Open_Landing_Page=0.27s;100;;;|s_001_002_Navigate_to_Getting_Started=U;30;;; [CRIT] Sakuli suite "integrationtest2" (3.42s) EXCEPTION: CASE "Testcase": STEP "Navigate to Getting Started": A non StaleElementReferenceError is thrown during retrying; TimeoutError: Cannot find Element within 3000ms by query: Locator: By(css selector...
<<<<>>>><<<local>>>
2 integrationtest3 suite__state=2;;;;|suite__warning=0s;;;;|suite__critical=0s;;;;|suite_integrationtest3=U;0;0;;|c_001__state=2;;;;|c_001__warning=0s;;;;|c_001__critical=0s;;;;|c_001_Testcase=U;0;0;;|s_001_001_Open_Landing_Page=0.57s;100;;;|s_001_002_Navigate_to_Getting_Started=U;30;;; [CRIT] Sakuli suite "integrationtest3" (4.24s) EXCEPTION: CASE "Testcase": STEP "Navigate to Getting Started": A non StaleElementReferenceError is thrown during retrying; TimeoutError: Cannot find Element within 3000ms by query: Locator: By(css selector...
Output from E2E Test with manipulated spool files (working with checmk)
<<<local>>>
0 integrationtest suite__state=0;;;;|suite__warning=0s;;;;|suite__critical=0s;;;;|suite_integrationtest=5.44s;0;0;;|c_001__state=0;;;;|c_001__warning=0s;;;;|c_001__critical=0s;;;;|c_001_Testcase=5.37s;0;0;;|s_001_001_Open_Landing_Page=1.22s;100;;;|s_001_002_Navigate_to_Getting_Started=1.97s;30;;;|s_001_003_Find_npm_init_code_sample=2.18s;;;; [OK] Sakuli suite "integrationtest" ok (5.44s). (Last suite run: 21.01.20 08:35:17)
<<<<sakuli.io>>>>
<<<local>>>
2 integrationtest2 suite__state=2;;;;|suite__warning=0s;;;;|suite__critical=0s;;;;|suite_integrationtest2=U;0;0;;|c_001__state=2;;;;|c_001__warning=0s;;;;|c_001__critical=0s;;;;|c_001_Testcase=U;0;0;;|s_001_001_Open_Landing_Page=0.66s;100;;;|s_001_002_Navigate_to_Getting_Started=U;30;;; [CRIT] Sakuli suite "integrationtest2" (3.96s) EXCEPTION: CASE "Testcase": STEP "Navigate to Getting Started": A non StaleElementReferenceError is thrown during retrying; TimeoutError: Cannot find Element within 3000ms by query: Locator: By(css selector...
<<<<>>>>
<<<local>>>
2 integrationtest3 suite__state=2;;;;|suite__warning=0s;;;;|suite__critical=0s;;;;|suite_integrationtest3=U;0;0;;|c_001__state=2;;;;|c_001__warning=0s;;;;|c_001__critical=0s;;;;|c_001_Testcase=U;0;0;;|s_001_001_Open_Landing_Page=0.39s;100;;;|s_001_002_Navigate_to_Getting_Started=U;30;;; [CRIT] Sakuli suite "integrationtest3" (3.69s) EXCEPTION: CASE "Testcase": STEP "Navigate to Getting Started": A non StaleElementReferenceError is thrown during retrying; TimeoutError: Cannot find Element within 3000ms by query: Locator: By(css selector...
Due to customer reports, the format of the spool files might be a problem as the missing line ending, missing empty headline might confuse CheckMk when multiple spool files are read.
Acceptance criteria: