SeleniumHQ / selenium-ide

Open Source record and playback test automation for the web.
https://selenium.dev/selenium-ide/
Apache License 2.0
2.82k stars 768 forks source link

When "parallel": true is set in .side, in xml result testsuite name="undefined" #1314

Open QAtch22 opened 2 years ago

QAtch22 commented 2 years ago

๐Ÿ› Bug Report

Hi,

Like the title says, when you set parallel to "true" in .side, in xml result testsuite name is "undefined".

When this simple test suite is run with "parallel": true, testsuite name is "undefined". When run with "parallel": false, testsuite name is as it should be.

{ "id": "31adc368-fd4b-4113-9406-2a507ad4ebb6", "version": "2.0", "name": "parallel_undefined", "url": "https://www.google.com/ncr", "tests": [{ "id": "2ec3b1bb-3c0f-4839-b1bb-f4e2dfa3b525", "name": "test01", "commands": [{ "id": "321cf8ed-6613-472a-b8d4-7ddcf099dfb1", "comment": "", "command": "open", "target": "https://www.google.com/ncr", "targets": [], "value": "" }, { "id": "97550c26-21ef-46a6-9317-dff1544b33af", "comment": "", "command": "setWindowSize", "target": "1366x728", "targets": [], "value": "" }, { "id": "40adb56e-0813-43f6-9907-b5db65b9ece4", "comment": "", "command": "type", "target": "name=q", "targets": [ ["name=q", "name"], ["css=.gLFyf", "css:finder"], ["xpath=//input[@name='q']", "xpath:attributes"], ["xpath=//input", "xpath:position"] ], "value": "selenium" }, { "id": "dc507b58-6d48-4cd9-bb7b-c7cc8a959dab", "comment": "", "command": "sendKeys", "target": "name=q", "targets": [ ["name=q", "name"], ["css=.gLFyf", "css:finder"], ["xpath=//input[@name='q']", "xpath:attributes"], ["xpath=//input", "xpath:position"] ], "value": "${KEY_ENTER}" }, { "id": "5ec687ee-8f35-4a9a-ad99-9983ff480982", "comment": "", "command": "mouseOver", "target": "css=div:nth-child(2) > .tF2Cxc > .yuRUbf .LC20lb", "targets": [ ["css=div:nth-child(2) > .tF2Cxc > .yuRUbf .LC20lb", "css:finder"], ["xpath=//div[@id='rso']/div/div/div/div/div/div/div/div/a/h3", "xpath:idRelative"], ["xpath=//h3", "xpath:position"], ["xpath=//h3[contains(.,'Selenium')]", "xpath:innerText"] ], "value": "" }, { "id": "003fc3da-0049-4a5a-8d6e-6b5319ab5cc8", "comment": "", "command": "click", "target": "css=div:nth-child(2) > .tF2Cxc > .yuRUbf .LC20lb", "targets": [ ["css=div:nth-child(2) > .tF2Cxc > .yuRUbf .LC20lb", "css:finder"], ["xpath=//div[@id='rso']/div/div/div/div/div/div/div/div/a/h3", "xpath:idRelative"], ["xpath=//h3", "xpath:position"], ["xpath=//h3[contains(.,'Selenium')]", "xpath:innerText"] ], "value": "" }] }, { "id": "3d3dec9b-7bcd-4b7e-b56f-a01917fac74f", "name": "test02", "commands": [{ "id": "7f9b4f49-7058-4387-85e0-f018025a908a", "comment": "", "command": "open", "target": "https://www.google.com/ncr", "targets": [], "value": "" }, { "id": "1819057a-8c5a-4dc2-9952-4ba4a8b1af43", "comment": "", "command": "setWindowSize", "target": "1366x728", "targets": [], "value": "" }, { "id": "29f6bc8d-cb98-4c84-b9ed-2ea46177cba8", "comment": "", "command": "type", "target": "name=q", "targets": [ ["name=q", "name"], ["css=.gLFyf", "css:finder"], ["xpath=//input[@name='q']", "xpath:attributes"], ["xpath=//input", "xpath:position"] ], "value": "side-runner" }, { "id": "7778426f-eb9f-4365-bd18-b11f9f286115", "comment": "", "command": "sendKeys", "target": "name=q", "targets": [ ["name=q", "name"], ["css=.gLFyf", "css:finder"], ["xpath=//input[@name='q']", "xpath:attributes"], ["xpath=//input", "xpath:position"] ], "value": "${KEY_ENTER}" }, { "id": "53e0089b-6791-496d-ba0b-b2a6541fceee", "comment": "", "command": "click", "target": "css=.g:nth-child(7) .LC20lb", "targets": [ ["css=.g:nth-child(7) .LC20lb", "css:finder"], ["xpath=//div[@id='rso']/div[2]/div/div/div/div/a/h3", "xpath:idRelative"], ["xpath=//div[2]/div/div/div/div/a/h3", "xpath:position"], ["xpath=//h3[contains(.,'Command-line Runner ยท Selenium IDE')]", "xpath:innerText"] ], "value": "" }] }], "suites": [{ "id": "e3458523-76e7-4e4e-9cce-815e11a9c21f", "name": "testsuite01", "persistSession": false, "parallel": true, "timeout": 300, "tests": ["2ec3b1bb-3c0f-4839-b1bb-f4e2dfa3b525", "3d3dec9b-7bcd-4b7e-b56f-a01917fac74f"] }], "urls": ["https://www.google.com/ncr"], "plugins": [] }

To Reproduce

Run the above test in side-runner with --output-format=junit, and check the xml result file - testsuite name is "undefined".

Expected behavior

testsuite name should be correct no matter if parallel is true or false.

Project file reproducing this issue (highly encouraged)

copy the code above to .side file.

Environment

OS: Windows 10 Selenium IDE Version: 3.17.2 Selenium SIDE Runner Version: 3.17.0 Node version: 14.17.6 Browser: Chrome Version: 97.0.4692.71 (64-bit)

toddtarsi commented 2 years ago

Very interesting, thank you for providing a good reproduction path. Unfortunately, my current and most immediate goal is v4 of the IDE, which I'm aiming to get out around April. After that is out, I intend to come back around and revisit / triage more nuanced issues like this. I'm sorry if this affects your ability to perform your workflow, but its the best move I can make for the long term health of this tooling.

QAtch22 commented 2 years ago

OK, this is not the issue of higher priority of course, thanks for taking the time to check it out, looking forward to IDE V4.