golemhq / golem

A complete test automation tool
http://golem-framework.readthedocs.io/
MIT License
489 stars 77 forks source link

JUnit uses set name as test name and breaks CI reporting #210

Open double-sigma opened 3 years ago

double-sigma commented 3 years ago

Hello!

I'm setting up a test suite written in Golem (0.9.2) in CI and every run test has a new name:

Run nr 1: <testcase name="set_ee501a" classname="testOne" time="6.13">

Run nr 2: <testcase name="set_9ec88c" classname="testOne" time="6.81">

Expected result is name="testOne"

JSON names things correctly, but Azure DevOps doesn't support importing JSON results :)

Run nr1:

{
            "test_set": "set_ee501a",
            "module": "",
            "sub_modules": [],
            "name": "testOne",
            "full_name": "testOne",
            "result": "success",
            "test_elapsed_time": 6.13,
            "start_date_time": "2021/05/14 00:37",
            "browser": "chrome (remote)",
            "data": {},
            "environment": "",
            "set_name": ""
        }

Run nr 2:

{
            "test_set": "set_9ec88c",
            "module": "",
            "sub_modules": [],
            "name": "testOne",
            "full_name": "testOne",
            "result": "success",
            "test_elapsed_time": 6.81,
            "start_date_time": "2021/05/14 00:44",
            "browser": "chrome (remote)",
            "data": {},
            "environment": "",
            "set_name": ""
        },