search

qmetry / qaf

Quality Automation Framework for web, mobileweb, mobile native and rest web-service using Selenium, webdrier, TestNG and Java Jersey
https://qmetry.github.io/qaf
MIT License
254 stars 138 forks source link

ResultUpdator will only update one entry in meta-info.json under test-results folder when do parallel suite execution #361

Closed WendyZ123 closed 3 years ago

WendyZ123 commented 3 years ago

QAF Version

3.0.0

Steps To Reproduce

 1.Add `JsonReporter` as result updator

result.updator=com.qmetry.qaf.automation.report.JsonReporter
disable.qaf.testng.reporter=true
qaf.json.reporter=true

2.set suitethreadpoolsize to 3 in pom file

Pom plugin settings: `<?xml version="1.0" encoding="UTF-8"?>

org.apache.maven.plugins maven-surefire-plugin ${mvnSurefirePlugin} config/master.xml suitethreadpoolsize 3 ${test.results.dir} ... ` 3.in master suite, config 3 suite files: test1.xml, test2.xml, teste.xml **master.xml** ` ` **test1.xml** ` ` test2.xml and test3.xml are similar as test1.xml 4.execution: run command "mvn test" ### Expected behavior There should be three entries displayed in meta-info.json for each test suite (My assumption based on new report folder structure) { "reports": [ { "name": "Test1 Suite", "dir": "test-results/20210129113859AM/json/test1Suite", "startTime": 1611887956726 }, { "name": "Test2 Suite", "dir": "test-results/20210129113859AM/json/test2Suite", "startTime": 1611887956726 }, { "name": "Test3 Suite", "dir": "test-results/20210129113859AM/json/test3Suite", "startTime": 1611887956726 } ] } ### Actual behavior Only display one entry in meta-info.json (under test-results folder) { "reports": [ { "name": "Test3 Suite", "dir": "test-results/20210129113859AM/json/test3Suite", "startTime": 1611887956726 } ] } ### Is the issue reproducible on runner? Yes - [ ] QAS - [x] Maven - [ ] Gradle - [ ] Ant - [ ] Eclipse ### Test case sample > test case: open up a chrome browser and load github page: https://github.com/