search

testng-team / testng-eclipse

Eclipse plug-in for TestNG
https://testng.org
193 stars 164 forks source link

better ability to copy results from TestNG Eclipse Results view #471

Open twhitmorenz opened 4 years ago

twhitmorenz commented 4 years ago

Problem Statement

We run large test-suites in a large application & have a major need to be able to compare results before/ after changes. It would really help to have the ability to cope & paste the contents of the Results view more easily.

Specific suggestions for improvement:

  1. Offer a right-click 'Copy All' in the Results All and Failed Tests panes, to copy a list of tests results with classname & method etc.
  2. Make Ctrl-C work to copy the test class & name in the 'Results' pane.
  3. Make Ctrl-C work to copy the entire stacktrace (not truncated, please) in the 'Failure Exception' pane.
  4. Make double-click on a Classname in the Results pane navigate to that class. (At present only double-clicking a Test Name navigates.)

Our organization chose TestNG for its advantages over JUnit. We have 400 developers working concurrently and 6200 tests, our tests are mostly green but at this scale (10m+ loc) there are often 20-40 failures. (When doing larger refactoring, up to 100-150 failures.)

It's really crucial working at this larger scale to be able to do a comparisons of results, to see what is broken from Run B versus Run A. However the current Results UI does not have any effective way to copy this information out so we can compare it against the next run.

Any improvements in this area would be much appreciated!

Any relate message in "Error Log" view

n/a

The Dependency Management tool for your project

Maven

Operating System

Windows Eclipse IDE for Java Developers 4.7.2.20171218-0600 epp.package.java Eclipse Packaging Project TestNG 6.14.0.201802161500 org.testng.eclipse.feature.group Cedric Beust

twhitmorenz commented 4 years ago

I am aware there are HTML reports in the 'test-output' folder. I personally save & use these for comparison sometimes, however this is too hidden for most of our developers and they don't use it.