achikin / testrail-jenkins-plugin

Integrate test results from Jenkins into TestRail(merged into jenkins main repo)
Apache License 2.0
26 stars 63 forks source link

I'm not sure that TestCase Errors or Skipped are ever reported to TestRail #11

Open Benjmeadows opened 8 years ago

Benjmeadows commented 8 years ago

From the Class:

public class Testsuite {
    private String name;
    private int failures;
    private int errors;
    private int skipped;
    private List<Testcase> cases;
    private List<Testsuite> suits;
    @XmlAttribute
    public void setName(String name) { this.name = name.trim(); }
    @XmlAttribute
    public void setFailures(int failures) { this.failures = failures; }
    @XmlAttribute
    public void setErrors(int errors) { this.errors = errors; }
    @XmlAttribute
    public void setSkipped(int skipped) { this.skipped = skipped; }
    @XmlElement(name = "testcase")
    public void setCases(List<Testcase> cases) { this.cases = cases; }
    @XmlElement(name = "testsuite")
    public void setSuits(List<Testsuite> suits) { this.suits = suits; }

    public String getName() { return this.name; }
    public List<Testcase> getCases() { return this.cases; }
    public List<Testsuite> getSuits() {return this.suits; }
    public int getFailures() { return this.failures; }
    public int getErrors() { return this.errors; }
    public int getSkipped() { return this.skipped; }
    public boolean hasSuits() { return this.suits != null; }
    public boolean hasCases() { return this.cases != null; }

I see in the TestRailNotifier where getSuits() is called and where getName() is called but I don't see anywhere in Notifier where getErros() or getSkipped() are called. Perhaps I am wrong and these are getting reported somewhere else or by another mechanism. Could you help me understand this because I am trying to figure out why my test suites are showing "passed" in TestRail but are failing in Jenkins with errors.

Thanks for forking this project and for putting it on github! If I can help contribute let me know!

Edited for formatting and removed getFailure() from list of things I believe aren't being reported. Last edit, promise.

xirsoi commented 7 years ago

Could you provide a test result that you are seeing this with? The xUnit xml or JSON document containing your results.