jenkinsci / nunit-plugin

Jenkins nunit plugin
https://plugins.jenkins.io/nunit/
MIT License
42 stars 55 forks source link

Plugin doesn't create attachments file for each test result #96

Open mcichonqa opened 8 months ago

mcichonqa commented 8 months ago

Jenkins and plugins versions report

Jenkins: 2.445 OS: Windows 10 - 10.0 Java: 11.0.2 - Oracle Corporation (OpenJDK 64-Bit Server VM)

ant:497.v94e7d9fffa_b_9 antisamy-markup-formatter:162.v0e6ec0fcfcf6 apache-httpcomponents-client-4-api:4.5.14-208.v438351942757 apache-httpcomponents-client-5-api:5.2.1-1.1 authentication-tokens:1.53.v1c90fd9191ab bootstrap5-api:5.3.2-2 bouncycastle-api:2.29 branch-api:2.1128.v717130d4f816 build-timeout:1.31 caffeine-api:3.1.8-133.v17b_1ff2e0599 checks-api:2.0.2 cloud-stats:320.v96b_65297a_4bb cloudbees-folder:6.858.v898218f3609d command-launcher:107.v773860566e2e commons-lang3-api:3.13.0-62.v7d18e55f51e2 commons-text-api:1.11.0-94.v3e1f4a_926e49 config-file-provider:959.vcff671a4518b credentials:1309.v8835d63ebd8a credentials-binding:642.v737c34dea_6c2 declarative-pipeline-migration-assistant:1.6.1 declarative-pipeline-migration-assistant-api:1.6.1 display-url-api:2.200.vb_9327d658781 docker-commons:439.va_3cb_0a_6a_fb_29 docker-java-api:3.3.1-79.v20b_53427e041 docker-plugin:1.5 docker-workflow:572.v950f58993843 dotnet-sdk:1.4.0 durable-task:523.va_a_22cf15d5e0 echarts-api:5.4.0-7 email-ext:2.102 font-awesome-api:6.4.2-1 git:5.2.1 git-client:4.5.0 github:1.37.3.1 github-api:1.316-451.v15738eef3414 github-branch-source:1741.va_3028eb_9fd21 gradle:2.9 instance-identity:185.v303dc7c645f9 ionicons-api:56.v1b_1c8c49374e jackson2-api:2.15.3-372.v309620682326 jakarta-activation-api:2.0.1-3 jakarta-mail-api:2.0.1-3 javax-activation-api:1.2.0-6 javax-mail-api:1.6.2-9 jaxb:2.3.9-1 jdk-tool:73.vddf737284550 jjwt-api:0.11.5-77.v646c772fddb_0 jquery3-api:3.7.1-1 junit:1259.v65ffcef24a_88 ldap:711.vb_d1a491714dc mailer:463.vedf8358e006b matrix-auth:3.2.1 matrix-project:822.824.v14451bc0fd42 metrics:4.2.18-442.v02e107157925 mina-sshd-api-common:2.11.0-86.v836f585d47fa mina-sshd-api-core:2.11.0-86.v836f585d47fa_ msbuild:1.30 mstest:1.0.5 mstestrunner:1.5.0 nunit:485.ve8a_85357320d okhttp-api:4.11.0-157.v6852a_a_fa_ec11 pam-auth:1.10 pipeline-build-step:516.v8ee60a_81c5b_9 pipeline-github-lib:42.v0739460cda_c4 pipeline-graph-analysis:202.va_d268e64deb_3 pipeline-graph-view:204.vf6b_83d21e246 pipeline-groovy-lib:689.veec561a_dee13 pipeline-input-step:477.v339683a_8d55e pipeline-maven:1362.vee39a_d4b_02b_1 pipeline-maven-api:1362.vee39a_d4b_02b_1 pipeline-milestone-step:111.v449306f708b_7 pipeline-model-api:2.2150.v4cfd8916915c pipeline-model-definition:2.2150.v4cfd8916915c pipeline-model-extensions:2.2150.v4cfd8916915c pipeline-rest-api:2.34 pipeline-stage-step:305.ve96d0205c1c6 pipeline-stage-tags-metadata:2.2150.v4cfd8916915c pipeline-stage-view:2.34 plain-credentials:143.v1b_df8b_d3b_e48 plugin-util-api:3.6.0 postbuild-task:1.9 powershell:2.1 resource-disposer:0.23 scm-api:676.v886669a_199aa script-security:1326.vdb_c154de8669 snakeyaml-api:2.2-111.vc6598e30cc65 ssh-credentials:308.ve4497b_ccd8f4 ssh-slaves:2.916.vd17b_43357ce4 sshd:3.312.v1c601b_c83b_0e structs:337.v1b_04ea_4df7c8 timestamper:1.26 token-macro:384.vf35b_f26814ec trilead-api:2.84.v72119de229b_7 variant:60.v7290fc0eb_bcd vstestrunner:1.0.8 workflow-aggregator:596.v8c21c963d92d workflow-api:1283.v99c10937efcb workflow-basic-steps:1042.ve7b_140c4a_e0c workflow-cps:3806.va_3a_6988277b_2 workflow-durable-task-step:1289.v4d3e7b01546b workflow-job:1360.vc6700e3136f5 workflow-multibranch:756.v891d88f2cd46 workflow-scm-step:415.v434365564324 workflow-step-api:639.v6eca_cd8c04aa workflow-support:865.v43e78cc44e0d ws-cleanup:0.45

What Operating System are you using (both controller, and any agents involved in the problem)?

Win10

Reproduction steps

1.Execute automated test which will include invocation TestContext.AddTestAttachments(filePath) in SetUp. 2.After test go to failed test and check added attachments. 3.Test result has only 3 sections like Error Message, Stacktrace and Standard Output without Attachments

Screen

Expected Results

Test result has attachment file

Actual Results

Test result doesn't have attachment file added during test execution.

Anything else?

This is part of test result xml file for test which added attachment:

<attachments>
                <attachment>
                  <filePath>C:\FileTasks\Test.txt</filePath>
                </attachment>
</attachments>

Are you interested in contributing a fix?

No response

jonesbusy commented 8 months ago

Hi,

You are right, this functionnality doesn't exists in the plugin (And I was not aware of it).

There is a plugin to handle attachement in Jenkins archivable : https://plugins.jenkins.io/junit-attachments/

It works for junit attachements but should be able to handle in attachement for results. In the meanwhile such functionnality is added to the plugin.

Regards,

mcichonqa commented 8 months ago

Hi, I tried to do workaround, but it looks like this will not work. I converted TRX and XML(NUnit) test results(includes attachments element) to JUnit test results, but after convertion JUnit results are without attachments element or I did something wrong.

I used trx2junit for convertion TRX to JUnit.

MJB222398 commented 3 months ago

@jonesbusy is there any update on this? Functionality would be very useful for my application.