allure-framework / allure-js

Allure integrations for JavaScript test frameworks
https://allurereport.org/
Apache License 2.0
225 stars 121 forks source link

newman-allure-reporter -- custom allure labels set in postman are not displayed on the report #725

Closed rsivasubramaniam closed 1 month ago

rsivasubramaniam commented 1 year ago

Describe the bug Custom allure labels set in Postman are not displayed on the report in spite of the "/allure-results/XXXXXX-results.json --> labels[]" containing them

To Reproduce Steps to reproduce the behavior:

  1. Add some custom labels under the Postman test - e.g. // @allure.label.customLabel=someCustomValue (e.g. official test from the repo also contains a similar custom label --> https://github.com/allure-framework/allure-js/blob/master/packages/newman-reporter-allure/tests/overview.test.ts)
  2. Run the test using newman cli with allure as the reporter
  3. Generate the allure report locally or the report that was generated if using a CI platform like Jenkins / CircleCI
  4. The report will not contain the custom label values even though the results.json contains them

Expected behavior Allure report should contain the custom label values set from the PM test tab

Screenshots

E.g. Custom Labels set in PM:

image


E.g. Left - Allure report | Right - Results.json:

image

Desktop (please complete the following information):

newman-allure-reporter:

Additional context N/A

rohitvipin commented 4 months ago

Is there any update, feedback or workaround for this?

baev commented 1 month ago

As for now, Allure Report only supports specific sets of labels. You can find the complete information here: https://github.com/orgs/allure-framework/discussions/2059#discussioncomment-6616266

As for today, custom labels can be displayed in Allure TestOps. For Allure Report, we plan to improve this functionality and introduce additional flexibility in the upcoming 3.0 release