search

pynt-io / pynt

Apache License 2.0
49 stars 19 forks source link

[Question] : Please explain the Test status - Not executed & Not supported #8

Closed rakeshkmr516 closed 1 year ago

rakeshkmr516 commented 1 year ago

@origold1 @oferhakimi - Please explain the Test status - Not executed & Not supported - Do we need to do any additional configuration to make the not executed checks

origold1 commented 1 year ago

Hi @rakeshkmr516 , thank you for posting the question. We agree that our Security Summary table is a bit misleading now, we are working on an overhaul of the report structure. But for now, "Not executed" is relevant to API1 and API5 - adding more then one user to the functional tests will enable Pynt to test these as well. "Not supported" means we dont have tests for this category yet (API9). We will update when the new report is ready.

Thank you for running Pynt ! Ori

rakeshkmr516 commented 1 year ago

Hi @origold1 Appreciate your quick response.

  1. Not executed - Adding more than one user to functional tests - Does it mean adding more than one iterations value in postman or any specific pynt configuration

  2. Tests & Not supported - Looking forward to tests for the category API9 & updated changes report

origold1 commented 1 year ago

Hi @rakeshkmr516 Adding more users means having a second user in your functional test collection. Look at the goat collection example: https://www.postman.com/pynt-io/workspace/pynt/collection/22821296-23bb40ff-e0a6-40eb-8bf1-13016c206f8b?ctx=documentation We have 2 users (James and Lars) performing login, get account and get transatctions requests. Note that the second user does not have to do exactly all requests as the first user, login and a few requests are enough.

Ori