testomatio / app

Testomat.io is a simplified test management system for your automated tests. Issues, project board & documentation. app.testomat.io
https://app.testomat.io
28 stars 2 forks source link

Automation test coverage shows 100% on analytics page regardless #1073

Closed selma-spread closed 1 month ago

selma-spread commented 3 months ago

Describe the bug When analysing 2 projects automation test coverage percentage doesnt recalculate

To Reproduce Steps to reproduce the behavior:

  1. Have two projects with one having more manual test cases and the other proportional automated test cases
  2. go to analytics page
  3. compare the analytics of both projects

Expected behavior Automation test coverage should recalculate percentage based on number of automated tests covered however it shows 100% Screenshots Screenshot 2024-07-15 at 15 37 52

Desktop (please complete the following information):

trumenov commented 1 month ago

Fields 'Automation Coverage' and 'Manual / Automated' is not the same. In 'Manual / Automated' you can see manual and automated tests counters. In 'Automation Coverage' you can see percents of tests with 'automatable_label' - settings for this label you can find in the settimgs modal here: image

So if you will add label "Automatable" to any of your tests you will see staticstics in this column. We already have discussion for renaming the 'Automation Coverage' naming, but it is still in progress.

DavertMik commented 1 month ago

Behavrios should be:

Manual vs Automated + label:Automatable

So if no Automatable label it will be

manual vs automated

if no automated tests but tests with automatable label:

manual vs label:automatable 

(current behavior)

TetianaKhomenko commented 1 month ago

Hi @selma-spread! The fix is live now. You can check it on your data