search

reportportal / agent-python-pytest

Framework integration with PyTest
Apache License 2.0
94 stars 103 forks source link

Rerun adds new test case using pytest #335

Closed chahalprabh92 closed 1 year ago

chahalprabh92 commented 1 year ago

Describe the bug I am testing rerun functionality basically 1 have 1 test case and that fails

Screen Shot 2023-04-20 at 1 22 43 PM Screen Shot 2023-04-20 at 1 24 42 PM

now I want to rerun it

when I rerun

pytest -c pytest.one_id.rerun.ini one_id/1.py --rp_rerun=True --rp_rerun_of=28d79fca-ccfb-4d96-9753-b81a282d945d--reportportal

it adds new case in report portal

Screen Shot 2023-04-20 at 1 26 03 PM

new case remains in In_Progress forever

Screen Shot 2023-04-20 at 1 26 39 PM

...

Expected behavior IT should update exisitng test case results

Screenshots If applicable

Versions:

{'Python': '3.9.7', 'Platform': 'macOS-12.5.1-x86_64-i386-64bit', 'Packages': {'pytest': '6.0.2', 'pluggy': '0.13.1'}, 'Plugins': {'Faker': '13.14.0', 'rerunfailures': '11.0', 'html': '1.20.0', 'ordering': '0.6', 'metadata': '2.0.4', 'reportportal': '5.1.3'}} © Report Portal 2023 All rights reserved

HardNorth commented 1 year ago

@chahalprabh92 I cannot reproduce your case. Which agent version do you use?

chahalprabh92 commented 1 year ago

@HardNorth pytest-reportportal==5.1.3 reportportal-client==5.2.5

HardNorth commented 1 year ago

@chahalprabh92 Can you open the launch, click on edit icon on both items and send me screenshots?

chahalprabh92 commented 1 year ago

it shows total as 2 on main page

Screen Shot 2023-05-01 at 4 12 19 PM

clicking 2 shows

Screen Shot 2023-05-01 at 4 12 31 PM Screen Shot 2023-05-01 at 4 12 46 PM
HardNorth commented 1 year ago

@chahalprabh92 So the issue in incorrect statistics, right? Although I don't see rerun mark on the test itself, that weird.

chahalprabh92 commented 1 year ago

Yeah, also I am testing the flow Where for a test case it is failed initially and then on rerun it is pass This flow is not working. For rerun same case result should be updated.

On Mon, May 1, 2023 at 9:29 PM, Vadzim Hushchanskou < @.***> wrote:

@chahalprabh92 https://github.com/chahalprabh92 So the issue in incorrect statistics, right?

— Reply to this email directly, view it on GitHub https://github.com/reportportal/agent-python-pytest/issues/335#issuecomment-1530859461, or unsubscribe https://github.com/notifications/unsubscribe-auth/ARV3ORXDYJWX7VHIODC6ZSTXECEQ7ANCNFSM6AAAAAAXGW7HN4 . You are receiving this because you were mentioned.Message ID: @.***>

HardNorth commented 1 year ago

@chahalprabh92 then it doesn't look like client issue. Could you please take a look at service-api logs for any errors?

HardNorth commented 1 year ago

Abandoned