Support for multithreaded execution with Pabot

reportportal / agent-Python-RobotFramework

Robot Framework integration for Report Portal

Apache License 2.0

59 stars 32 forks source link

Support for multithreaded execution with Pabot #65

Closed jaasal closed 3 years ago

jaasal commented 4 years ago

The Robot Framework agent should have support for reporting results from multithreaded Pabot (https://pabot.org/) execution.

It should be done so, that the end result in RP looks excactly like it would in basic Robot FW execution.

iivanou commented 4 years ago

@jaasal Actually, it supports reporting with pabot. You should create a new launch at RP and pass its UUID through the RP_LAUNCH_UUID variable.

Unfortunately, pabot is not multithreaded. It starts test suites in different processes, leaving us without any option to create a new launch automatically.

jaasal commented 4 years ago

@iivanou

That approach is not perfect, because it creates same top level suites multiple times:

Is there some easy workaround for this?

iivanou commented 4 years ago

Actually, they are not the same. They have the same name but the different uuid. The easiest way is to rename your test suites files.

jaasal commented 4 years ago

Could you elaborate?

My structure is:

tests
- UI
- 001 Login
  - TEST1
  - TEST2
- 002 Account
  - TEST1
  - TEST3
- RESTAPI
  - 001 ProductAPI
  - TEST1
  - TEST2
  - 002 SomeOtherAPI
  - TEST1
  - TEST2
- FunkyAPI
  - 001 Jazzy Suite
  - TEST1
  - TEST2 and so on...

I think this make perfectly sense in the default HTML report that Robot produces, also I had this working with RP4 but struggling with the new API.

iivanou commented 4 years ago

At the previous screenshot I saw test suites reported with the same name "UI". I though the you have a portion of test suites called "UI" located in different folders.