eroshenkoam / xcresults

55 stars 29 forks source link

[Xcode 15] Allure Report does not contain XCTest video recordings / screenshots #67

Open testableapple opened 8 months ago

testableapple commented 8 months ago

Hi there! In Xcode 15, Apple introduced Xcode test reports. It offers video recordings out of the box. Video recordings are enabled by default, and they replace screenshots:

Screenshot 2024-02-13 at 2 21 14 PM

The problem is that xcresults does not extract these video recordings. I assume this is because these recordings have some new format.

Environment

Steps

  1. Run the XCTests on iOS Simulator (17.2)
  2. xcresults export test_output/TestApp.xcresult allure_results/
  3. allurectl upload -e ${allure_url} --project-id ${allure_project_id} --launch-id ${allure_launch_id} allure_results/
  4. Open launch in Allure TestOps

Actual result

Expected result

mohamedwasiq commented 2 months ago

@testableapple @eroshenkoam Is there any fix for this ?

testableapple commented 2 months ago

Hi @mohamedwasiq, not that I am aware of. I just updated xctestplan to capture screenshots instead of the video recordings. Hope this helps.

mohamedwasiq commented 2 months ago

My test plan uses screenshots only, but still Allure is not able to capture the screenshots.

Screenshot 2024-08-28 at 14 14 55

I'm using Xcode 15.4

testableapple commented 2 months ago

Hi @mohamedwasiq, it's hard to say what's going wrong there. Works fine for me on xcresults 1.16.3. Maybe you could share the xcresults version that you use and a screenshot showing the preferred capture format in your testplan?