Investigate workflow job failing on main: e2ePerformanceTests / Run E2E tests in AWS device farm

[github-actions[bot]]

🚨 Failure Summary 🚨:

• 📋 Job Name: e2ePerformanceTests / Run E2E tests in AWS device farm
• 🔧 Failure in Workflow: Process new code merged to main
• 🔗 Triggered by PR: PR Link
• 👤 PR Author: @adhorodyski
• 🤝 Merged by: @mountiny
• 🐛 Error Message: warning: No matching artifact of type LOG found for debug.log, skipping failure: Test run failed after 3720 seconds with: undefined. Timeout is set to 7200 warning: No matching artifact of type LOG found for debug.log, skipping failure: Test run failed after 3350 seconds with: undefined. Timeout is set to 7200 failure: Process returned exit code 1 Launched as "/home/runner/runners/2.320.0/externals/node20/bin/node /home/runner/work/_actions/Wandalen/wretry.action/v3.5.0_js_action/src/Runner.mjs /home/runner/work/_actions/Wandalen/aws-devicefarm/test-application/dist/index.js" Launched at "/home/runner/work/App/App" Attempts exhausted, made 2 attempts : Attempt #1 started at : 18:22:24 GMT+0000 (Coordinated Universal Time) Attempt #2 started at : 19:29:52 GMT+0000 (Coordinated Universal Time) failure: Process completed with exit code 1.

⚠️ Action Required ⚠️:

🛠️ A recent merge appears to have caused a failure in the job named e2ePerformanceTests / Run E2E tests in AWS device farm. This issue has been automatically created and labeled with Workflow Failure for investigation.

👀 Please look into the following:

1. Why the PR caused the job to fail?
2. Address any underlying issues.

🐛 We appreciate your help in squashing this bug!

[mountiny]

Seems like it did not play that well because of the changed metrics but hopefully it will be fine on the next PRs

@adhorodyski @kirillzyusko @hannojg can you check if we need to do anything about these please?

[adhorodyski]

We need someone with access to the aws farm correct? Can I help in any way?

[kirillzyusko]

@mountiny I think it's expected failure, because we compare metrics with a previous commit. And since they were renamed - it's expected to have a crash in calculation, because we expect, that names in main/delta are the same.

I think subsequent runs (for next merged PRs) were successful? If so, then I think we can close this issue 🙂

[mountiny]

Yep sounds right to me