Refresh iOS 16 and 17 e2e test strategy - Githubissues

bugsnag / bugsnag-cocoa

BugSnag error monitoring & exception reporter for iOS, macOS, tvOS and watchOS

https://docs.bugsnag.com/platforms/ios

MIT License

234 stars 128 forks source link

Refresh iOS 16 and 17 e2e test strategy #1640

Closed twometresteve closed 5 months ago

twometresteve commented 5 months ago

Goal

Refresh the iOS 16/17 e2e test strategy to:

Run full set of e2e tests on iOS 17 for every Git push
Run subset of tests on all other iOS versions for each push
Always run app hang tests separately

Changeset

Full set of iOS 16 tests moved to the full pipeline
Barebones tests for iOS 16 added to the basic pipeline
App hang tests for iOS 17 factored into their own buildkite job

Due to the nature of the code diff, this PR would be best reviewed by inspecting the build results or each pipeline file as a whole.

Testing

Covered by a full CI run.

github-actions[bot] commented 5 months ago

Bugsnag.framework binary size did not change - 713,264 bytes

    FILE SIZE        VM SIZE    
 --------------  -------------- 
  [ = ]       0  [ = ]       0    TOTAL

Generated by :no_entry_sign: Danger