search

bugsnag / bugsnag-android

BugSnag crash monitoring and reporting tool for Android apps
https://www.bugsnag.com/platforms/android/
Other
1.18k stars 205 forks source link

Reinstate instrumentation tests using MacOS test boxes as a platform #2034

Closed Cawllec closed 3 months ago

Cawllec commented 3 months ago

Goal

We've had to remove our instrumentation tests from github actions for a variety of reasons. This change adds a script which should add Android Virtual Devices and SDKs to our MacOS test boxes as required, using them to run the instrumentation tests. The version of android we're testing against is determined by the API_LEVEL environment variable, which should allow us to run against several different API levels if we see the need to.

Testing

It's successfully completed several test runs, and a negative test run to ensure the script failed successfully.

bugsnagbot commented 3 months ago

Android notifier sizes

Format Size impact of Bugsnag (kB) Size impact of Bugsnag when Minified (kB)
APK 1852.07 1675.96
arm64_v8a 631.04 450.82
armeabi_v7a 565.51 385.29
x86 704.75 528.62
x86_64 676.09 495.86

Generated by :no_entry_sign: Danger

lemnik commented 3 months ago

It's probably worth using the compressed option in the BK artifact plugin so that we just get a single zip file for the test reports.