getsentry / sentry-react-native

Official Sentry SDK for React Native
https://sentry.io
MIT License
1.58k stars 338 forks source link

fix(ci): Skip maestro test if SENTRY_AUTH_TOKEN is unavailable or empty #4288

Closed antonis closed 3 days ago

antonis commented 4 days ago

:loudspeaker: Type of change

:scroll: Description

Skip maestro test if SENTRY_AUTH_TOKEN is unavailable or empty

:bulb: Motivation and Context

This is an additional fix after https://github.com/getsentry/sentry-react-native/pull/4269 since the CI issue was not solved https://github.com/getsentry/sentry-react-native/pull/4284#issuecomment-2483181486

:green_heart: How did you test it?

CI

:pencil: Checklist

:crystal_ball: Next steps

skip-changelog

github-actions[bot] commented 4 days ago

Android (legacy) Performance metrics :rocket:

  Plain With Sentry Diff
Startup time 435.00 ms 429.08 ms -5.92 ms
Size 17.74 MiB 20.08 MiB 2.34 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
70caa604a66a0a191f272363d4dd04d6f5950ba1+dirty 299.00 ms 321.02 ms 22.02 ms
fe135918376819714679fec8bf2bb2e1f07ec64b 478.92 ms 480.84 ms 1.92 ms
4cc5c276b8e06761211f41601792dfcbfc7dd854 460.04 ms 496.32 ms 36.28 ms
cdf2f334f8389e9747b61d338d9ba8945027b0d1 469.46 ms 462.17 ms -7.29 ms
d43a46b7be9152b013c84185112b1179619f8c86 454.22 ms 477.79 ms 23.57 ms
acadc0f974a0c234a3d9010117b076792d14d6e8+dirty 373.24 ms 381.51 ms 8.27 ms
5a22220fafc6352a2e07e20943dda325a4cf67f5 412.38 ms 447.35 ms 34.97 ms
d0bf49472b8e02ea40eab48e2e861b603450233e+dirty 375.37 ms 395.14 ms 19.77 ms
86d6d2c81bc42209de70f7f3b97a1fbbde04025f+dirty 332.90 ms 352.45 ms 19.55 ms
0d3e6775185b3030074b2bca3cb796e5d265910b 422.82 ms 411.90 ms -10.92 ms

App size

Revision Plain With Sentry Diff
70caa604a66a0a191f272363d4dd04d6f5950ba1+dirty 17.73 MiB 19.75 MiB 2.01 MiB
fe135918376819714679fec8bf2bb2e1f07ec64b 17.74 MiB 20.07 MiB 2.34 MiB
4cc5c276b8e06761211f41601792dfcbfc7dd854 17.73 MiB 19.95 MiB 2.21 MiB
cdf2f334f8389e9747b61d338d9ba8945027b0d1 17.74 MiB 20.08 MiB 2.34 MiB
d43a46b7be9152b013c84185112b1179619f8c86 17.73 MiB 20.06 MiB 2.33 MiB
acadc0f974a0c234a3d9010117b076792d14d6e8+dirty 17.73 MiB 19.75 MiB 2.01 MiB
5a22220fafc6352a2e07e20943dda325a4cf67f5 17.73 MiB 19.93 MiB 2.20 MiB
d0bf49472b8e02ea40eab48e2e861b603450233e+dirty 17.73 MiB 19.75 MiB 2.02 MiB
86d6d2c81bc42209de70f7f3b97a1fbbde04025f+dirty 17.73 MiB 20.04 MiB 2.31 MiB
0d3e6775185b3030074b2bca3cb796e5d265910b 17.74 MiB 20.07 MiB 2.34 MiB
github-actions[bot] commented 4 days ago

Android (new) Performance metrics :rocket:

  Plain With Sentry Diff
Startup time 414.80 ms 462.75 ms 47.95 ms
Size 7.15 MiB 8.35 MiB 1.20 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
70caa604a66a0a191f272363d4dd04d6f5950ba1+dirty 308.83 ms 393.06 ms 84.23 ms
2ec71da2fbe36565c59c20f960c72fc75737275c+dirty 375.64 ms 431.59 ms 55.95 ms
8c88ac762793289e8bff7071fed62020f14f350e+dirty 402.72 ms 434.32 ms 31.60 ms
728164bd341a3b0e14876d86101c4bcca5b1f1ed+dirty 335.93 ms 342.94 ms 7.01 ms
acadc0f974a0c234a3d9010117b076792d14d6e8+dirty 259.04 ms 304.67 ms 45.63 ms
d0bf49472b8e02ea40eab48e2e861b603450233e+dirty 253.73 ms 308.23 ms 54.49 ms
86d6d2c81bc42209de70f7f3b97a1fbbde04025f+dirty 267.21 ms 325.24 ms 58.04 ms
e540498478edf6f59bd7e731809a3ea6409dcc1c+dirty 408.56 ms 480.00 ms 71.44 ms
c639edf12520d1afee79e1ff2ba18df03ce70ec3+dirty 363.39 ms 414.78 ms 51.39 ms
6e8584e8f1988b33cc24c85f32711c91358905fa+dirty 383.37 ms 400.84 ms 17.47 ms

App size

Revision Plain With Sentry Diff
70caa604a66a0a191f272363d4dd04d6f5950ba1+dirty 7.15 MiB 8.03 MiB 901.79 KiB
2ec71da2fbe36565c59c20f960c72fc75737275c+dirty 7.15 MiB 8.38 MiB 1.23 MiB
8c88ac762793289e8bff7071fed62020f14f350e+dirty 7.15 MiB 8.35 MiB 1.20 MiB
728164bd341a3b0e14876d86101c4bcca5b1f1ed+dirty 7.15 MiB 8.12 MiB 997.71 KiB
acadc0f974a0c234a3d9010117b076792d14d6e8+dirty 7.15 MiB 8.03 MiB 903.20 KiB
d0bf49472b8e02ea40eab48e2e861b603450233e+dirty 7.15 MiB 8.04 MiB 910.85 KiB
86d6d2c81bc42209de70f7f3b97a1fbbde04025f+dirty 7.15 MiB 8.09 MiB 962.69 KiB
e540498478edf6f59bd7e731809a3ea6409dcc1c+dirty 7.15 MiB 8.38 MiB 1.23 MiB
c639edf12520d1afee79e1ff2ba18df03ce70ec3+dirty 7.15 MiB 8.35 MiB 1.20 MiB
6e8584e8f1988b33cc24c85f32711c91358905fa+dirty 7.15 MiB 8.13 MiB 1002.18 KiB
github-actions[bot] commented 4 days ago

iOS (legacy) Performance metrics :rocket:

  Plain With Sentry Diff
Startup time 1217.62 ms 1217.27 ms -0.35 ms
Size 2.36 MiB 3.10 MiB 753.04 KiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
457e29fc08e6edbebee646d095513d72728a5756+dirty 1253.94 ms 1269.18 ms 15.24 ms
d43a46b7be9152b013c84185112b1179619f8c86+dirty 1219.24 ms 1219.65 ms 0.41 ms
e5bc97b850117530a0b5a1fd7728fcf3909efb04+dirty 1230.63 ms 1234.83 ms 4.20 ms
9c48b2c9eb6422d8d51fcf56b1b4ab7841d2ec8a+dirty 1246.96 ms 1255.73 ms 8.77 ms
c639edf12520d1afee79e1ff2ba18df03ce70ec3+dirty 1236.18 ms 1235.04 ms -1.14 ms
3853f4362ec819042552ffa9ed30e8f6627e60bf+dirty 1221.82 ms 1242.64 ms 20.82 ms
52c056204eb6a8e4fe6e138e9307f2838242b4a6+dirty 1219.34 ms 1221.25 ms 1.91 ms
544699261cd72e3efc1259ba66b138f5f70a05ed+dirty 1273.28 ms 1276.68 ms 3.40 ms
0677344f8502b3ae15a3128bf239cf5571b92443+dirty 1276.70 ms 1300.07 ms 23.37 ms
8ae23a70cf23a4f7a3c54784f496e7af813b7a48+dirty 1230.02 ms 1227.62 ms -2.40 ms

App size

Revision Plain With Sentry Diff
457e29fc08e6edbebee646d095513d72728a5756+dirty 2.36 MiB 2.87 MiB 520.67 KiB
d43a46b7be9152b013c84185112b1179619f8c86+dirty 2.36 MiB 3.08 MiB 734.25 KiB
e5bc97b850117530a0b5a1fd7728fcf3909efb04+dirty 2.36 MiB 3.10 MiB 753.14 KiB
9c48b2c9eb6422d8d51fcf56b1b4ab7841d2ec8a+dirty 2.36 MiB 2.85 MiB 495.77 KiB
c639edf12520d1afee79e1ff2ba18df03ce70ec3+dirty 2.36 MiB 3.08 MiB 736.63 KiB
3853f4362ec819042552ffa9ed30e8f6627e60bf+dirty 2.36 MiB 2.85 MiB 499.81 KiB
52c056204eb6a8e4fe6e138e9307f2838242b4a6+dirty 2.36 MiB 3.14 MiB 793.36 KiB
544699261cd72e3efc1259ba66b138f5f70a05ed+dirty 2.36 MiB 2.88 MiB 531.94 KiB
0677344f8502b3ae15a3128bf239cf5571b92443+dirty 2.36 MiB 2.85 MiB 496.81 KiB
8ae23a70cf23a4f7a3c54784f496e7af813b7a48+dirty 2.36 MiB 3.10 MiB 752.42 KiB
github-actions[bot] commented 4 days ago

iOS (new) Performance metrics :rocket:

  Plain With Sentry Diff
Startup time 1233.91 ms 1232.16 ms -1.75 ms
Size 2.92 MiB 3.66 MiB 757.49 KiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
457e29fc08e6edbebee646d095513d72728a5756+dirty 1256.71 ms 1258.50 ms 1.79 ms
d43a46b7be9152b013c84185112b1179619f8c86+dirty 1223.31 ms 1230.92 ms 7.61 ms
e5bc97b850117530a0b5a1fd7728fcf3909efb04+dirty 1229.17 ms 1227.64 ms -1.54 ms
9c48b2c9eb6422d8d51fcf56b1b4ab7841d2ec8a+dirty 1253.39 ms 1256.30 ms 2.91 ms
c639edf12520d1afee79e1ff2ba18df03ce70ec3+dirty 1223.63 ms 1227.98 ms 4.35 ms
3853f4362ec819042552ffa9ed30e8f6627e60bf+dirty 1271.74 ms 1278.04 ms 6.30 ms
52c056204eb6a8e4fe6e138e9307f2838242b4a6+dirty 1233.94 ms 1226.29 ms -7.65 ms
544699261cd72e3efc1259ba66b138f5f70a05ed+dirty 1249.94 ms 1254.80 ms 4.86 ms
0677344f8502b3ae15a3128bf239cf5571b92443+dirty 1252.52 ms 1254.08 ms 1.56 ms
8ae23a70cf23a4f7a3c54784f496e7af813b7a48+dirty 1233.67 ms 1229.52 ms -4.15 ms

App size

Revision Plain With Sentry Diff
457e29fc08e6edbebee646d095513d72728a5756+dirty 2.92 MiB 3.43 MiB 524.75 KiB
d43a46b7be9152b013c84185112b1179619f8c86+dirty 2.92 MiB 3.64 MiB 740.29 KiB
e5bc97b850117530a0b5a1fd7728fcf3909efb04+dirty 2.92 MiB 3.66 MiB 758.40 KiB
9c48b2c9eb6422d8d51fcf56b1b4ab7841d2ec8a+dirty 2.92 MiB 3.41 MiB 499.97 KiB
c639edf12520d1afee79e1ff2ba18df03ce70ec3+dirty 2.92 MiB 3.64 MiB 742.55 KiB
3853f4362ec819042552ffa9ed30e8f6627e60bf+dirty 2.92 MiB 3.41 MiB 503.54 KiB
52c056204eb6a8e4fe6e138e9307f2838242b4a6+dirty 2.92 MiB 3.69 MiB 794.15 KiB
544699261cd72e3efc1259ba66b138f5f70a05ed+dirty 2.92 MiB 3.44 MiB 535.26 KiB
0677344f8502b3ae15a3128bf239cf5571b92443+dirty 2.92 MiB 3.41 MiB 500.94 KiB
8ae23a70cf23a4f7a3c54784f496e7af813b7a48+dirty 2.92 MiB 3.66 MiB 757.67 KiB