microsoft / FluidFramework

Library for building distributed, real-time collaborative web applications
https://fluidframework.com
MIT License
4.74k stars 536 forks source link

Skip flaky SharedString e2e test for ODSP and r11s #23187

Closed kian-thompson closed 6 days ago

kian-thompson commented 1 week ago

This test is observed to be somewhat flaky in the e2e pipeline. There isn't much to be done for this test as it's testing simple behavior, and the flakiness is most likely due to server performance at the time of the pipeline run. Since the test is simply verifying end-to-end flow (loader -> runtime -> DDS) for a specific feature, we can skip it for the specifically flaky drivers.

AB#12905 AB#13656

Data point side note when running the test 1000 times for specific drivers:

msfluid-bot commented 6 days ago
@fluid-example/bundle-size-tests: +245 Bytes
Metric NameBaseline SizeCompare SizeSize Diff
aqueduct.js 467.26 KB 467.3 KB +35 Bytes
azureClient.js 564.03 KB 564.08 KB +49 Bytes
connectionState.js 724 Bytes 724 Bytes No change
containerRuntime.js 263.45 KB 263.47 KB +14 Bytes
fluidFramework.js 428.91 KB 428.92 KB +14 Bytes
loader.js 134.18 KB 134.19 KB +14 Bytes
map.js 42.71 KB 42.71 KB +7 Bytes
matrix.js 150.15 KB 150.16 KB +7 Bytes
odspClient.js 530.39 KB 530.44 KB +49 Bytes
odspDriver.js 98.41 KB 98.43 KB +21 Bytes
odspPrefetchSnapshot.js 42.81 KB 42.83 KB +14 Bytes
sharedString.js 166.23 KB 166.24 KB +7 Bytes
sharedTree.js 419.37 KB 419.37 KB +7 Bytes
Total Size 3.38 MB 3.38 MB +245 Bytes

Baseline commit: 4e4b3e737a788dbd7dbb74c943db60bbd903640b

Generated by :no_entry_sign: dangerJS against c67b5cd2a6288aba00a8a698f8c87a3e36add245