m-lab / mlab-speedtest

Repository of the Interface and Project for speed.measurementlab.net
https://speed.measurementlab.net
Apache License 2.0
36 stars 14 forks source link

Integrate msak-js as multi-stream option #63

Closed robertodauria closed 6 months ago

robertodauria commented 7 months ago

Add option for multi-stream testing on speed.measurementlab.net by integrating msak-js.

@stephen-soltesz @laiyi-ohlsen Do you imagine this to be the default option? Should there be a checkbox to enable multi-stream? Perhaps a transition period so users can report if something is not working as intended? I'm not planning to start working on this before next week, but your input here would be much appreciated. :)

stephen-soltesz commented 7 months ago

App Engine allows you to run two versions simultaneously with two different implementations and compare. (I know speed.mlab doesn't run there); What if 50% of the time users get single-stream ndt and 50% they get single-stream msak and we compare? Do we get enough traffic to compare? Then we could gradually add more streams or other msak options.

Phrased differently, how do we get confidence that the msak js client performs as well as we'd like?