ooni / probe

OONI Probe network measurement tool for detecting internet censorship
https://ooni.org/install
BSD 3-Clause "New" or "Revised" License
754 stars 142 forks source link

dslx: allow to configure parallelism #2619

Open bassosimone opened 11 months ago

bassosimone commented 11 months ago

In https://github.com/ooni/probe-cli/pull/1388 we introduced code with fixed parallelism. We should be able to configure the parallelism because some experiments (e.g., whatsapp) are so lightweight that they could use heavy parallelism.

The overall objective here is to cleanup and review dslx, then start using it in production and rewrite experiments using it. In turn, by doing that, we'll enable collecting better throttling metrics for experiments.