Get rid of spawning of child workers and instead refactor the code to only make use of activities

ooni / data

OONI Data CLI and Pipeline v5

https://docs.ooni.org/data

8 stars 4 forks source link

Get rid of spawning of child workers and instead refactor the code to only make use of activities #76

Closed hellais closed 2 weeks ago

hellais commented 2 months ago

This requires a bit more study and is an opportunity to do significant refactor of the activities and workflows in temporal. This is especially true if we are going to use the cloud solution where you pay by action, so the least actions we have the better.

I originally wanted to do this as part of https://github.com/ooni/data/pull/74, but I am moving it to another issue since I would like to take more time to do it carefully.

hellais commented 2 weeks ago

This was done here: https://github.com/ooni/data/commit/26db0bec16a0ddc45711af125d035957a00a59ec