Allow smartmodules on sink connectors to run client-side

infinyon / fluvio

Lean and mean distributed stream processing system written in rust and web assembly.

https://www.fluvio.io/

Apache License 2.0

2.77k stars 199 forks source link

Allow smartmodules on sink connectors to run client-side #4073

Open nacardin opened 1 week ago

nacardin commented 1 week ago

It would help with debugging since we now have stdout and stderr with wasi smartmodules. Currently the consumer smartmodules run on the SPU where its harder access stdout and stderr.

digikata commented 1 week ago

From a separate meeting:

needs further analysis on exactly what conditions smartmodules currently run on the spu
need to review dedupe and lookback interactions on where the sm is run