apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.68k stars 4.19k forks source link

[Feature Request]: a generic faas runner #24548

Open wilsonwang371 opened 1 year ago

wilsonwang371 commented 1 year ago

What would you like to happen?

Hi,

I am wondering if it is possible for beam to support running on a generic faas system(openwhisk for example). Definitely there are other components needed for beam such as MQ. Is it possible to define a generic interface that a faas system need to implement in order to run beam on top of it?

Thanks

Issue Priority

Priority: 3

Issue Component

Component: beam-community

kennknowles commented 1 year ago

I'm sure you could implement a Beam runner using FaaS. It could be a fun project if you want to try it!