search

botify-labs / simpleflow

Python library for dataflow programming.
https://botify-labs.github.com/simpleflow/
MIT License
68 stars 24 forks source link

AWS Lambda Tasks #169

Open fkshiomi opened 7 years ago

fkshiomi commented 7 years ago

Thanks for your hard work with SimpleFlow project.

SimpleFlow is very good library for Python/SWF. My team is planning to rewrite a nodeJS application in Python and we are going to use AWS SWF.

I would like to know:

Do you have support for "AWS Lambda Tasks" in SimpleFlow framework? Our application has many AWS Lambda Functions, it would be very nice, if "AWS SWF" coordinate invocations, timeouts, Error Handling, etc. for us. If not, is "SimpleFlow Team" planning to add “AWS Lambda Task” feature? We need this feature quite soon, could we help to add it? How can we help?

Regards Fabio Shiomi

ybastide commented 7 years ago

Hi Fabio!

Unfortunatly, simpleflow doesn't currently support Lambda functions. We plan to add them, but after landing child workflows and signals support, so hopefully in the next few weeks if it's as simple as it looks (famous last words).

ampelmann commented 7 years ago

@fkshiomi Hi Fabio,

You're more than welcome if you want to contribute and add the lambda feature into simpleflow !

Regards, Thomas

ybastide commented 7 years ago

Hi Fabio,

Here's a branch with minimal support for lambda functions: https://github.com/botify-labs/simpleflow/pull/230. Your handler receives a context dict containing an args list and kwargs dict (with the help of another branch, this will soon be generalized to arbitrary JSON).

The workflow must have a proper Lambda role (such as swf-lambda-function described in the documentation), specified either on the command line or as a workflow attribute.

Regards, Yves