Section: AWS Services / Step Function

Idea-Pool / aws-testing

This repository contains guides on testing AWS services and in general about testing in AWS Cloud.

https://aws-testing.ideapool.community

Other

1 stars 2 forks source link

Section: AWS Services / Step Function #24

Open szikszail opened 1 year ago

szikszail commented 1 year ago

Links:

Source: https://github.com/Idea-Pool/aws-testing/blob/main/docs/aws-services/step-function.md

Tasks:

[ ] Introduce steps functions
[ ] Write about testing types and practices
[ ] Make sample stack
[ ] Make tests for the sample stack

Other useful material: On the Diverse And Fantastical Shapes of Testing.pdf Testing AWS Step Functions flows - DEV Community.pdf Testing strategies for Step Functions - Lumigo.pdf

szikszail commented 1 year ago

Tracking of https://jira.epam.com/jira/browse/EPMDEBIP-352

kornel-filep commented 1 year ago

My proposal would be to use 2 (or maybe all 3) from these examples:

Fan out a batch job using AWS Step Functions This seems like a general use-case where we have to fan out a big batch job. As this comes up a lot during development, including an example with this could be interesting and useful for the audience.
Dynamically process data with a Map state Data processing and writing to a DynamoDB would increase the scope of this step function testing, but as step functions are used a lot in data pipelines, this might be an interesting scenario to work on as well.
Poll for Job Status (Lambda, AWS Batch) And this one is just an easy job poller, which when a timeout happens returns with an error. We have a simple condition check in the step function so might as well include it as a simpler example.

@sorosz89 what do you think?

sorosz89 commented 1 year ago

Good idea, we can even use a simple one as well: Make a call to API Gateway

szikszail commented 1 year ago

https://github.com/Idea-Pool/poc-aws-step-function-cdk-testing

kornel-filep commented 1 year ago

https://github.com/Idea-Pool/poc-aws-step-function-cdk-testing

We could use this one as well, however in the scope of the topic we would also like to focus on testing step functions as a solution, with reasonable isolation, instead of pure infrastructure testing.