jbesw
commented
7 months ago Thanks - this will be live at https://serverlessland.com/repos/amazon-appflow-retry shortly.
Closed cata86 closed 7 months ago
jbesw
commented
7 months ago Thanks - this will be live at https://serverlessland.com/repos/amazon-appflow-retry shortly.
Description
This project implements retry functionality in Amazon AppFlow, as it is not natively supported. Amazon AppFlow does not provide built-in support for automatic retries in case of a failure. However, we can implement a custom retry mechanism using AWS EventBridge and a Lambda function.
To achieve this, we will set up an AWS EventBridge rule that listens for events generated by AppFlow when a flow execution fails. When AppFlow detects a failure, it can trigger an event that is sent to EventBridge. Then, we will create a Lambda function that is subscribed to this EventBridge rule.
The Lambda function will be responsible for handling the retry logic. It can examine the nature of the failure, apply any necessary transformations to the data, and attempt to re-execute the failed step of the flow. To manage the delay or backoff strategy the Lambda function use one StepFunction to prevent overwhelming the system in case of recurring failures.
language
English
runtime
Javascript
Level
200
Type
Examples
Use case
Backend
Primary image
https://github.com/cata86/AppFlowRetry/blob/main/resources/AppFlowRetry.png?raw=true
IaC framework
AWS SAM
AWS Serverless services used
Description headline
AppFlow failed job retry strategy
Repo URL
https://github.com/cata86/AppFlowRetry
Additional resources
https://aws.amazon.com/appflow/ https://aws.amazon.com/step-functions/ https://aws.amazon.com/lambda/ https://aws.amazon.com/eventbridge/ https://aws.amazon.com/sns/
Author Name
Andrea Catalano ; Davide Coccia
Author Image URL
https://internal-cdn.amazon.com/badgephotos.amazon.com/?fullsizeimage=1&give404ifmissing=1&uid=accata ; https://internal-cdn.amazon.com/badgephotos.amazon.com/?fullsizeimage=1&give404ifmissing=1&uid=dcoccia
Author Bio
Andrea Catalano is Solutions Architect at Amazon Web Service based in Italy. He is passionate about helping public sector organisations innovate and transform using cloud technology. His expertise is containers, identity management and serverless technologies.
Davide Coccia is a Technical Account Manager at Amazon Web Services focused on helping customers build, deploy, and run secure, resilient, and cost-effective workloads on AWS. He has a background in analytics consulting. Outside of work, he keeps himself busy with running, playing football (aka soccer) and learning any sort of new things.
Author Twitter handle
No response
Author LinkedIn URL
https://www.linkedin.com/in/andrea-catalano-24163215/ ; https://www.linkedin.com/in/davide-coccia-1921b529
leave
No response